-- Logs begin at Thu 2022-07-28 18:49:13 UTC, end at Thu 2022-07-28 20:45:07 UTC. -- Jul 28 19:49:27.485088 dv-cinder-851449-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 19:49:27.493868 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 19:49:27 2022] *** Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: nodename: dv-cinder-851449-1-iscsi Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: machine: x86_64 Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: clock source: unix Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: pcre jit disabled Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: detected number of CPU cores: 4 Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: current working directory: / Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: detected binary path: /usr/bin/uwsgi-core Jul 28 19:49:27.495839 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: your processes number limit is 47680 Jul 28 19:49:27.496467 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: your memory page size is 4096 bytes Jul 28 19:49:27.496467 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: detected max file descriptor number: 2048 Jul 28 19:49:27.496467 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: lock engine: pthread robust mutexes Jul 28 19:49:27.496467 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: thunder lock: enabled Jul 28 19:49:27.496467 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 19:49:27.496467 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 19:49:27.534752 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: Python main interpreter initialized at 0x5602734cb9c0 Jul 28 19:49:27.534752 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: python threads support enabled Jul 28 19:49:27.534752 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: your server socket listen backlog is limited to 100 connections Jul 28 19:49:27.534752 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: your mercy for graceful operations on workers is 90 seconds Jul 28 19:49:27.535098 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 19:49:27.535182 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: *** Operational MODE: preforking *** Jul 28 19:49:27.535406 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: *** uWSGI is running in multiple interpreter mode *** Jul 28 19:49:27.535406 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: spawned uWSGI master process (pid: 103244) Jul 28 19:49:27.535591 dv-cinder-851449-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 19:49:27.536177 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: spawned uWSGI worker 1 (pid: 103245, cores: 1) Jul 28 19:49:27.536507 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: spawned uWSGI worker 2 (pid: 103246, cores: 1) Jul 28 19:49:27.536685 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 19:49:28.206100 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 19:49:28.249411 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 19:49:29.289148 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:49:29.289148 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: from cryptography.utils import int_from_bytes Jul 28 19:49:29.289767 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:49:29.289767 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: from cryptography.utils import int_from_bytes Jul 28 19:49:29.302968 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:49:29.302968 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: from cryptography.utils import int_from_bytes Jul 28 19:49:29.303438 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:49:29.303438 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: from cryptography.utils import int_from_bytes Jul 28 19:49:31.763042 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 19:49:31.763865 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 19:49:31.763865 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 19:49:31.764156 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 19:49:31.764408 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 19:49:31.764819 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.765145 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.765463 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.765778 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.766105 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.766414 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.766732 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.767065 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.767373 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.767635 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.767948 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.768270 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-1-iscsi {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.768609 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.768916 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.769001 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 19:49:31.769370 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 19:49:31.769460 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.769540 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.769684 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 19:49:31.769816 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.770042 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 19:49:31.770138 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.770295 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 19:49:31.770422 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.770677 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.770916 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.771031 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.771309 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.771431 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.771621 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.771742 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.771940 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.772057 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.772245 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.772364 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.772583 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.772686 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.772897 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.772989 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.773215 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.773307 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.773469 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.773560 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.773781 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.773873 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.774099 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-1-iscsi {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.774198 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.774558 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-1-iscsi {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.774952 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.775048 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.775134 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.775277 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.775380 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.775456 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.775539 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.775745 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.775837 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.776062 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.776170 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.776373 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.776510 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.776740 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.776903 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.777062 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.777209 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.777368 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.777511 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.777696 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.777818 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.778011 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.778148 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.778326 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.778462 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.778642 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.778767 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.778942 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.779082 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.779247 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.779386 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.779553 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.779705 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.779867 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.780009 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.780169 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.780396 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-1-iscsi {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.780490 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.780733 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.780827 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.781038 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.781132 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.781350 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.781474 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.781666 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.781773 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.781984 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.782092 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.782235 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.782348 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.782480 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.782627 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.782796 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.782944 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.783112 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.783249 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.783419 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.783571 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.783725 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.783886 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.784031 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.784202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.784336 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.784515 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.784683 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.784838 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.784961 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.785143 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.785265 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.785451 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.785553 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.785764 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.785857 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.786066 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.786165 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.786366 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.786482 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.786618 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.786788 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.786899 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.787103 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.787217 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.787501 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.787595 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.787751 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.787838 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.788312 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.788409 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.788588 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.788694 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.788907 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.789006 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.789223 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.789309 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.789529 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.789614 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.790388 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.790895 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.791001 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.791084 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.791163 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.791241 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.791328 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.791431 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.791601 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.791719 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.791906 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.792010 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.792213 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.792299 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.792530 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.792666 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.792865 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.792961 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.793167 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.793318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.793475 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.793569 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.793779 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.793864 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.794086 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.794181 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.794390 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.794477 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.794690 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.794776 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.794996 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.795091 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.795300 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.795386 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.795603 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.795697 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.795908 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.796001 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.796212 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.796304 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.796513 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.796685 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.796841 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.796926 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.797143 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.797234 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.797452 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.797555 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.797769 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.797862 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.798067 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.798162 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.798316 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.798413 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.798621 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.798707 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.798923 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.799017 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.799238 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.799340 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.799544 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.799640 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.799846 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.799930 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.800146 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.800241 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.800445 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.800530 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.800776 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.800864 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.801080 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.801172 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.801382 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.801466 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.801689 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.801790 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.801993 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.802086 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.802291 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.802392 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.802590 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.802689 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.802890 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.802989 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.803191 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.803297 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.803495 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.803591 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.803798 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.803892 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.804099 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.804183 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.804398 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.804488 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.804724 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.804861 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.805028 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.805123 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.805327 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.805419 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.806341 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.806704 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.806833 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.806921 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.807000 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.807090 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.807170 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.807257 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.807478 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.807564 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.807781 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.807881 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.808084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.808170 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.808389 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.808476 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.808735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.808837 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.809035 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.809130 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.809340 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.809426 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.809653 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.809749 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.809958 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.810044 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.810261 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.810346 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.810560 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.810655 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.810862 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.810948 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.811162 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.811248 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.811463 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.811558 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.811767 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.811871 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.812067 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.812160 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.812364 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.812456 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.812701 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.812794 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.813019 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.813112 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.813322 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.813414 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.813626 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.813722 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.813930 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.814032 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.814245 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:49:31.814338 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.814554 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.814645 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.814871 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.814973 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.815198 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.815290 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.815509 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.815599 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.815814 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.815917 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.816153 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.816276 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.816470 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.816595 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.816803 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.816925 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.817115 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.817217 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.817437 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.817549 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.817745 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.817846 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.818051 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.818142 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.818360 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.818465 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.818680 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.818789 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.818994 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.819088 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.819306 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.819412 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.819618 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.819709 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.819926 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.820018 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.820237 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.820337 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.820563 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.820669 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.820879 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.820972 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.821222 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.821324 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.821552 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.821646 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.821907 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.822035 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.822243 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.822342 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.822586 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.822773 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.822899 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.823102 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.823239 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.823417 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.823514 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.823731 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.823824 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.824042 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.824129 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.824349 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.824437 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.824676 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.824782 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.824983 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.825076 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.825295 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.825382 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.825599 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.825686 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.825917 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.826003 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.826242 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.826329 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.826545 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.826632 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.826854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.826961 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.827167 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.827265 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.827473 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.827577 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.827782 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.827877 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.828091 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.828183 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.828394 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.828487 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.828727 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.828830 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.829035 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.829123 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.829338 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.829423 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.829645 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.829739 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.829950 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.830044 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.830250 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.830335 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.830551 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.830645 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.830859 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.830945 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.831158 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.831251 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.831470 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.831566 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.831782 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.831868 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.832086 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.832192 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.832390 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.832483 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.832723 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.832812 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.833033 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.833126 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.833343 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.833430 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.833649 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.833735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.833949 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.834038 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.834260 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.834348 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.834568 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.834654 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.834871 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.834966 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.835193 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.835280 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.835504 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.835588 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.835805 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.835902 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.836110 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.836194 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.836413 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.836497 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.837427 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.837874 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838013 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838098 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838183 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838263 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838340 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838432 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838541 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838626 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838844 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.838930 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.839147 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.839234 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.839448 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.839542 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.839756 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.839841 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.840062 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.840148 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.840363 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.840453 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.840690 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.840793 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.840994 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.841090 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.841331 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.841416 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.841633 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.841717 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.841933 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.842037 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.842243 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.842343 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.842543 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.842708 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.842844 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.842930 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.843145 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.843231 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.843450 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.843549 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.843748 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.843841 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.844051 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.844140 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.844352 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.844452 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.844677 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.844778 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.844980 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.845065 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.845296 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.845392 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.845602 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.845689 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.845901 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.845997 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.846203 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.846290 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.846503 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.846590 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.846819 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.846903 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.847124 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.847212 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.847447 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.847544 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.847776 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.847907 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.848090 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.848178 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.848406 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.848498 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.848739 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.848881 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.849048 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.849173 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.849355 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.849440 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.849661 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.849804 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.849967 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.850052 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.850272 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.850364 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.850580 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.850722 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.850887 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.850974 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.851195 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.851286 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.851501 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.851595 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.851807 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.851892 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.852115 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.852199 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.853178 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.853554 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.853646 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.853728 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.853807 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.853885 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.853971 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.854089 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.854301 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.854422 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.854633 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.854742 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.854942 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.855063 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.855254 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.855375 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.855574 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.855689 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.855884 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.855998 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.856194 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.856307 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.856503 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.856638 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.856831 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.856949 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.857136 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.857266 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.857456 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.857569 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.857771 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.857878 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.858081 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.858177 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.858391 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.858490 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.858694 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.858780 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.859006 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.859099 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.859314 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.859409 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.859617 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.859708 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.859919 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.860004 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.860230 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.860330 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.860564 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.860666 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.860880 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.860966 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.861204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.861303 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.861513 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.861598 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.861818 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.861902 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.862124 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.862222 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.862427 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.862535 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.862734 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.862832 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.863034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.863121 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.863339 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.863432 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.863643 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.863730 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.863949 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.864035 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.864250 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.864337 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.864582 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.864691 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.864899 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.865003 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.865199 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.865300 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.865500 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.865603 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.865809 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.865902 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.866115 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.866222 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.866424 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.866526 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.866739 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.866839 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.867050 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.867137 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.867349 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.867451 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.867651 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.867750 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.868186 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.868583 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.868583 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.868761 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.868849 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.868930 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.869008 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.869093 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.869278 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.869375 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.869619 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.869706 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.869928 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.870014 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.870231 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.870318 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.870546 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.870633 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.870865 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.870951 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.871174 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.871431 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.871518 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.871768 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.871853 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.872075 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.872237 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.872393 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.872478 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.872739 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.872876 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.873039 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.873139 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.873350 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.873438 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.873659 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.873749 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.873968 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.874055 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.874276 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.874375 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.874589 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.874675 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.874893 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.874992 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.875198 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.875284 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.875502 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.875588 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.875804 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.875897 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.876109 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.876195 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.876409 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.876494 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.876744 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.876992 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.877081 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.877327 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.877414 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.877633 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.877775 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.877938 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.878070 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.878253 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.878340 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.878555 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.878649 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.878867 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.878953 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.879170 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.879256 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.879490 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.879589 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.879800 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.879899 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.880106 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.880192 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.880407 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.880491 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.880733 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.880822 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.881043 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.881129 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.881349 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.881435 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.881653 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.881740 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.881955 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.882042 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.882265 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.882350 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.882567 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.882654 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.882868 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.882954 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.883172 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.883267 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.883476 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.883736 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.883973 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.884375 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.884448 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.884524 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.884630 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.884710 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.884802 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.884979 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.885109 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.885289 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.885418 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.885605 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.885722 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.885920 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.886027 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.886237 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.886332 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.886554 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.886643 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.886866 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.886952 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.887179 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.887267 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.887486 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.887574 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.887800 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.887896 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.888111 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.888197 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.888415 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.888503 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.888745 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.888846 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.889057 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.889143 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.889367 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.889458 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.889672 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.889772 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.889978 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.890063 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.890278 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.890362 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.890577 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.890671 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.890886 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.890972 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.891186 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.891271 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.891491 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.891578 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.891798 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.891883 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.892098 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.892191 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.892397 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.892484 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.892721 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.892817 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.893034 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.893122 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.893335 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.893421 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.893634 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.893719 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.893936 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.894031 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.894236 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.894321 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.894538 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.894624 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.894837 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.894930 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.895145 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.895238 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.895445 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.895531 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.895746 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.895910 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.896045 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.896138 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.896345 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.896429 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.896665 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.896772 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.896970 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.897054 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.897273 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.897415 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.897571 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.897658 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.897873 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.897995 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.898175 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.898261 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.898474 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.898561 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.898772 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.898856 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.899074 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.899685 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.900012 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.900401 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.900486 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.900594 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.900678 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.900757 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.900906 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.901059 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.901247 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.901376 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.901551 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.901680 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.901910 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.901996 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.902218 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.902305 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.902534 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.902628 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.902850 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.902935 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.903156 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.903241 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.903456 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.903551 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.903756 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.903842 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.904055 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.904151 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.904355 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.904450 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.904676 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.904780 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.904993 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.905079 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.905299 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.905393 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.905602 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.905696 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.905902 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.905988 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.906204 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.906292 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.906523 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.906609 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.906830 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.906914 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.907162 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.907248 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.907476 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.907561 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.907777 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.907861 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.908087 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.908173 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.908393 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.908486 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.908722 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.908809 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.909033 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.909121 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.909334 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.909418 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.909641 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.909740 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.909948 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.910032 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.910257 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.910343 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.910558 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.910655 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.910860 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.910951 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.911163 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.911249 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.911473 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.911622 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.911781 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.911873 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.912083 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.912167 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.912403 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.912498 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.912736 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.912824 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.913292 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.913382 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.913598 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.913686 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.913898 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.913984 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.914200 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.914287 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.914500 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.914597 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.914886 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.915400 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.915537 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.915631 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.915793 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.915888 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.916106 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.916193 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.916420 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.916506 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.916759 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.916848 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.917068 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.917162 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.917378 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.917473 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.917682 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.917767 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.917985 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.918102 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.918309 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.918448 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.918621 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.918709 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.918931 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.919017 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.919240 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.919336 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.919545 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.919631 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.919855 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.919942 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.920160 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.920256 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.920485 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.920589 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.920814 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.920899 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.921118 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.921214 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.921438 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.921535 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.921796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.921882 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.922107 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.922194 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.922421 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.922513 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.922738 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.922825 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.923044 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.923131 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.923458 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.923558 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.923772 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.923883 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.924083 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.924200 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.924393 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.924526 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.924722 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.924871 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.925027 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.925196 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.925339 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.925502 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.925660 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.925824 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.925964 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.926117 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.926266 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.926442 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.926568 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.926765 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.926887 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.927081 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.927190 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.927396 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.927507 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.927701 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.927919 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.928026 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.928226 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.928361 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.928529 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.928667 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.928964 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.929065 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.929279 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.929387 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.929590 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.929710 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.929913 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.930021 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.930234 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.930343 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.931398 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.931505 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.931597 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.931776 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.931864 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.932084 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.932170 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.932396 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.932492 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.932729 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.932819 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.933038 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.933124 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.933362 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.933503 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.933668 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.933755 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.933981 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.934067 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.934292 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.934380 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.934601 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.934687 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.934906 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.934994 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.935211 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.935307 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.935532 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.935620 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.935838 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.935925 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.936159 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.936248 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.936473 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.936584 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.936817 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.936916 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.937125 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.937214 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.937433 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.937519 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.937735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.937831 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.938039 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.938134 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.938348 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.938435 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.938648 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.938743 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.938948 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.939034 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.939255 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.939340 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.939568 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.939673 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.939870 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.939957 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.940172 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.940267 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.940493 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.940638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.940820 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.940908 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.941140 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.941234 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.941450 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.941538 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.941766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.941851 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.942081 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.942166 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.942382 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.942470 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.942692 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.942777 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.942996 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.943090 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.943294 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.943381 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.943594 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.943687 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.943894 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.943978 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.944197 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.944294 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.944505 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.944609 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.944829 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.944932 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.945132 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.945220 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.945433 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.945526 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.945753 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.945849 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.946211 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.946673 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.946673 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.946840 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.946920 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.947009 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.947169 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.947265 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.947474 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.947559 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.947782 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.947919 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.948084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.948170 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.948392 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.948533 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.948730 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.948821 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.949033 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.949123 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.949334 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.949420 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.949646 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.949742 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.949944 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.950038 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.950244 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.950330 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.950544 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.950703 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.950862 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.950954 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.951163 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.951249 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.951480 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.951568 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.951785 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.951872 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.952085 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.952181 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.952386 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.952472 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.952710 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.952800 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.953022 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.953126 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.953338 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.953425 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.953654 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.953742 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.953966 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.954173 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.954285 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.954502 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.954597 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.954816 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.954904 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.955128 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.955224 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.955439 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.955526 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.955751 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.955847 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.956063 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.956150 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.956373 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.956460 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.956706 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.956812 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.957017 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.957104 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.957327 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.957421 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.957634 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.957728 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.957949 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.958037 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.958265 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.958351 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.958580 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.958681 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.958903 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.959095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.959218 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.959420 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.959520 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.959737 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.959832 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.960046 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.960173 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.960354 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.960487 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.960688 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.960846 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.960999 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.961164 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.961308 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.961484 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.961616 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.962709 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.962818 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.962901 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.962991 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.963081 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.963170 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.963250 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.963435 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.963558 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.963760 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.963869 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.964092 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.964180 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.964409 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.964504 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.964751 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.964869 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.965066 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.965194 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.965380 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.965528 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.965733 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.965849 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.966045 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.966163 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.966351 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.966478 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.966663 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.966796 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.966978 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.967292 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.967392 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.967602 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.967696 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.967910 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.967997 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.968221 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.968315 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.968531 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.968725 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.968863 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.968960 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.969170 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.969266 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.969485 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.969573 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.969791 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.969876 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.970096 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.970184 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.970406 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.970493 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.970715 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.970800 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.971019 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.971107 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.971326 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.971412 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.971636 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.971721 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.971939 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.972147 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.972257 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.972457 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.972586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.972811 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.973117 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.973204 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.973443 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.973528 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.973758 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.973854 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.974074 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.974168 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.974394 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.974487 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.974697 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.974791 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.974999 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.975087 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.975307 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.975394 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.975611 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.975705 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.975910 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.975996 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.976222 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.976307 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.976527 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.976635 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.976849 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.976937 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.977151 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.977236 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.977516 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.978013 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.978108 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.978186 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.978296 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.978445 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.978612 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.978760 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.978919 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.979083 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.979246 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.979409 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.979553 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.979731 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.979856 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.980039 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.980160 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.980361 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.980470 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.980692 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.980793 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.981000 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.981095 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.981315 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.981402 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.981624 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.981710 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.981927 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.982013 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.982229 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.982317 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.982538 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.982624 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.982844 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.982930 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.983146 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.983234 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.983447 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.983540 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.983746 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.983840 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.984069 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.984158 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.984376 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.984492 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.984715 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.984824 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.985019 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.985123 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.985323 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.985409 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.985623 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.985720 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.985925 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.986019 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.986227 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.986314 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.986528 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.986623 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.986837 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.986935 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.987137 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.987225 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.987443 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.987684 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.987778 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.988023 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.988109 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.988323 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.988419 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.988653 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.988743 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.988999 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.989091 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.989307 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.989408 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.989613 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.989699 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.989912 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.989998 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.990225 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.990324 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.990531 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.990625 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.990838 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.990924 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.991147 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.991241 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.991456 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.991543 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.991766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.991851 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.992076 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.992164 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.992387 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.992646 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.992736 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.993588 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.994005 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.994005 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.994211 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.994293 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.994372 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.994460 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.994654 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.994750 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.994966 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.995052 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.995275 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.995379 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.995582 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.995669 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.995908 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.995994 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.996221 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.996387 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.996532 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.996669 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.996900 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.996988 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.997211 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.997312 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.997522 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.997610 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.997829 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.997914 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.998137 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.998235 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.998446 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.998543 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.998757 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.998843 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.999066 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.999159 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.999369 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.999455 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.999681 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.999766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:31.999992 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.000080 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.000301 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.000387 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.000647 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.000750 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.000987 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.001073 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.001304 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.001391 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.001621 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.001722 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.001933 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.002021 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.002247 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.002331 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.002554 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.002650 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.002860 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.002954 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.003168 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.003255 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.003476 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.003563 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.003789 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.003875 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.004105 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.004230 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.004408 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.004496 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.004736 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.004838 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.005066 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.005160 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.005356 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.005452 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.005663 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.005757 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.005965 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.006061 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.006266 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.006354 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.006573 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.006659 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.006876 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.006970 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.007177 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.007271 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.007479 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.007619 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.007780 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.007935 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.008090 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.008263 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.008389 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.009334 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.009693 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.009796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.009887 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.009968 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.010142 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.010236 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.010453 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.010548 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.010760 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.010847 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.011072 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.011167 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.011380 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.011468 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.011687 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.011772 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.011990 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.012077 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.012292 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.012380 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.012620 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.012709 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.012926 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.013029 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.013276 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.013370 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.013535 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.013623 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.013837 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.013933 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.014143 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.014231 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.014445 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.014536 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.014748 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.014843 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.015052 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.015146 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.015355 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.015448 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.015657 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.015752 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.015960 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.016047 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.016267 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.016354 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.016587 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.016678 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.016893 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.016979 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.017195 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.017282 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.017499 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.017586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.017800 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.017886 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.018115 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.018209 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.018442 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.018530 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.018752 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.018837 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.019065 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.019151 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.019371 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.019461 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.019693 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.019780 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.020000 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.020094 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.020316 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.020402 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.020653 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.020742 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.020968 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.021068 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.021278 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.021373 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.021585 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.021671 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.021895 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.021991 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.022203 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.022288 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.022510 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.022603 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.022817 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.022904 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.023124 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.023210 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.023433 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.023566 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.023745 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.023848 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.024058 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.024163 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.025227 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.025401 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.025500 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.025590 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.025737 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.025835 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.026061 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.026224 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.026378 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.026466 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.026690 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.026776 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.027018 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.027113 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.027329 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.027417 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.027637 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.027723 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.027946 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.028042 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.028256 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.028344 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.028581 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.028672 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.028884 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 19:49:32.028984 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.029200 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.029515 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.029831 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.030144 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.030468 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.030789 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.031098 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.031420 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.031740 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.032082 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.032391 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.032757 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.033085 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.033399 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.033707 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.034009 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:49:32.034249 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103246) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 19:49:32.182315 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO dbcounter [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Registered counter for database nova_api Jul 28 19:49:32.187473 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO dbcounter [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Registered counter for database nova_api Jul 28 19:49:32.204448 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG oslo_db.sqlalchemy.engines [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:32.207516 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_db.sqlalchemy.engines [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:32.210977 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writer thread running {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:32.214668 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writer thread running {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:32.266535 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.context [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4a45bd5e-a9aa-40c0-b86c-7b1b2576c347(cell1) {{(pid=103245) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 19:49:32.268917 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.context [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4a45bd5e-a9aa-40c0-b86c-7b1b2576c347(cell1) {{(pid=103246) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 19:49:32.270411 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:49:32.271987 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:49:32.272804 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:49:32.272910 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:49:32.275000 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:49:32.275368 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG oslo_concurrency.lockutils [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103245) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:49:32.275841 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:49:32.277333 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO dbcounter [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Registered counter for database nova_cell0 Jul 28 19:49:32.277837 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:49:32.279804 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO dbcounter [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Registered counter for database nova_cell0 Jul 28 19:49:32.282642 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO dbcounter [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Registered counter for database nova_cell1 Jul 28 19:49:32.285332 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO dbcounter [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Registered counter for database nova_cell1 Jul 28 19:49:32.292327 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG oslo_db.sqlalchemy.engines [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:32.293117 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG oslo_db.sqlalchemy.engines [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:32.294002 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_db.sqlalchemy.engines [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:32.297545 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_db.sqlalchemy.engines [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:32.299461 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writer thread running {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:32.300011 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writer thread running {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:32.436662 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writer thread running {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:32.438914 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writer thread running {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:32.446983 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO dbcounter [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Registered counter for database nova_cell0 Jul 28 19:49:32.449497 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO dbcounter [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Registered counter for database nova_cell0 Jul 28 19:49:32.455842 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG oslo_db.sqlalchemy.engines [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:32.459343 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_db.sqlalchemy.engines [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103246) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:49:32.460558 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writer thread running {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:32.464990 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writer thread running {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:49:32.800196 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: WARNING keystonemiddleware.auth_token [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 19:49:32.800791 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: WARNING keystonemiddleware.auth_token [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 19:49:32.807675 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: WARNING keystonemiddleware.auth_token [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 19:49:32.807810 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: WARNING keystonemiddleware.auth_token [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 19:49:33.151922 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: WARNING keystonemiddleware.auth_token [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 19:49:33.152623 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: WARNING keystonemiddleware.auth_token [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 19:49:33.157975 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: WARNING keystonemiddleware.auth_token [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 19:49:33.158548 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: WARNING keystonemiddleware.auth_token [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 19:49:33.163605 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602734cb9c0 pid: 103245 (default app) Jul 28 19:49:33.164045 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602734cb9c0 pid: 103246 (default app) Jul 28 19:49:33.166305 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:49:33.167486 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-c37aecc6-fa5a-447c-845e-5102dc8d1a44 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002320 Jul 28 19:49:33.167886 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Thu Jul 28 19:49:33 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:50:49.484647 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:50:49.485868 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Jul 28 19:50:49.486270 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:50:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:50:49.497339 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_api:SELECT=3 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:49.498453 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_cell1:SELECT=3 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:49.499531 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_cell0:SELECT=3 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:49.500880 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:50.362746 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-2e4a80c4-cc2a-41fd-8683-973a32543c7c admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:50:50.397265 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-2e4a80c4-cc2a-41fd-8683-973a32543c7c admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905061 Jul 28 19:50:50.408635 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 2/3] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jul 28 19:50:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:52.631674 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:50:52.632692 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-0ee29dea-9cc4-4c22-857f-fbbfa6cc4c2f None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001385 Jul 28 19:50:52.633631 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 2/4] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:50:53.117501 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-56a0ec45-ca86-4315-80b3-e0d61e1b9b8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:50:53.137785 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 19:50:53.137785 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: warnings.warn(msg) Jul 28 19:50:53.166941 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-56a0ec45-ca86-4315-80b3-e0d61e1b9b8c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.525987 Jul 28 19:50:53.167694 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 3/5] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:50:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:50:53.182047 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_api:SELECT=3 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:53.183133 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_cell0:SELECT=3 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:53.184127 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_cell1:SELECT=3 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:53.184869 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:50:53.392136 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-f1ae095e-b417-4637-9908-3e082dc919bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:50:53.396593 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 19:50:53.396593 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: warnings.warn(msg) Jul 28 19:50:53.464995 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-f1ae095e-b417-4637-9908-3e082dc919bc admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289182 Jul 28 19:50:53.465796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 3/6] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jul 28 19:50:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:50:55.698628 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-56a0ec45-ca86-4315-80b3-e0d61e1b9b8c admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:50:55.699629 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-56a0ec45-ca86-4315-80b3-e0d61e1b9b8c admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 28 19:50:55.700014 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 4/7] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:50:56.377777 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-33d42ecb-4c8b-4328-843e-09baeb0634fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:50:56.397416 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 19:50:56.397416 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: warnings.warn(msg) Jul 28 19:50:56.419537 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-33d42ecb-4c8b-4328-843e-09baeb0634fe admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.713520 Jul 28 19:50:56.427031 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 4/8] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:50:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:50:56.432508 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-a2f3c61b-a3d9-46dd-8f23-835227c413a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:50:56.435317 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 19:50:56.435317 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: warnings.warn(msg) Jul 28 19:50:56.468869 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-a2f3c61b-a3d9-46dd-8f23-835227c413a9 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039969 Jul 28 19:50:56.470042 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 5/9] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jul 28 19:50:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:50:58.717539 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-33d42ecb-4c8b-4328-843e-09baeb0634fe admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:50:58.717539 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-33d42ecb-4c8b-4328-843e-09baeb0634fe admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 28 19:50:58.717539 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:50:59.125993 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-c51e9cb2-fbed-4c23-bb2e-8f816a9be6a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "name": "ds1G"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:50:59.144859 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-c51e9cb2-fbed-4c23-bb2e-8f816a9be6a0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422610 Jul 28 19:50:59.145421 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 6/11] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:50:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:50:59.157694 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-ff88d3cb-d9ad-4261-9e1b-f24bbab3d5c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:50:59.185034 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-ff88d3cb-d9ad-4261-9e1b-f24bbab3d5c2 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030912 Jul 28 19:50:59.185628 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 6/12] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jul 28 19:50:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:01.396652 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-c51e9cb2-fbed-4c23-bb2e-8f816a9be6a0 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:01.397668 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-c51e9cb2-fbed-4c23-bb2e-8f816a9be6a0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 28 19:51:01.398977 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 7/13] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:01.820324 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-cfa53631-79ea-4a5d-bb1d-3fc31494942f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:01.839334 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-cfa53631-79ea-4a5d-bb1d-3fc31494942f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434824 Jul 28 19:51:01.840077 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 7/14] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:51:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:01.852429 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-64f274b5-e2e9-41bd-9b8d-3fbb86d793c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:01.879000 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-64f274b5-e2e9-41bd-9b8d-3fbb86d793c0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030827 Jul 28 19:51:01.879799 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 8/15] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jul 28 19:51:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:04.136655 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-cfa53631-79ea-4a5d-bb1d-3fc31494942f admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:04.137662 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-cfa53631-79ea-4a5d-bb1d-3fc31494942f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 28 19:51:04.138065 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 8/16] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:51:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:04.581783 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-c4c03603-a745-4d42-be7c-cd7b484edd1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "ram": 4096, "name": "ds4G"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:04.604417 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-c4c03603-a745-4d42-be7c-cd7b484edd1d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460167 Jul 28 19:51:04.605043 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 9/17] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:51:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:04.617101 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-e323b108-6a29-43cd-b90d-25ee45239ca1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:04.641946 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-e323b108-6a29-43cd-b90d-25ee45239ca1 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028415 Jul 28 19:51:04.643132 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 9/18] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jul 28 19:51:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:06.890112 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-c4c03603-a745-4d42-be7c-cd7b484edd1d admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:06.891444 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-c4c03603-a745-4d42-be7c-cd7b484edd1d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 Jul 28 19:51:06.891923 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 10/19] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:51:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:07.349706 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-5a006c8f-9e99-43c1-93f0-e79f48eeb27d admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:07.375056 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-5a006c8f-9e99-43c1-93f0-e79f48eeb27d admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.475171 Jul 28 19:51:07.375605 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 10/20] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jul 28 19:51:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:51:09.873113 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-c4c03603-a745-4d42-be7c-cd7b484edd1d admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:09.874174 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-c4c03603-a745-4d42-be7c-cd7b484edd1d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Jul 28 19:51:09.874585 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 11/21] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:51:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:10.323213 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-a57f4036-85dc-4c67-97a1-0f13b869fed8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "swap": 0, "vcpus": 1}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:10.343204 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-a57f4036-85dc-4c67-97a1-0f13b869fed8 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.462861 Jul 28 19:51:10.343756 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 11/22] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:51:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:10.356112 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-fac7695d-1d00-4e0f-a241-e4a00ea7f5af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:10.379250 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-fac7695d-1d00-4e0f-a241-e4a00ea7f5af admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026675 Jul 28 19:51:10.379798 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 12/23] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jul 28 19:51:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:12.566669 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-a57f4036-85dc-4c67-97a1-0f13b869fed8 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:12.567674 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-a57f4036-85dc-4c67-97a1-0f13b869fed8 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 28 19:51:12.568073 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 12/24] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:51:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:12.978639 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-161dd634-f2f8-4b17-8956-cb041e2acd71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:12.997444 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-161dd634-f2f8-4b17-8956-cb041e2acd71 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423298 Jul 28 19:51:12.997904 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 13/25] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:51:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:13.009566 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-0577ce0e-2689-483f-8230-788ead3402c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:13.033640 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-0577ce0e-2689-483f-8230-788ead3402c4 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027670 Jul 28 19:51:13.034306 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 13/26] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jul 28 19:51:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:51:15.329989 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-161dd634-f2f8-4b17-8956-cb041e2acd71 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:15.330928 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-161dd634-f2f8-4b17-8956-cb041e2acd71 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 28 19:51:15.331485 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 14/27] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:51:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:15.746975 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-0d29b54b-cbb6-4b5d-8765-bb127555f198 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:15.768146 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-0d29b54b-cbb6-4b5d-8765-bb127555f198 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.430620 Jul 28 19:51:15.768875 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 14/28] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:51:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:15.782129 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-7a1ae893-3212-4c38-9b34-9e50a6d1c52a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:15.807611 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-7a1ae893-3212-4c38-9b34-9e50a6d1c52a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029157 Jul 28 19:51:15.808192 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 15/29] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jul 28 19:51:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:18.031962 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-0d29b54b-cbb6-4b5d-8765-bb127555f198 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:18.032993 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-0d29b54b-cbb6-4b5d-8765-bb127555f198 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 28 19:51:18.033621 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 15/30] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:51:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:18.476004 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-b75101c8-83bb-439a-9fed-3ff3a471f9d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "swap": 0, "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:18.501057 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-b75101c8-83bb-439a-9fed-3ff3a471f9d0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461454 Jul 28 19:51:18.502172 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 16/31] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:51:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:18.515794 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-39331599-ab2d-4e5d-b02c-ea918d5aa89e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:18.542099 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-39331599-ab2d-4e5d-b02c-ea918d5aa89e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031022 Jul 28 19:51:18.542872 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 16/32] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jul 28 19:51:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:20.834480 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-b75101c8-83bb-439a-9fed-3ff3a471f9d0 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:20.837251 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-b75101c8-83bb-439a-9fed-3ff3a471f9d0 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003220 Jul 28 19:51:20.849551 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 17/33] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:51:20 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:21.315303 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-b359e415-29e1-423d-90b6-5eef5607fa27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "5", "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:21.339812 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-b359e415-29e1-423d-90b6-5eef5607fa27 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.494696 Jul 28 19:51:21.340412 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 17/34] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jul 28 19:51:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 19:51:21.352943 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-9def3f06-2f14-4893-acc4-f73161f3648d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:21.359313 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:21.382380 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-9def3f06-2f14-4893-acc4-f73161f3648d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033283 Jul 28 19:51:21.383159 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 18/35] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jul 28 19:51:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:51:41.328836 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-b359e415-29e1-423d-90b6-5eef5607fa27 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:41.329843 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-b359e415-29e1-423d-90b6-5eef5607fa27 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 28 19:51:41.330247 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 18/36] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:41.719659 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-60cb497b-8688-4eb1-841d-f482082fee60 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:41.737938 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-60cb497b-8688-4eb1-841d-f482082fee60 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401356 Jul 28 19:51:41.738467 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 19/37] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jul 28 19:51:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:51:42.799443 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-b359e415-29e1-423d-90b6-5eef5607fa27 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:42.800433 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-b359e415-29e1-423d-90b6-5eef5607fa27 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 28 19:51:42.800858 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 19/38] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:43.322781 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-10ad8b0f-c7a7-49a5-b41b-29c498fc4bda admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:43.328288 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.wsgi [None req-10ad8b0f-c7a7-49a5-b41b-29c498fc4bda admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-10ad8b0f-c7a7-49a5-b41b-29c498fc4bda admin admin] Request method failure captured: Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Accept: application/json Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Accept-Encoding: gzip, deflate Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Connection: keep-alive Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Content-Length: 0 Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Host: 10.222.0.67 Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Openstack-Api-Version: compute 2.90 Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Openstack-System-Scope: None Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: User-Agent: python-novaclient Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Auth-Token: gAAAAABi4ujOJJ0iE6yO1u37GcsQalqkekMEsbbLQIkB0xXzNIK1HIWoFiHoySDDVxkLjHmQzd9UxI8X_cXSDN3W2OYtQevmhffYuiqDYR74km_2W1q4Ezsy4kR7LK9laK32SzxAQU-dT5cg_ww55BI9KnbfGiC3-QnDOSD3Tru1S0uXU2o3gpU Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Domain-Id: None Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Domain-Name: None Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Identity-Status: Confirmed Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Is-Admin-Project: True Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Domain-Id: default Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Domain-Name: Default Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Name: admin Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Role: reader,admin,member Jul 28 19:51:43.331586 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Roles: reader,admin,member Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_16e1efa0795546bb9676ba6d30945871"}]}] Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Tenant: admin Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Tenant-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Tenant-Name: admin Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User: admin Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Domain-Id: default Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Domain-Name: Default Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Id: c0cafa7a21684da3b4e70e1d8e5bf629 Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Name: admin Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: method: > Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: exception: Flavor 42 could not be found. Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: action_args: {'id': '42'} Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:51:43.333291 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:43.334204 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.335475 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-10ad8b0f-c7a7-49a5-b41b-29c498fc4bda admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:51:43.336649 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-10ad8b0f-c7a7-49a5-b41b-29c498fc4bda admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396137 Jul 28 19:51:43.336649 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 20/39] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jul 28 19:51:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 19:51:43.343265 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-ac246bee-a94b-45af-a51f-dc8a809526b9 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:43.347338 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:51:43.368622 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-ac246bee-a94b-45af-a51f-dc8a809526b9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028920 Jul 28 19:51:43.369156 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 20/40] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jul 28 19:51:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:51:43.378724 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-c0226bae-d16e-49c9-87aa-e8fef529c8dc admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:43.402337 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-c0226bae-d16e-49c9-87aa-e8fef529c8dc admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027164 Jul 28 19:51:43.402865 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 21/41] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jul 28 19:51:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:51:43.412008 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-c1c6bf90-acc2-4592-bfd5-74d880112cb1 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:43.419071 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.wsgi [None req-c1c6bf90-acc2-4592-bfd5-74d880112cb1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-c1c6bf90-acc2-4592-bfd5-74d880112cb1 admin admin] Request method failure captured: Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Accept: application/json Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Accept-Encoding: gzip, deflate Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Connection: keep-alive Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Content-Length: 0 Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Host: 10.222.0.67 Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Openstack-Api-Version: compute 2.90 Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Openstack-System-Scope: None Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: User-Agent: python-novaclient Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Auth-Token: gAAAAABi4ujOJJ0iE6yO1u37GcsQalqkekMEsbbLQIkB0xXzNIK1HIWoFiHoySDDVxkLjHmQzd9UxI8X_cXSDN3W2OYtQevmhffYuiqDYR74km_2W1q4Ezsy4kR7LK9laK32SzxAQU-dT5cg_ww55BI9KnbfGiC3-QnDOSD3Tru1S0uXU2o3gpU Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Domain-Id: None Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Domain-Name: None Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Identity-Status: Confirmed Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Is-Admin-Project: True Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Domain-Id: default Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Domain-Name: Default Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Name: admin Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Role: reader,admin,member Jul 28 19:51:43.422318 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Roles: reader,admin,member Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_16e1efa0795546bb9676ba6d30945871"}]}] Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Tenant: admin Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Tenant-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Tenant-Name: admin Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User: admin Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Domain-Id: default Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Domain-Name: Default Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Id: c0cafa7a21684da3b4e70e1d8e5bf629 Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Name: admin Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: method: > Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: exception: Flavor 42 could not be found. Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: action_args: {'id': '42'} Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:51:43.423796 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:43.424834 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:43.426084 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-c1c6bf90-acc2-4592-bfd5-74d880112cb1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:51:43.427285 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-c1c6bf90-acc2-4592-bfd5-74d880112cb1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015202 Jul 28 19:51:43.427285 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 21/42] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jul 28 19:51:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 19:51:44.395300 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-c0226bae-d16e-49c9-87aa-e8fef529c8dc admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:44.396320 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-c0226bae-d16e-49c9-87aa-e8fef529c8dc admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 28 19:51:44.396743 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 22/43] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:51:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:44.930760 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-f12c16a0-32f7-4d8f-aca8-b151ed009d8b admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:44.936714 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.wsgi [None req-f12c16a0-32f7-4d8f-aca8-b151ed009d8b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-f12c16a0-32f7-4d8f-aca8-b151ed009d8b admin admin] Request method failure captured: Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Accept: application/json Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Accept-Encoding: gzip, deflate Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Connection: keep-alive Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Content-Length: 0 Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Host: 10.222.0.67 Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Openstack-Api-Version: compute 2.90 Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Openstack-System-Scope: None Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: User-Agent: python-novaclient Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Auth-Token: gAAAAABi4ujQVrQa6szSBYw2cPJlrkhoRjSxbED8BGmJldbcpmKFhRMKjjogAN8ekZiVulda2prpqQcpyv2y8Tox3-fyB9t6ROrYL44Pqs1e1fyQGo9QXqzDuCHrmkYh5lgse5tArdgq5V-U1EoQgQPQK6MoPgHxQ6MEzFReZrZLmny8rUhq4K0 Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Domain-Id: None Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Domain-Name: None Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Identity-Status: Confirmed Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Is-Admin-Project: True Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Domain-Id: default Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Domain-Name: Default Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Name: admin Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Role: reader,admin,member Jul 28 19:51:44.938202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Roles: reader,admin,member Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_16e1efa0795546bb9676ba6d30945871"}]}] Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Tenant: admin Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Tenant-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Tenant-Name: admin Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User: admin Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Domain-Id: default Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Domain-Name: Default Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Id: c0cafa7a21684da3b4e70e1d8e5bf629 Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Name: admin Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: method: > Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: exception: Flavor 84 could not be found. Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: action_args: {'id': '84'} Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:51:44.939699 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:44.940702 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:44.942006 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-f12c16a0-32f7-4d8f-aca8-b151ed009d8b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:51:44.943199 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-f12c16a0-32f7-4d8f-aca8-b151ed009d8b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.400448 Jul 28 19:51:44.943199 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 22/44] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jul 28 19:51:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 19:51:44.949128 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-4a0677de-25a2-49dc-b09a-97b870d406ec admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:44.964270 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-4a0677de-25a2-49dc-b09a-97b870d406ec admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018644 Jul 28 19:51:44.964816 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 23/45] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jul 28 19:51:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:51:44.974016 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-8e661cb8-17bc-494a-9de1-271c0446513a admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:44.989491 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-8e661cb8-17bc-494a-9de1-271c0446513a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019007 Jul 28 19:51:44.990014 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 23/46] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jul 28 19:51:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:51:44.999705 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d3a974dd-5b8b-4753-b78a-80fed5378321 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:45.004979 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.wsgi [None req-d3a974dd-5b8b-4753-b78a-80fed5378321 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d3a974dd-5b8b-4753-b78a-80fed5378321 admin admin] Request method failure captured: Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Accept: application/json Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Accept-Encoding: gzip, deflate Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Connection: keep-alive Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Content-Length: 0 Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Host: 10.222.0.67 Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Openstack-Api-Version: compute 2.90 Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Openstack-System-Scope: None Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: User-Agent: python-novaclient Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Auth-Token: gAAAAABi4ujQVrQa6szSBYw2cPJlrkhoRjSxbED8BGmJldbcpmKFhRMKjjogAN8ekZiVulda2prpqQcpyv2y8Tox3-fyB9t6ROrYL44Pqs1e1fyQGo9QXqzDuCHrmkYh5lgse5tArdgq5V-U1EoQgQPQK6MoPgHxQ6MEzFReZrZLmny8rUhq4K0 Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Domain-Id: None Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Domain-Name: None Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Identity-Status: Confirmed Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Is-Admin-Project: True Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Domain-Id: default Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Domain-Name: Default Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Name: admin Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Role: reader,admin,member Jul 28 19:51:45.007034 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Roles: reader,admin,member Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_16e1efa0795546bb9676ba6d30945871"}]}] Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Tenant: admin Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Tenant-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Tenant-Name: admin Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User: admin Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Domain-Id: default Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Domain-Name: Default Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Id: c0cafa7a21684da3b4e70e1d8e5bf629 Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Name: admin Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: method: > Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: exception: Flavor 84 could not be found. Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: action_args: {'id': '84'} Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:51:45.008515 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:45.009477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:45.010766 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-d3a974dd-5b8b-4753-b78a-80fed5378321 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:51:45.011988 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-d3a974dd-5b8b-4753-b78a-80fed5378321 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012332 Jul 28 19:51:45.011988 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 24/47] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jul 28 19:51:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 19:51:45.979369 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-8e661cb8-17bc-494a-9de1-271c0446513a admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:45.980374 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-8e661cb8-17bc-494a-9de1-271c0446513a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 28 19:51:45.980804 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 24/48] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:46.505777 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-036265e4-e869-4080-9cec-751f74a44df5 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:46.512122 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.wsgi [None req-036265e4-e869-4080-9cec-751f74a44df5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-036265e4-e869-4080-9cec-751f74a44df5 admin admin] Request method failure captured: Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Accept: application/json Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Accept-Encoding: gzip, deflate Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Connection: keep-alive Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Content-Length: 0 Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Host: 10.222.0.67 Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Openstack-Api-Version: compute 2.90 Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Openstack-System-Scope: None Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: User-Agent: python-novaclient Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Auth-Token: gAAAAABi4ujRH-ZLfKnqH6mrfVkiKKDuRAYFUJTF8KaeHAbxiPkH18AjkoAoC66DIyJAGzExGDwAlgwa5vTrofnsV0LLIuL9kL01BSDBBMdPpEZzFE6kEtxnJ2Lw7vL-vM2MVD0I1sJ2aU8KIVz92f3JDFMa0c9ePkgS4rkN7_lVF24pup08SkM Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Domain-Id: None Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Domain-Name: None Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Identity-Status: Confirmed Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Is-Admin-Project: True Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Domain-Id: default Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Domain-Name: Default Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Project-Name: admin Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Role: reader,admin,member Jul 28 19:51:46.513638 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Roles: reader,admin,member Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_16e1efa0795546bb9676ba6d30945871"}]}] Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Tenant: admin Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Tenant-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-Tenant-Name: admin Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User: admin Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Domain-Id: default Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Domain-Name: Default Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Id: c0cafa7a21684da3b4e70e1d8e5bf629 Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: X-User-Name: admin Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: method: > Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: exception: Flavor 451 could not be found. Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: action_args: {'id': '451'} Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:51:46.515209 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:46.517399 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.518698 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-036265e4-e869-4080-9cec-751f74a44df5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103245) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:51:46.519884 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-036265e4-e869-4080-9cec-751f74a44df5 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395986 Jul 28 19:51:46.519884 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 25/49] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jul 28 19:51:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 19:51:46.524658 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-1e6879ad-65da-49a9-9661-76ee9dda7119 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:46.540316 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-1e6879ad-65da-49a9-9661-76ee9dda7119 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018956 Jul 28 19:51:46.540876 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 25/50] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jul 28 19:51:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:51:46.550394 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:46.565704 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018784 Jul 28 19:51:46.566230 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 26/51] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jul 28 19:51:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:51:46.576323 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-d71781b6-dbc8-4dac-9228-6159f0116d08 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:46.581618 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.wsgi [None req-d71781b6-dbc8-4dac-9228-6159f0116d08 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-d71781b6-dbc8-4dac-9228-6159f0116d08 admin admin] Request method failure captured: Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Accept: application/json Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Accept-Encoding: gzip, deflate Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Connection: keep-alive Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Content-Length: 0 Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Host: 10.222.0.67 Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Openstack-Api-Version: compute 2.90 Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Openstack-System-Scope: None Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: User-Agent: python-novaclient Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Auth-Token: gAAAAABi4ujRH-ZLfKnqH6mrfVkiKKDuRAYFUJTF8KaeHAbxiPkH18AjkoAoC66DIyJAGzExGDwAlgwa5vTrofnsV0LLIuL9kL01BSDBBMdPpEZzFE6kEtxnJ2Lw7vL-vM2MVD0I1sJ2aU8KIVz92f3JDFMa0c9ePkgS4rkN7_lVF24pup08SkM Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Domain-Id: None Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Domain-Name: None Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Identity-Status: Confirmed Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Is-Admin-Project: True Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Domain-Id: default Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Domain-Name: Default Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Project-Name: admin Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Role: reader,admin,member Jul 28 19:51:46.583095 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Roles: reader,admin,member Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/16e1efa0795546bb9676ba6d30945871"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_16e1efa0795546bb9676ba6d30945871"}]}] Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Tenant: admin Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Tenant-Id: 16e1efa0795546bb9676ba6d30945871 Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-Tenant-Name: admin Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User: admin Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Domain-Id: default Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Domain-Name: Default Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Id: c0cafa7a21684da3b4e70e1d8e5bf629 Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: X-User-Name: admin Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: method: > Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: exception: Flavor 451 could not be found. Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: action_args: {'id': '451'} Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:51:46.584854 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:46.585693 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: ERROR nova.api.openstack.wsgi Jul 28 19:51:46.586735 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-d71781b6-dbc8-4dac-9228-6159f0116d08 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103246) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:51:46.587754 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-d71781b6-dbc8-4dac-9228-6159f0116d08 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011706 Jul 28 19:51:46.587754 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 26/52] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jul 28 19:51:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 19:51:47.561383 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:47.562382 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 28 19:51:47.562769 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 27/53] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:51:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:48.086483 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-6803e22a-1a0c-4096-a9d5-02cea7e599b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:48.105563 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-6803e22a-1a0c-4096-a9d5-02cea7e599b4 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406284 Jul 28 19:51:48.106116 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 27/54] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jul 28 19:51:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:49.075366 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:49.076400 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 28 19:51:49.076833 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 28/55] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:49.606993 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-65f41097-964d-4e3a-a7fd-64d319e1dada admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:49.625309 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-65f41097-964d-4e3a-a7fd-64d319e1dada admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.406024 Jul 28 19:51:49.625856 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 28/56] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jul 28 19:51:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:50.595172 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:50.596187 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 28 19:51:50.596602 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 29/57] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:51.118119 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-ee911917-3c2b-4d15-b121-f52523204c2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:51.139202 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-ee911917-3c2b-4d15-b121-f52523204c2d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.407433 Jul 28 19:51:51.139757 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 29/58] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jul 28 19:51:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 19:51:52.104899 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:52.105896 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 28 19:51:52.106281 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 30/59] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:52.625672 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-98ca0384-194c-4f55-ae2a-87f051747677 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:51:52.644423 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-98ca0384-194c-4f55-ae2a-87f051747677 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400467 Jul 28 19:51:52.645002 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 30/60] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jul 28 19:51:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:51:53.611443 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:53.612477 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 28 19:51:53.612904 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 31/61] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:51:54.147983 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-dec24377-b546-492d-a432-c595c2d275a1 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:51:54.168614 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-dec24377-b546-492d-a432-c595c2d275a1 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407042 Jul 28 19:51:54.169163 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 31/62] 10.222.0.67 () {60 vars in 1202 bytes} [Thu Jul 28 19:51:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:52:45.778963 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:52:45.779970 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-8b1ce0fb-8f59-4f3f-aa0d-38aef21746e3 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 28 19:52:45.780365 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 32/63] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jul 28 19:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:52:45.791383 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:46.187088 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-a6b86bcd-d25f-416e-9298-3a33fc878df9 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:52:46.208461 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-a6b86bcd-d25f-416e-9298-3a33fc878df9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.421479 Jul 28 19:52:46.208969 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 32/64] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jul 28 19:52:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:52:46.231439 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-3f6d25b2-46a5-43bc-93c7-e2098f548082 admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:52:46.234872 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG dbcounter [-] [103245] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:52:46.240226 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-3f6d25b2-46a5-43bc-93c7-e2098f548082 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012364 Jul 28 19:52:46.240901 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 33/65] 10.222.0.67 () {60 vars in 1282 bytes} [Thu Jul 28 19:52:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:52:46.252259 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-ca26845c-daf3-4635-a85e-6ec1680d6261 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:52:46.260976 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-ca26845c-daf3-4635-a85e-6ec1680d6261 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012171 Jul 28 19:52:46.261508 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 33/66] 10.222.0.67 () {60 vars in 1285 bytes} [Thu Jul 28 19:52:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:52:46.273830 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:52:46.281924 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012742 Jul 28 19:52:46.282445 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 34/67] 10.222.0.67 () {60 vars in 1285 bytes} [Thu Jul 28 19:52:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:52:46.294573 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-b54cfd9b-0a66-4152-bfd4-1a24375259c9 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:52:46.302198 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-b54cfd9b-0a66-4152-bfd4-1a24375259c9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011098 Jul 28 19:52:46.302710 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 34/68] 10.222.0.67 () {60 vars in 1282 bytes} [Thu Jul 28 19:52:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:56:18.781466 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:56:18.782503 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 28 19:56:18.782896 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 35/69] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:56:18.928908 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_api:SELECT=6 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:19.089869 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-f8792fca-c5c2-48bc-8ed1-366fb4f0ba3d admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:56:19.092801 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 19:56:19.092801 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: warnings.warn(msg) Jul 28 19:56:19.094015 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-f8792fca-c5c2-48bc-8ed1-366fb4f0ba3d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:56:19.094458 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-f8792fca-c5c2-48bc-8ed1-366fb4f0ba3d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:56:19.095238 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-f8792fca-c5c2-48bc-8ed1-366fb4f0ba3d admin admin] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:56:19.095669 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-f8792fca-c5c2-48bc-8ed1-366fb4f0ba3d admin admin] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:56:19.129521 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-f8792fca-c5c2-48bc-8ed1-366fb4f0ba3d admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.202109 Jul 28 19:56:19.130055 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 35/70] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jul 28 19:56:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:56:19.963112 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:56:19.964100 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jul 28 19:56:19.964488 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 36/71] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:56:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:56:20.153853 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-12e93d11-d505-428c-8df6-6508c3cd44fb admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:56:20.156408 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 19:56:20.156408 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: warnings.warn(msg) Jul 28 19:56:20.157713 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-12e93d11-d505-428c-8df6-6508c3cd44fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:56:20.158151 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-12e93d11-d505-428c-8df6-6508c3cd44fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:56:20.158963 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-12e93d11-d505-428c-8df6-6508c3cd44fb admin admin] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:56:20.159390 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-12e93d11-d505-428c-8df6-6508c3cd44fb admin admin] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:56:20.179346 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-12e93d11-d505-428c-8df6-6508c3cd44fb admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077178 Jul 28 19:56:20.179848 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 36/72] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jul 28 19:56:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 19:56:31.445671 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:56:31.446654 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jul 28 19:56:31.447048 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 37/73] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:56:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:56:31.591950 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_cell0:SELECT=4 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:31.592709 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_cell1:SELECT=4 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:31.593433 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG dbcounter [-] [103246] Writing DB stats nova_api:SELECT=8 {{(pid=103246) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:56:31.642938 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-79e43564-e959-4384-b43e-e8dc61a8bfe3 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:56:31.645414 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 19:56:31.645414 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: warnings.warn(msg) Jul 28 19:56:31.646599 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-79e43564-e959-4384-b43e-e8dc61a8bfe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:56:31.647061 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-79e43564-e959-4384-b43e-e8dc61a8bfe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:56:31.647844 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-79e43564-e959-4384-b43e-e8dc61a8bfe3 admin admin] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:56:31.648270 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-79e43564-e959-4384-b43e-e8dc61a8bfe3 admin admin] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:56:31.673231 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-79e43564-e959-4384-b43e-e8dc61a8bfe3 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085656 Jul 28 19:56:31.673784 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 37/74] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jul 28 19:56:31 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:56:32.498416 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: DEBUG nova.api.openstack.wsgi [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] Calling method '>' {{(pid=103245) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:56:32.499406 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: INFO nova.api.openstack.requestlog [None req-186cf2cc-bff6-4b67-b6f8-5621f2e2ab1a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Jul 28 19:56:32.499799 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: [pid: 103245|app: 0|req: 38/75] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jul 28 19:56:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:56:32.690070 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG nova.api.openstack.wsgi [None req-170e3ff5-0605-4470-9de0-326c57292ce7 admin admin] Calling method '>' {{(pid=103246) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:56:32.692413 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 19:56:32.692413 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: warnings.warn(msg) Jul 28 19:56:32.693615 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-170e3ff5-0605-4470-9de0-326c57292ce7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:56:32.694054 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-170e3ff5-0605-4470-9de0-326c57292ce7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:56:32.694835 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-170e3ff5-0605-4470-9de0-326c57292ce7 admin admin] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:56:32.695260 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: DEBUG oslo_concurrency.lockutils [None req-170e3ff5-0605-4470-9de0-326c57292ce7 admin admin] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103246) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:56:32.717614 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: INFO nova.api.openstack.requestlog [None req-170e3ff5-0605-4470-9de0-326c57292ce7 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079043 Jul 28 19:56:32.718099 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: [pid: 103246|app: 0|req: 38/76] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jul 28 19:56:32 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:57:28.540092 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: Thu Jul 28 19:57:28 2022 - graceful shutdown triggered... Jul 28 19:57:28.540231 dv-cinder-851449-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 19:57:28.541231 dv-cinder-851449-1-iscsi devstack@n-api.service[103245]: Gracefully killing worker 1 (pid: 103245)... Jul 28 19:57:28.542043 dv-cinder-851449-1-iscsi devstack@n-api.service[103246]: Gracefully killing worker 2 (pid: 103246)... Jul 28 19:57:29.541698 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: worker 1 buried after 1 seconds Jul 28 19:57:29.541698 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: worker 2 buried after 1 seconds Jul 28 19:57:29.541698 dv-cinder-851449-1-iscsi devstack@n-api.service[103244]: goodbye to uWSGI. Jul 28 19:57:29.543380 dv-cinder-851449-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 19:57:29.543914 dv-cinder-851449-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 19:57:29.546642 dv-cinder-851449-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 19:57:29.555709 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 19:57:29.558347 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 19:57:29 2022] *** Jul 28 19:57:29.558505 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 19:57:29.559228 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 19:57:29.559389 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: nodename: dv-cinder-851449-1-iscsi Jul 28 19:57:29.559516 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: machine: x86_64 Jul 28 19:57:29.559796 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: clock source: unix Jul 28 19:57:29.559911 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: pcre jit disabled Jul 28 19:57:29.560044 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: detected number of CPU cores: 4 Jul 28 19:57:29.560213 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: current working directory: / Jul 28 19:57:29.560329 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: detected binary path: /usr/bin/uwsgi-core Jul 28 19:57:29.560447 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: your processes number limit is 47680 Jul 28 19:57:29.560591 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: your memory page size is 4096 bytes Jul 28 19:57:29.560718 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: detected max file descriptor number: 2048 Jul 28 19:57:29.560832 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: lock engine: pthread robust mutexes Jul 28 19:57:29.561115 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: thunder lock: enabled Jul 28 19:57:29.561430 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 19:57:29.561633 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 19:57:29.601690 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: Python main interpreter initialized at 0x5628d50979c0 Jul 28 19:57:29.601690 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: python threads support enabled Jul 28 19:57:29.601690 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: your server socket listen backlog is limited to 100 connections Jul 28 19:57:29.601690 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: your mercy for graceful operations on workers is 90 seconds Jul 28 19:57:29.602146 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 19:57:29.602146 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: *** Operational MODE: preforking *** Jul 28 19:57:29.602396 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: *** uWSGI is running in multiple interpreter mode *** Jul 28 19:57:29.602396 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: spawned uWSGI master process (pid: 117954) Jul 28 19:57:29.602600 dv-cinder-851449-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 19:57:29.604620 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: spawned uWSGI worker 1 (pid: 117968, cores: 1) Jul 28 19:57:29.604620 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: spawned uWSGI worker 2 (pid: 117969, cores: 1) Jul 28 19:57:29.604620 dv-cinder-851449-1-iscsi devstack@n-api.service[117954]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 19:57:30.265885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 19:57:30.266521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 19:57:31.417202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:57:31.417202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: from cryptography.utils import int_from_bytes Jul 28 19:57:31.417855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:57:31.417855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: from cryptography.utils import int_from_bytes Jul 28 19:57:31.422684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:57:31.422684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: from cryptography.utils import int_from_bytes Jul 28 19:57:31.423185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 19:57:31.423185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: from cryptography.utils import int_from_bytes Jul 28 19:57:33.849189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 19:57:33.849905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 19:57:33.850303 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 19:57:33.850407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 19:57:33.850491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 19:57:33.850589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 19:57:33.850675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 19:57:33.850756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 19:57:33.850838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 19:57:33.850921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 19:57:33.851001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.851081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.851485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.851600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.851689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.851774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.851856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.852051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.852217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.852327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.852479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.852672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.852902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.853011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.853226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.853357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.853545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.853671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.853826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.853922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.854105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.854277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.854424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-1-iscsi {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.854576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851449-1-iscsi {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.854722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.854885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.855155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.855881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.856085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.856244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.856412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.856645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.856816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.856968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.857121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.857298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.857477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.857698 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.857875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.859341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.859341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.859807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.860033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.860262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.860514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.860753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.860978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.861212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.861212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.861648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.861869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.862105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.862354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.862576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.862787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.863012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.863234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.863463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.863712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.863932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.864168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-1-iscsi {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.864387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851449-1-iscsi {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.864613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.864795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.865380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.865542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.865698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.865852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.867000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.867192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.867396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.867555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.867759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.867935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.868091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.868245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.868409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.868581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.868743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.868900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.869046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.869201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.869359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.869511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.869656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.869819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.870015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.870209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.870366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.870519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.870670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.870829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.871611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.871778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.871935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.872091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.872244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.872397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.872615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.872782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.872935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.873092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.873244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.873399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.873551 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.873708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.873855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.874000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.874156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.874314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.874483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.874638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.874793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.874947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.875375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.875679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.875841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.875998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.876147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.876446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.876640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.876874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.877214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.877381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.877539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.877694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.877888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.877888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.878192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.878339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.878484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.878635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.878795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.878961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.879115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.879269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.879413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.879568 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.879723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.879875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.880027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.880171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.880323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.880323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.880631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.880631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.880933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.881087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.881232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.881384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.881543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.881688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.881842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.881995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.882141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.882301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.882455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.882601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.882752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.882920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.883073 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.883229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.884222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.884383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.884498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.884638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.884793 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.884946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.885120 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.885750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.885750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.886071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.886282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.887090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.887509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.887711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.887711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.888076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.888274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.888429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.888429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.888765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.888920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.889086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.889247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.889399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.889567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.889742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.889890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.890035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.890179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.890382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.890610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.890770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.890887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.891000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.891111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.891254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.891497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.891648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.891816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.891993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.892147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.892994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.893176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.893340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.893519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.893669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.893669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.894023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.894023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.894423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.894668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.894668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.895006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.895177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.895383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.896058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.896261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.896410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.896606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.896731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.896731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.896986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.897492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.897763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.897916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.898142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.898328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.898328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.898615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.898758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.898910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.899069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.899247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.899430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.899591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.899737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.899881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.900035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.900035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.900395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.900592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.900592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.900877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.901039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.901185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.901349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.901495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.901646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.901790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.903368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.903368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.903724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.903881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.904066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.904301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.904451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.904843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.905043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.905191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.905355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.905503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.905503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.906300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.906420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.906543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.906658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.906658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.906824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.906927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.907111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.907227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.907521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.907627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.907627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.907841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.908154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.908287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.908420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.908565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.908664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.908664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.908908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.909023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.909170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 19:57:33.909297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.909297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.909571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.909694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.909807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.909899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.910056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.910152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.910252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.910352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.910438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.910642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.910642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.910891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.911017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.911128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.911328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.911452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.911590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.911835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.911954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.911954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.912223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.912365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.912471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.912621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.912753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.912901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.912901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.912901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.913514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.913622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.913704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.913842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.913842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.914047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.914141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.914229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.914364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.914502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.914615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.914615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.914823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.914971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.915089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.915254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.915412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.915536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.915721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.915829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.915829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.916414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.916414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.916672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.916747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.916845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.916940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.917034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.917133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.917133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.917298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.917390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.917569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.917667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.918555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.918691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.918863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.918956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.919941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.920988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.921921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922703 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.922959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.923055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.923141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.923285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.923487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.923641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.923739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.923833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.923919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.924064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.924204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.924327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.924449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.924592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.924725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.924848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.924989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.924989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.925269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.925403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.925524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.925524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.925524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.925832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.925954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.926075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.926216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.926597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.926730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.926845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.926971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.927084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.927196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.927315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.927428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.927554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.927673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.927794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.927906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.928025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.928145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.928267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.928417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.928502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.928876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.928991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.929111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.929317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.929469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.929617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.929789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.930494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.930666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.930818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.930972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.931140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.931289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.931438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.931596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.931741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.931883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.932025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.932270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.932420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.932647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.932790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.932934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.933075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.933232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.933469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.934543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.934543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.934543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.934543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.935364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.935524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.935702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.935850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.935850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.936131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.936272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.936463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.936775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.936924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.937074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.937230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.937381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.937529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.937671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.937818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.937966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.938108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.938246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.938404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.938552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.938719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.938976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.939131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.939284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.939450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.939622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.939759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.939898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.940036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.940193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.940342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.940502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.940665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.940804 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.940955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.941105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.941245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.941382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.941520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.941794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.941949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.942975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943159 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943337 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.943869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.944071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.944169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.944378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.944486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.944727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.944822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.945039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.945135 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.945353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.945459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.945663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.945754 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.945981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.946074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.946286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.946388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.946596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.946709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.946920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.947025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.947230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.947324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.947543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.947643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.947853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.947959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.948170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.948271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.948480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.948667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.948824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.949033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.949205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.949349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.949486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.949620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.949839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.949939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.950150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.950250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.950465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.950577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.950775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.950889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.951082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.951184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.951386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.951481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.951702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.951855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.952028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.952134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.952306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.952411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.952641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.952763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.952956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.953063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.953271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.953368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.953579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.953685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.953887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.953981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.954193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.954296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.954494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.954597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.954797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.954900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.955101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.955206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.955407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.955503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.955708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.955811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.956009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.956105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.956312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.956416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.956666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.956774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.956982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.957089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.957287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.957386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.957587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.957691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.957908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.958017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.958215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.958312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.958520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.958616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.958825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.958931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.959137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.959234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.959453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.959578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.959768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.959897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.960076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.960191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.960382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.960525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.960719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.960831 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.961032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.961141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.961341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.961442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.961653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.961765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.961983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.962156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.962297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.962393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.962559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.962648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.962845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.962959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.963153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.963248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.963466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.963567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.963776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.964048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.964149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.964379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.964497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.964756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.964854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.965155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.965256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.965472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.965567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.965779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.965872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.966091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.966192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.966410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.966504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.966747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.966982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.967110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.967318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.967467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.967632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.967734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.967932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.968024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.968240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.968335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.968560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.968670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.968875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.968970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.969180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.969281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.969485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.969594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.969839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.970007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.970164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.970269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.970364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.970450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.970653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.970749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.970964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.971067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.971264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.971366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.971572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.971666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.971872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.971974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.972184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.972286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.972486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.972613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.972815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.972921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.973117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.973216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.973415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.973506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.973727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.973820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.974033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.974134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.974349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.974464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.974656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.974780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.974982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.975089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.975291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.975387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.975589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.975695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.975910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.976006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.976210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.976306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.976512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.976642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.976841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.976958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.977145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.977251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.977457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.977562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.977749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.977913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.978055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.978218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.978361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.978523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.978671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.978849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.978976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.979154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.979273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.979459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.979553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.979766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.979877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.980083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.980177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.980931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.981177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.981284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.981492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.981587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.981797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.981891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.982108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.982218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.982422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.982527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.982721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.982814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.983026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.983128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.983328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.983422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.983640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.983740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.983942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.984043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.984246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.984349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.984575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.984671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.984877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.985022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.985185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.985285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.985485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.985584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.985792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.985894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.986100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.986216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.986400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.986504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.986703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.986816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.987006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.987101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.987308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.987410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.987610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.987720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.987915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.988019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.988216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.988318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.988558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.988654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.988862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.988967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.989169 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.989289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.989468 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.989570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.989770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.989872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.990066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.990172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.990373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.990485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.990670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.990765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.990974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.991078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.991276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.991378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.991576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.991671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.991876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.992054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.992180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.992279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.992489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.992613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.992820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.992927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.993123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.993225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.993423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.993517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.993727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.993842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.994029 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.994126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.994330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.994426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.994638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.994745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.994963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.995060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.995272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.995375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.995579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.995675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.995973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.996650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.996842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.997025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.997329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.997430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.997648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.997745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.997960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.998054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.998273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.998375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.998576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.998669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.998877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.998977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.999199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.999301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.999515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.999615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.999825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:33.999992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.000127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.000220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.000441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.000647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.000800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.000962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.001060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.001197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.001368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.001507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.001670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.001823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.001982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.002123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.002270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.002410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.002589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.002740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.002889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.003032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.003182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.003325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.003465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.003615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.003763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.003912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.004053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.004202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.004352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.004503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.004683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.004829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.004997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.005156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.005316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.005461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.005608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.005749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.005889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.006030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.006184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.006327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.006478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.006626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.006774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.006930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.007071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.007213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.007397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.007548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.007709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.007947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.008094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.008249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.008402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.008560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.008699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.008853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.008995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.009135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.009284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.009452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.009589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.009740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.009888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.010036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.010194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.010434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.010539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.010726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.010869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.011011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.011153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.011295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.011396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.011513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.011775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.011876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.012094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.012224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.012410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.012507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.012775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.012869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.013084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.013187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.013390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.013521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.013694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.013836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.014017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.014150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.014320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.014463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.014641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.014776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.015056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.015172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.015370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.015483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.015673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.015765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.015988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.016089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.016296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.016387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.016622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.016719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.016951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.017062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.017259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.017382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.017585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.017689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.017931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.018037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.018242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.018344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.018550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.018651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.018873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.019019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.019181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.019325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.019497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.019662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.019816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.019960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.020101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.020242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.020396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.020588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.020744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.020852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.021056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.021151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.021377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.021511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.021778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.021879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.022104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.022199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.022413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.022507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.022725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.022875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.023032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.023135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.023338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.023432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.023641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.023734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.023948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.024057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.024254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.024356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.024572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.024710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.024899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.025038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.025202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.025349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.025544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.025697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.025843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.025994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.026145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.026294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.026442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.026595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.026744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.026894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.027037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.027661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.027907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.028005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.028239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.028357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.028560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.028669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.028896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.028995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.029211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.029305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.029513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.029647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.029816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.029918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.030122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.030215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.030427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.030560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.030767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.030874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.031029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.031124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.031352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.031483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.031705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.031845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.031975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.032103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.032287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.032456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.032610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.032752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.032909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.033038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.033210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.033342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.033516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.033661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.033822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.033954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.034160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.034291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.034462 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.034594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.034773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.034911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.035075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.035207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.035381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.035516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.035686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.035818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.035990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.036129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.036293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.036435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.036603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.036747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.036909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.037050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.037210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.037344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.037510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.037651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.037866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.038284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.038414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.038550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.038688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.038824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.038985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.039133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.039290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.039429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.039593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.039750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.039879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.040020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.040183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.040317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.040485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.040650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.040837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.041016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.041179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.041329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.041472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.041613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.041764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.041906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.042057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.042200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.042340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.042488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.042640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.043476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.043635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.043807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.043955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.044096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.044247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.044397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.044561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.044702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.044845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.044989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.045149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.045291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.045439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.045588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.045763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.045933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.046084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.046226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.046367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.046507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.046648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.046855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.047009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.047181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.047325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.047496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.047652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.047807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.047972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.048125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.048296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.048459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.048570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.048730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.048899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.049046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.049197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.049340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.049561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.049723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.049882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.050026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.050178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.050321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.050477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.050628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.050779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.050941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.051160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.051309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.051526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.051689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.051851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.052092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.052296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.052469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.052650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.052795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.052937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.053079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.053223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.053377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.053546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.053713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.053857 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.053998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.054149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.054300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.054442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.054592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.054741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.054884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.055039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.055189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.055330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.055483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.055633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.055778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.055778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.056090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.056240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.056383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.056527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.056712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.056857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.056998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.057139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.057297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.057297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.057574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.057726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.057867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.058041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.058185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.058353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.058612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.058763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.058907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.059050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.059210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.059366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.059516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.059660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.059847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.060013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.060186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.060350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.060493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.060666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.060820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.060970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.061206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.061387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.061531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.061673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.061815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.061961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.062122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.062284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.062426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.062568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.062717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.062898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.063070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.063223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.063365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.063512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.063661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.063835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.063994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.064162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.064317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.064459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.064680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.064841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.065035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.065195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.065385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.065535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.065684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.065834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.066001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.066166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.066309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.066449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.066609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.066762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.066905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.067055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.067204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.067356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.067504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.067731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.067881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.068087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.068251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.068402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.068565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.068726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.068876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.069026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.069169 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.069311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.069471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.069615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.069755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.069897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.070037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.070186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.070342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.070485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.070626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.070773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.070915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.071064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.071225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.071454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.071607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.071750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.071891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.072032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.072186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.072329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.072478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.072652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.072804 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.072961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.073111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.073274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.073417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.073558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.073699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.073849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.074014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.074192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.074378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.074549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.074748 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.074908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.075057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.075199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.075199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.075486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.075486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.075767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.075910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.076058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.076201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.076349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.076512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.076713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.076713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.076992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.077147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.077306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.077460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.077603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.077743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.077891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.078041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.078191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.078348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.078506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.078655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.078797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.078938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.079147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.079308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.079450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.079592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.079768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.079916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.080144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.080287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.080429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.080607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.080767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.080911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.081066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.081228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.081370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.081596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.081756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.081900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.082050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.082218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.082372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.082516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.082658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.082822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.082981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.083131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.083283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.083425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.083576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.083732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.083882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.084023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.084171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.084312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.084453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.084635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.084795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.084937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.085096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.085247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.085389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.085539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.085689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.085831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.085980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.086122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.086286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.086437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.086580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.086728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.086870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.087020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.087172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.087314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.087455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.087622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.087779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.087923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.088077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.088220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.088367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.088518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.088703 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.088869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.089024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.089174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.089316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.089471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.090166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.090391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.090581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.090784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.090967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.091137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.091280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.091447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.091609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.091825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.091972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.092123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.092266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.092416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.092624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.092773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.092926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.093069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.093226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.093369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.093522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.093664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.093812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.093961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.094112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.094112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.094406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.094548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.094690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.094840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.094991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.095141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.095305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.095456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.095598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.095752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.095902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.096044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.096185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.096327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.096475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.096658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.096811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.096953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.097102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.097296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.097445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.097597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.097739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.097879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.098027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.098170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.098322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.098465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.098607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.098755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.098897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.099059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.099256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.099418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.099562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.099703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.099844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.099986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.100141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.100284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.100425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.100627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.100786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.100930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.101095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.101247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.101389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.101538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.101679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.101847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.102070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.102217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.102358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.102499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.102499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.102778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.102920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.103071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.103071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.103339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.103481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.103633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.103784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.103926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.104067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.104208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.104360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.104517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.104687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.104842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.105003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.105145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.105341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.105984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.106128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.106269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.106417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.106559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.106716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.106863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.107004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.107145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.107298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.107447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.107599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.107749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.107893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.108034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.108174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.108323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.108480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.108647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.108790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.108933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.109075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.109304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.109449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.109599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.109750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.109894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.110043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.110200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.110350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.110492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.110642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.110792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.110935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.111096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.111239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.111390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.111547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.111689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.111841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.111991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.112218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.112375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.112526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.112703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.112862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.113006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.113159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.113308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.113459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.113601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.113752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.113895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.114035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.114177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.114318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.114468 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.114611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.114752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.114905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.115054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.115213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.115368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.115517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.115666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.115809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.115956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.116105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.116257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.116398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.116564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.116739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.116883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.117040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.117182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.117339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.117481 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.117622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.117763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.117914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.118063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.118206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.118361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.118503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.118660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 19:57:34.118817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.118959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.119238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.119586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.119902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.120247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.120596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.120984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.121309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.121700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 19:57:34.121949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 19:57:34.179805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO dbcounter [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Registered counter for database nova_api Jul 28 19:57:34.185089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO dbcounter [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Registered counter for database nova_api Jul 28 19:57:34.201198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_db.sqlalchemy.engines [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:57:34.205569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_db.sqlalchemy.engines [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:57:34.207898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writer thread running {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:57:34.212191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writer thread running {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:57:34.265174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.context [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4a45bd5e-a9aa-40c0-b86c-7b1b2576c347(cell1) {{(pid=117969) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 19:57:34.269092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.context [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4a45bd5e-a9aa-40c0-b86c-7b1b2576c347(cell1) {{(pid=117968) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 19:57:34.269346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:57:34.270884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:57:34.271671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:57:34.273168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:57:34.273685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:57:34.274723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:57:34.275518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:57:34.275680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO dbcounter [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Registered counter for database nova_cell0 Jul 28 19:57:34.278019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:57:34.279848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO dbcounter [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Registered counter for database nova_cell0 Jul 28 19:57:34.279967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO dbcounter [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Registered counter for database nova_cell1 Jul 28 19:57:34.283844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO dbcounter [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Registered counter for database nova_cell1 Jul 28 19:57:34.287216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_db.sqlalchemy.engines [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:57:34.289335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_db.sqlalchemy.engines [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:57:34.290650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_db.sqlalchemy.engines [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:57:34.294913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_db.sqlalchemy.engines [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:57:34.295544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writer thread running {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:57:34.296770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writer thread running {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:57:34.297216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writer thread running {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:57:34.447848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO dbcounter [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Registered counter for database nova_cell0 Jul 28 19:57:34.448859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writer thread running {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:57:34.458809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_db.sqlalchemy.engines [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:57:34.459433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO dbcounter [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Registered counter for database nova_cell0 Jul 28 19:57:34.463691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writer thread running {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:57:34.466445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_db.sqlalchemy.engines [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 19:57:34.471133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writer thread running {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 19:57:34.779690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: WARNING keystonemiddleware.auth_token [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 19:57:34.786962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: WARNING keystonemiddleware.auth_token [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 19:57:34.793153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: WARNING keystonemiddleware.auth_token [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 19:57:34.800378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: WARNING keystonemiddleware.auth_token [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 19:57:35.132843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: WARNING keystonemiddleware.auth_token [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 19:57:35.138794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: WARNING keystonemiddleware.auth_token [None req-8ca0f271-904e-4c48-a1ca-76fe427517ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 19:57:35.144067 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628d50979c0 pid: 117969 (default app) Jul 28 19:57:35.147933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: WARNING keystonemiddleware.auth_token [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 19:57:35.154330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: WARNING keystonemiddleware.auth_token [None req-a8c74efa-2d8d-420b-b70c-7fb167b57caa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 19:57:35.159649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5628d50979c0 pid: 117968 (default app) Jul 28 19:58:14.549483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:14.551307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:14.552312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:14.553304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:15.456376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d65de676-f33a-4add-a606-91a72259f761 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] Action: 'create', calling method: .version_select at 0x7f50387f2ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-806302419", "metadata": {"Type": "work"}}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:16.136729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=3 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:16.137871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=3 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:16.138808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=3 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:16.139834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=3 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:16.782865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d65de676-f33a-4add-a606-91a72259f761 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.247585 Jul 28 19:58:16.783764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1156 bytes} [Thu Jul 28 19:58:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2250 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 19:58:16.802159 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a738ea42-ece8-4cfc-af79-7c9401c2980f tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] Calling method '.version_select at 0x7f503864baf0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:16.864956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a738ea42-ece8-4cfc-af79-7c9401c2980f tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920" status: 200 len: 352 microversion: 2.1 time: 0.070593 Jul 28 19:58:16.865969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 2/2] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:16 2022] GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920 => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:17.879163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1e00e0c5-b590-458d-9852-ad18bfba74b5 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] Calling method '.version_select at 0x7f50386601f0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:18.062895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1e00e0c5-b590-458d-9852-ad18bfba74b5 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920" status: 200 len: 353 microversion: 2.1 time: 0.187029 Jul 28 19:58:18.064400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 3/3] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:17 2022] GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920 => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:18.079068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-156d326c-65c9-4359-b9da-78e42832e620 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] Calling method '.version_select at 0x7f50386608b0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:18.182848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-156d326c-65c9-4359-b9da-78e42832e620 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920" status: 200 len: 353 microversion: 2.1 time: 0.108973 Jul 28 19:58:18.183762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 4/4] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:18 2022] GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:18.200889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6bdbb02c-5586-4626-85a9-ad2c0526bfd9 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] Calling method '.version_select at 0x7f503864bc10>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:18.320856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6bdbb02c-5586-4626-85a9-ad2c0526bfd9 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920" status: 202 len: 0 microversion: 2.1 time: 0.123806 Jul 28 19:58:18.321624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 5/5] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 19:58:18 2022] DELETE /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 19:58:18.330580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6e109510-24dd-4d2e-9780-daa48406bee8 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] Calling method '.version_select at 0x7f5038660af0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:18.431248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6e109510-24dd-4d2e-9780-daa48406bee8 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920" status: 200 len: 352 microversion: 2.1 time: 0.104913 Jul 28 19:58:18.432261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 6/6] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:18 2022] GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 19:58:18.465699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fc015e66-7509-439e-ab1c-48de484c4feb tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Action: 'create', calling method: .version_select at 0x7f50387f3ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1546387723"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:19.446553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ef894eb7-c946-4390-9aa1-1ab1108cdc73 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] Calling method '.version_select at 0x7f50386603a0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:19.786594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-ef894eb7-c946-4390-9aa1-1ab1108cdc73 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] HTTP exception thrown: Volume e9d35d66-1739-4f0c-94cf-f924d9152920 could not be found. Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ef894eb7-c946-4390-9aa1-1ab1108cdc73 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] Request method failure captured: Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920 HTTP/1.1 Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upWgFiJ0F2t40guGJx37rQvpIUEUmQ4V0Gf_FYLKQ2c6Tro_6I-zdP-zymyVSwSxss7HPOxtRaDhRfwXouUk25TghHn6a5Tgms6UTSCd7g-oiw_dfJAQSEtNIM4_B_IEgbyr_dW95_0DSpQA1mHyxyb3u6inqV4W1TbaAZOuTRba34 Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 73291f05256140af8b54532b84d34200 Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesGetTestJSON-1536435550 Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 19:58:19.791437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/73291f05256140af8b54532b84d34200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/73291f05256140af8b54532b84d34200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/73291f05256140af8b54532b84d34200"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_73291f05256140af8b54532b84d34200"}]}] Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesGetTestJSON-1536435550 Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 73291f05256140af8b54532b84d34200 Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesGetTestJSON-1536435550 Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesGetTestJSON-1536435550-project Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 28935855b37640d9ab66194f3c1108ce Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesGetTestJSON-1536435550-project Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Volume e9d35d66-1739-4f0c-94cf-f924d9152920 could not be found. Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'e9d35d66-1739-4f0c-94cf-f924d9152920'} Jul 28 19:58:19.793030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9d35d66-1739-4f0c-94cf-f924d9152920 could not be found. (HTTP 404) (Request-ID: req-6198944b-fb68-4c5a-99b9-79aea5f784a2) Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:19.794019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 19:58:19.795464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9d35d66-1739-4f0c-94cf-f924d9152920 could not be found. Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 19:58:19.797085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9d35d66-1739-4f0c-94cf-f924d9152920 could not be found. Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9d35d66-1739-4f0c-94cf-f924d9152920 could not be found. Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ef894eb7-c946-4390-9aa1-1ab1108cdc73 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] Returning 404 to user: Volume e9d35d66-1739-4f0c-94cf-f924d9152920 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ef894eb7-c946-4390-9aa1-1ab1108cdc73 tempest-VolumesGetTestJSON-1536435550 tempest-VolumesGetTestJSON-1536435550-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920" status: 404 len: 109 microversion: 2.1 time: 0.350564 Jul 28 19:58:19.798482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 7/7] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:19 2022] GET /compute/v2.1/os-volumes/e9d35d66-1739-4f0c-94cf-f924d9152920 => generated 109 bytes in 352 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 19:58:19.803108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-01121538-4fc0-47d6-bc70-cb2cd18cfacc tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f50385cd1f0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:20.073193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-01121538-4fc0-47d6-bc70-cb2cd18cfacc tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/e7b26324-ccee-4216-9d0a-2fc9146b9edb" status: 200 len: 350 microversion: 2.1 time: 0.275762 Jul 28 19:58:20.075932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 8/8] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:19 2022] GET /compute/v2.1/os-volumes/e7b26324-ccee-4216-9d0a-2fc9146b9edb => generated 350 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:20.082209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fc015e66-7509-439e-ab1c-48de484c4feb tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.950552 Jul 28 19:58:20.083193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1/9] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Jul 28 19:58:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3953 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 28 19:58:20.098708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9f770a50-0455-4158-9217-e43ad91dadc3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f50385cd940>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:20.934825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9f770a50-0455-4158-9217-e43ad91dadc3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9" status: 200 len: 346 microversion: 2.1 time: 0.840023 Jul 28 19:58:20.948649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 9/10] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:20 2022] GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9 => generated 346 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:20.949854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8337933f-af79-4011-b818-cbc94b5200c4 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Action: 'create', calling method: .version_select at 0x7f503864ca60>, body: {"snapshot": {"volume_id": "d5a4046f-5359-498a-adb6-edc53360a3e9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-619629444"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:21.454656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8337933f-af79-4011-b818-cbc94b5200c4 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.510026 Jul 28 19:58:21.455868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 2/11] 10.222.0.67 () {60 vars in 1162 bytes} [Thu Jul 28 19:58:20 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 19:58:21.467967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-31dc2e25-bf10-4fb5-beae-da1789fd2f79 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f5038fd2160>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:21.535487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-31dc2e25-bf10-4fb5-beae-da1789fd2f79 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 200 len: 286 microversion: 2.1 time: 0.072535 Jul 28 19:58:21.536084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 10/12] 10.222.0.67 () {58 vars in 1251 bytes} [Thu Jul 28 19:58:21 2022] GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:21.547367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f974c1c7-37ef-49b3-a1b0-bd44e4a7a4fb tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f503865fc10>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:21.654387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f974c1c7-37ef-49b3-a1b0-bd44e4a7a4fb tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.110636 Jul 28 19:58:21.657106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 3/13] 10.222.0.67 () {58 vars in 1140 bytes} [Thu Jul 28 19:58:21 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:21.669614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6d6098f9-2653-4a7b-a274-687cea3adbe4 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f50385cd820>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:21.733887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6d6098f9-2653-4a7b-a274-687cea3adbe4 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 200 len: 286 microversion: 2.1 time: 0.070078 Jul 28 19:58:21.740228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 11/14] 10.222.0.67 () {58 vars in 1251 bytes} [Thu Jul 28 19:58:21 2022] GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:22.276184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e8451605-fb39-4b17-aa29-113cd5863424 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f503865fb80>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:22.340207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e8451605-fb39-4b17-aa29-113cd5863424 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/8cd3829f-2629-4184-82b3-da48c2994271" status: 200 len: 351 microversion: 2.1 time: 0.069254 Jul 28 19:58:22.341641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 4/15] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:22 2022] GET /compute/v2.1/os-volumes/8cd3829f-2629-4184-82b3-da48c2994271 => generated 351 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:22.749075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-50f94650-1152-404f-a08f-a732ba7f4e2c tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f50385cd0d0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:22.891318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-50f94650-1152-404f-a08f-a732ba7f4e2c tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 200 len: 286 microversion: 2.1 time: 0.148226 Jul 28 19:58:22.892129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 12/16] 10.222.0.67 () {58 vars in 1251 bytes} [Thu Jul 28 19:58:22 2022] GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:23.905965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-738a9139-bb48-44ab-9edc-1a0def759d68 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f503865f310>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:23.975964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-738a9139-bb48-44ab-9edc-1a0def759d68 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 200 len: 286 microversion: 2.1 time: 0.076349 Jul 28 19:58:23.977199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 5/17] 10.222.0.67 () {58 vars in 1251 bytes} [Thu Jul 28 19:58:23 2022] GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:24.988728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9f7c702e-476b-4941-a9dc-81b82ced70e3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f50385d1310>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:25.083735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9f7c702e-476b-4941-a9dc-81b82ced70e3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 200 len: 286 microversion: 2.1 time: 0.099551 Jul 28 19:58:25.084917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 13/18] 10.222.0.67 () {58 vars in 1251 bytes} [Thu Jul 28 19:58:24 2022] GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:26.098326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b7138f29-52b4-4cf3-ba67-083082c5b069 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f503864ce50>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:26.296060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b7138f29-52b4-4cf3-ba67-083082c5b069 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 200 len: 287 microversion: 2.1 time: 0.202144 Jul 28 19:58:26.297331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 6/19] 10.222.0.67 () {58 vars in 1251 bytes} [Thu Jul 28 19:58:26 2022] GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 287 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 19:58:26.311339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3e4e2ea5-5b08-4468-86b2-7d6a98cb4714 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f50385cd040>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:26.416948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-74dee0a1-b685-457d-854b-7c43e4d7ce7c tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f503864cca0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:26.575261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3e4e2ea5-5b08-4468-86b2-7d6a98cb4714 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 202 len: 0 microversion: 2.1 time: 0.267585 Jul 28 19:58:26.576573 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 14/20] 10.222.0.67 () {58 vars in 1254 bytes} [Thu Jul 28 19:58:26 2022] DELETE /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 19:58:26.586371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-062a6f2f-4d79-45b9-83c2-ac9157d76eb3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f50385cd670>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:26.656570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-062a6f2f-4d79-45b9-83c2-ac9157d76eb3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 200 len: 286 microversion: 2.1 time: 0.073128 Jul 28 19:58:26.657644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 15/21] 10.222.0.67 () {58 vars in 1251 bytes} [Thu Jul 28 19:58:26 2022] GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:26.666752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-74dee0a1-b685-457d-854b-7c43e4d7ce7c tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/eef2ff3e-82fc-43c0-a5c5-ea58d9e3ad87" status: 200 len: 351 microversion: 2.1 time: 0.254069 Jul 28 19:58:26.672592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 7/22] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:26 2022] GET /compute/v2.1/os-volumes/eef2ff3e-82fc-43c0-a5c5-ea58d9e3ad87 => generated 351 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:26.680798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4f09dd52-9fb0-4f64-89a5-ccc2967b7216 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f5038fd20d0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:26.800589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4f09dd52-9fb0-4f64-89a5-ccc2967b7216 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.123906 Jul 28 19:58:26.801237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 16/23] 10.222.0.67 () {58 vars in 1134 bytes} [Thu Jul 28 19:58:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:26.817084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a3522f62-b2b4-4629-8a29-d09b1a484a30 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f503865f4c0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:27.005549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a3522f62-b2b4-4629-8a29-d09b1a484a30 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.192252 Jul 28 19:58:27.006240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 8/24] 10.222.0.67 () {58 vars in 1149 bytes} [Thu Jul 28 19:58:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:27.021463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7b12ec76-629a-4a0c-a1de-11cd1af92492 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f5038660b80>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:27.272305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7b12ec76-629a-4a0c-a1de-11cd1af92492 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.254673 Jul 28 19:58:27.292898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 17/25] 10.222.0.67 () {58 vars in 1134 bytes} [Thu Jul 28 19:58:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:27.295119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e181c75-e62b-4f57-94c8-5923b646ec1c tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f5038664700>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:27.539601 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e181c75-e62b-4f57-94c8-5923b646ec1c tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.255219 Jul 28 19:58:27.541116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 9/26] 10.222.0.67 () {58 vars in 1167 bytes} [Thu Jul 28 19:58:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 19:58:27.557116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6bcb8238-c6cf-4a5c-8cfc-b9544c0eb433 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f50385cde50>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:27.674618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9b8435ec-1a6f-4ca9-8307-b21ffcf405d5 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f5038664040>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:27.749739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9b8435ec-1a6f-4ca9-8307-b21ffcf405d5 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 200 len: 286 microversion: 2.1 time: 0.084083 Jul 28 19:58:27.750302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 10/27] 10.222.0.67 () {58 vars in 1251 bytes} [Thu Jul 28 19:58:27 2022] GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:27.769831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6bcb8238-c6cf-4a5c-8cfc-b9544c0eb433 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.217959 Jul 28 19:58:27.770895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 18/28] 10.222.0.67 () {58 vars in 1170 bytes} [Thu Jul 28 19:58:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:27.785825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-595591b7-e5f6-4b08-870f-35d8d6202822 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f50386648b0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:27.983692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-595591b7-e5f6-4b08-870f-35d8d6202822 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.202393 Jul 28 19:58:27.992063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 11/29] 10.222.0.67 () {58 vars in 1155 bytes} [Thu Jul 28 19:58:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:27.996795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-73c9b821-ce48-42b2-b0d5-cdfae510ead4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Action: 'create', calling method: .version_select at 0x7f50385d4160>, body: {"keypair": {"name": "tempest-keypair-699652393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnUJNW8QyvJ/AzRnNmqxhWNs9OXQsZ8fZST5PPVYvhVh+Rz2eXNt4AHhE4wKE95XwgI1lgLFox+zJX3kQ0CcYS7NoObMrV/nS8Now6TFHFnK9DF2kjmPhEgR93V+e6mdQ=="}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:28.045930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7a7e9e8a-8d2e-46c6-a6e6-bbfecdecd816 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f503865f3a0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:28.186967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-73c9b821-ce48-42b2-b0d5-cdfae510ead4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Getting quotas for project 70cb4fda232e46b6842f8aa7840e48a7. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 19:58:28.212428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-73c9b821-ce48-42b2-b0d5-cdfae510ead4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Getting quotas for user 4e0e1988c7f44d5198811aca33e1345e and project 70cb4fda232e46b6842f8aa7840e48a7. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 19:58:28.308005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7a7e9e8a-8d2e-46c6-a6e6-bbfecdecd816 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.314089 Jul 28 19:58:28.309814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 12/30] 10.222.0.67 () {58 vars in 1188 bytes} [Thu Jul 28 19:58:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:28.319001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-73c9b821-ce48-42b2-b0d5-cdfae510ead4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.517124 Jul 28 19:58:28.323674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-169ef33c-7df8-4234-8b72-d843b1a2b4a3 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] Calling method '.version_select at 0x7f503864cf70>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:28.325942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 19/31] 10.222.0.67 () {62 vars in 1200 bytes} [Thu Jul 28 19:58:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 524 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 19:58:28.487429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-169ef33c-7df8-4234-8b72-d843b1a2b4a3 tempest-VolumesTestJSON-1600418465 tempest-VolumesTestJSON-1600418465-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.167986 Jul 28 19:58:28.489263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 13/32] 10.222.0.67 () {58 vars in 1155 bytes} [Thu Jul 28 19:58:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:28.765171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71ab0405-611b-477a-b339-4bd4872848a3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f50385a8dc0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:28.843962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-71ab0405-611b-477a-b339-4bd4872848a3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] HTTP exception thrown: Snapshot 1ccdcb39-c59d-4aba-b210-e904849a0e63 could not be found. Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71ab0405-611b-477a-b339-4bd4872848a3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Request method failure captured: Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 HTTP/1.1 Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upYsYNUd3d2RjDfJ9qx4Ko6DFsk2ADYKlcGWeiX34Zmi_bnEmxqAts6dwUHEjDXJmaTUsXv83rHx7WAlZkNPkjfOHr7rpI9-OndkxcBy6Oj85c0hAhVooHrrnkBD8IoFEHNrDe-yhkYdRzDXyKdhx6k3V1IQmVwNBOnTNRO8dfu_Yo Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 85a854ad07a24a489720c0341cf6c123 Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 19:58:28.846641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_85a854ad07a24a489720c0341cf6c123"}]}] Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 85a854ad07a24a489720c0341cf6c123 Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesSnapshotsTestJSON-1794074377-project Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5981cf6c67ea48078dd7ad097b05407f Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1794074377-project Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Snapshot 1ccdcb39-c59d-4aba-b210-e904849a0e63 could not be found. Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '1ccdcb39-c59d-4aba-b210-e904849a0e63'} Jul 28 19:58:28.847970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1ccdcb39-c59d-4aba-b210-e904849a0e63 could not be found. (HTTP 404) (Request-ID: req-21ff51c7-ef16-4629-b815-4619664455a1) Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:28.848809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 19:58:28.849956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1ccdcb39-c59d-4aba-b210-e904849a0e63 could not be found. Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 19:58:28.851160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1ccdcb39-c59d-4aba-b210-e904849a0e63 could not be found. Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1ccdcb39-c59d-4aba-b210-e904849a0e63 could not be found. Jul 28 19:58:28.852406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:28.854779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71ab0405-611b-477a-b339-4bd4872848a3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Returning 404 to user: Snapshot 1ccdcb39-c59d-4aba-b210-e904849a0e63 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:58:28.855962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-71ab0405-611b-477a-b339-4bd4872848a3 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63" status: 404 len: 111 microversion: 2.1 time: 0.097497 Jul 28 19:58:28.856711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 20/33] 10.222.0.67 () {58 vars in 1251 bytes} [Thu Jul 28 19:58:28 2022] GET /compute/v2.1/os-snapshots/1ccdcb39-c59d-4aba-b210-e904849a0e63 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 19:58:28.868240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9379d37a-d3fb-411e-890e-fb25ab80cbba tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f50387f3ca0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:29.024431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9379d37a-d3fb-411e-890e-fb25ab80cbba tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9" status: 202 len: 0 microversion: 2.1 time: 0.161835 Jul 28 19:58:29.025966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 14/34] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 19:58:28 2022] DELETE /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 19:58:29.038588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4880bf50-f317-4fa5-ad66-b3f565934f77 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f503901cee0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:29.131425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4880bf50-f317-4fa5-ad66-b3f565934f77 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9" status: 200 len: 345 microversion: 2.1 time: 0.099236 Jul 28 19:58:29.132421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 21/35] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:29 2022] GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9 => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:29.868702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-195204604", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "networks": [{"uuid": "f7507fa7-d12f-4e76-801c-24ad168be337"}]}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:30.065982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.network.neutron [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] validate_networks() for [('f7507fa7-d12f-4e76-801c-24ad168be337', None, None, None, None, None)] {{(pid=117968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 19:58:30.150819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8c4290eb-c039-4b65-8bac-8464f0443384 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f5037d59700>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:30.404948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-8c4290eb-c039-4b65-8bac-8464f0443384 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] HTTP exception thrown: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8c4290eb-c039-4b65-8bac-8464f0443384 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Request method failure captured: Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9 HTTP/1.1 Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upYsYNUd3d2RjDfJ9qx4Ko6DFsk2ADYKlcGWeiX34Zmi_bnEmxqAts6dwUHEjDXJmaTUsXv83rHx7WAlZkNPkjfOHr7rpI9-OndkxcBy6Oj85c0hAhVooHrrnkBD8IoFEHNrDe-yhkYdRzDXyKdhx6k3V1IQmVwNBOnTNRO8dfu_Yo Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 85a854ad07a24a489720c0341cf6c123 Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 19:58:30.410377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_85a854ad07a24a489720c0341cf6c123"}]}] Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 85a854ad07a24a489720c0341cf6c123 Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesSnapshotsTestJSON-1794074377-project Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5981cf6c67ea48078dd7ad097b05407f Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1794074377-project Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'd5a4046f-5359-498a-adb6-edc53360a3e9'} Jul 28 19:58:30.411678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. (HTTP 404) (Request-ID: req-421707fa-b027-4c2d-b04c-bfd4a958b1b0) Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:30.412725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 19:58:30.413910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 19:58:30.414986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.417742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.423562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8c4290eb-c039-4b65-8bac-8464f0443384 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Returning 404 to user: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:58:30.425950 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8c4290eb-c039-4b65-8bac-8464f0443384 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9" status: 404 len: 109 microversion: 2.1 time: 0.282450 Jul 28 19:58:30.428889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 22/36] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:30 2022] GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9 => generated 109 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 19:58:30.445355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6f8b658-ba31-43aa-8847-462a65ef47c2 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f5037d6e0d0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:30.555666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-b6f8b658-ba31-43aa-8847-462a65ef47c2 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] HTTP exception thrown: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6f8b658-ba31-43aa-8847-462a65ef47c2 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Request method failure captured: Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9 HTTP/1.1 Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upYsYNUd3d2RjDfJ9qx4Ko6DFsk2ADYKlcGWeiX34Zmi_bnEmxqAts6dwUHEjDXJmaTUsXv83rHx7WAlZkNPkjfOHr7rpI9-OndkxcBy6Oj85c0hAhVooHrrnkBD8IoFEHNrDe-yhkYdRzDXyKdhx6k3V1IQmVwNBOnTNRO8dfu_Yo Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 85a854ad07a24a489720c0341cf6c123 Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 19:58:30.558527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_85a854ad07a24a489720c0341cf6c123"}]}] Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 85a854ad07a24a489720c0341cf6c123 Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesSnapshotsTestJSON-1794074377-project Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5981cf6c67ea48078dd7ad097b05407f Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1794074377-project Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'd5a4046f-5359-498a-adb6-edc53360a3e9'} Jul 28 19:58:30.559515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. (HTTP 404) (Request-ID: req-e66673f7-00fa-4268-9fbe-8ea051c2e3c1) Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:30.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 19:58:30.561090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 19:58:30.565474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6f8b658-ba31-43aa-8847-462a65ef47c2 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Returning 404 to user: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b6f8b658-ba31-43aa-8847-462a65ef47c2 tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9" status: 404 len: 109 microversion: 2.1 time: 0.120813 Jul 28 19:58:30.566770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 23/37] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 19:58:30 2022] DELETE /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 19:58:30.569981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bfb6d1bd-6a80-4ffa-9967-c33c439e225c tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Calling method '.version_select at 0x7f5037d59f70>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:30.667223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-bfb6d1bd-6a80-4ffa-9967-c33c439e225c tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] HTTP exception thrown: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bfb6d1bd-6a80-4ffa-9967-c33c439e225c tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Request method failure captured: Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9 HTTP/1.1 Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upYsYNUd3d2RjDfJ9qx4Ko6DFsk2ADYKlcGWeiX34Zmi_bnEmxqAts6dwUHEjDXJmaTUsXv83rHx7WAlZkNPkjfOHr7rpI9-OndkxcBy6Oj85c0hAhVooHrrnkBD8IoFEHNrDe-yhkYdRzDXyKdhx6k3V1IQmVwNBOnTNRO8dfu_Yo Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 85a854ad07a24a489720c0341cf6c123 Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 19:58:30.669731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/85a854ad07a24a489720c0341cf6c123"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_85a854ad07a24a489720c0341cf6c123"}]}] Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 85a854ad07a24a489720c0341cf6c123 Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1794074377 Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesSnapshotsTestJSON-1794074377-project Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5981cf6c67ea48078dd7ad097b05407f Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1794074377-project Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'd5a4046f-5359-498a-adb6-edc53360a3e9'} Jul 28 19:58:30.670847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. (HTTP 404) (Request-ID: req-0d6708d1-aa89-4a32-b7b3-697aab9dae99) Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:30.671448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 19:58:30.672805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 19:58:30.673660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bfb6d1bd-6a80-4ffa-9967-c33c439e225c tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] Returning 404 to user: Volume d5a4046f-5359-498a-adb6-edc53360a3e9 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bfb6d1bd-6a80-4ffa-9967-c33c439e225c tempest-VolumesSnapshotsTestJSON-1794074377 tempest-VolumesSnapshotsTestJSON-1794074377-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9" status: 404 len: 109 microversion: 2.1 time: 0.105850 Jul 28 19:58:30.675002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 24/38] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 19:58:30 2022] GET /compute/v2.1/os-volumes/d5a4046f-5359-498a-adb6-edc53360a3e9 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 19:58:31.612689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Flavor limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 19:58:31.613163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Image limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 19:58:31.613574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Flavor pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 19:58:31.613977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Image pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 19:58:31.614379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 19:58:31.656752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:31.658052 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:31.659689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:31.660356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:31.721757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Getting quotas for project 0110b3b94c904e6587c182873daed000. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 19:58:31.742672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Getting quotas for user 3ada142ef49a48afa2b07267c75901a4 and project 0110b3b94c904e6587c182873daed000. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 19:58:31.779449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Going to run 1 instances... {{(pid=117968) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 19:58:31.782389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 19:58:32.006778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b1ddc9b5-527b-4156-b2f5-e93ff9c3c1b3 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.275728 Jul 28 19:58:32.007716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 15/39] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 19:58:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 19:58:32.021531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a952154b-45b7-4872-a469-fa5608f50088 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:32.022292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a952154b-45b7-4872-a469-fa5608f50088 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:32.271808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a952154b-45b7-4872-a469-fa5608f50088 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:32.299858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a952154b-45b7-4872-a469-fa5608f50088 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1214 microversion: 2.1 time: 0.283504 Jul 28 19:58:32.316704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 25/40] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:32 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:32.822304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1171050899", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84a9a07b-45bb-4ad4-8977-5e4500a589e4"}], "security_groups": [{"name": "tempest-securitygroup--253002823"}], "key_name": "tempest-keypair-699652393", "user_data": "}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:33.118386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.network.neutron [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] validate_networks() for [('84a9a07b-45bb-4ad4-8977-5e4500a589e4', None, None, None, None, None)] {{(pid=117968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 19:58:33.321697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4c9c9eea-3e17-4714-ad43-a58c65e78df8 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:33.323312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4c9c9eea-3e17-4714-ad43-a58c65e78df8 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:33.779869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4c9c9eea-3e17-4714-ad43-a58c65e78df8 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:33.794318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4c9c9eea-3e17-4714-ad43-a58c65e78df8 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1214 microversion: 2.1 time: 0.476630 Jul 28 19:58:33.818172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 26/41] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:33 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1214 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:34.574413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Flavor limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 19:58:34.575454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Image limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 19:58:34.577505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Flavor pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 19:58:34.578232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Image pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 19:58:34.580178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 19:58:34.612906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:34.614705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:34.615899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:34.616769 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:34.641404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Getting quotas for project 70cb4fda232e46b6842f8aa7840e48a7. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 19:58:34.646868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Getting quotas for user 4e0e1988c7f44d5198811aca33e1345e and project 70cb4fda232e46b6842f8aa7840e48a7. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 19:58:34.663278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Going to run 1 instances... {{(pid=117968) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 19:58:34.667401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 19:58:34.764134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-922e787b-8fe6-4f9a-a3ed-c554087ec876 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.953488 Jul 28 19:58:34.767271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 16/42] 10.222.0.67 () {62 vars in 1188 bytes} [Thu Jul 28 19:58:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 19:58:34.779150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-04ee9ce6-33c8-43f3-86da-6b7ba4ce7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:34.783903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-04ee9ce6-33c8-43f3-86da-6b7ba4ce7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:34.941060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1549074274", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:34.947701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-04ee9ce6-33c8-43f3-86da-6b7ba4ce7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:34.981578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-04ee9ce6-33c8-43f3-86da-6b7ba4ce7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:34.985777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-04ee9ce6-33c8-43f3-86da-6b7ba4ce7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:34.990291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-04ee9ce6-33c8-43f3-86da-6b7ba4ce7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1281 microversion: 2.20 time: 0.216177 Jul 28 19:58:34.992328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 17/43] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:34 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1281 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:35.030929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-079b8b92-dc56-46af-8190-a0a610ebfaa9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:35.032435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-079b8b92-dc56-46af-8190-a0a610ebfaa9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:35.051327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-079b8b92-dc56-46af-8190-a0a610ebfaa9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:35.055661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-079b8b92-dc56-46af-8190-a0a610ebfaa9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:35.059380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-079b8b92-dc56-46af-8190-a0a610ebfaa9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:35.060342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-079b8b92-dc56-46af-8190-a0a610ebfaa9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:35.215955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] validate_networks() for [('345252fa-83ab-4000-840a-bbb735e163c1', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 19:58:35.492408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-079b8b92-dc56-46af-8190-a0a610ebfaa9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:35.536890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-079b8b92-dc56-46af-8190-a0a610ebfaa9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1218 microversion: 2.1 time: 0.519085 Jul 28 19:58:35.539756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 18/44] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:35 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1218 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:36.021167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8c00c05f-f47c-4239-aed4-d450374f7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:36.022534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8c00c05f-f47c-4239-aed4-d450374f7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:36.225701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8c00c05f-f47c-4239-aed4-d450374f7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:36.245962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8c00c05f-f47c-4239-aed4-d450374f7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:36.251405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8c00c05f-f47c-4239-aed4-d450374f7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:36.253943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8c00c05f-f47c-4239-aed4-d450374f7d67 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1281 microversion: 2.20 time: 0.236558 Jul 28 19:58:36.255987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 19/45] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:36 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:36.562532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d43f383f-285c-409f-bf7d-14784cbe7828 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:36.563530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d43f383f-285c-409f-bf7d-14784cbe7828 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:36.582112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d43f383f-285c-409f-bf7d-14784cbe7828 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:36.594674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d43f383f-285c-409f-bf7d-14784cbe7828 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:36.623191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d43f383f-285c-409f-bf7d-14784cbe7828 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:36.632638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d43f383f-285c-409f-bf7d-14784cbe7828 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:36.874819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d43f383f-285c-409f-bf7d-14784cbe7828 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:36.888084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d43f383f-285c-409f-bf7d-14784cbe7828 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1266 microversion: 2.1 time: 0.331400 Jul 28 19:58:36.891163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 20/46] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:36 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:37.284437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:37.285904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:37.298171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:37.316040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:37.324827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:37.331487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:37.619904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:37.628848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:37.640294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:37.650396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-30491ac0-7206-44e3-8ff3-951b3bae5024 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1277 microversion: 2.20 time: 0.370821 Jul 28 19:58:37.651050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 21/47] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:37 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1277 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:37.911305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6638dc4c-f5fc-4215-bfe2-691991fcf8ce tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:37.911913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6638dc4c-f5fc-4215-bfe2-691991fcf8ce tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:37.923985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6638dc4c-f5fc-4215-bfe2-691991fcf8ce tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:37.924433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6638dc4c-f5fc-4215-bfe2-691991fcf8ce tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:37.926137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6638dc4c-f5fc-4215-bfe2-691991fcf8ce tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:37.932342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6638dc4c-f5fc-4215-bfe2-691991fcf8ce tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:38.172489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6638dc4c-f5fc-4215-bfe2-691991fcf8ce tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:38.184958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6638dc4c-f5fc-4215-bfe2-691991fcf8ce tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1272 microversion: 2.1 time: 0.277363 Jul 28 19:58:38.187829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 22/48] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:37 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:58:38.240919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 19:58:38.243452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 19:58:38.244321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 19:58:38.244970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 19:58:38.245598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 19:58:38.279358 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:38.280891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:38.283379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:38.285333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:38.344587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Getting quotas for project 4cc8b359904d4304a7b25954a46ae97b. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 19:58:38.350813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Getting quotas for user 5be80ca35c954fdb963d6dc278fd62d3 and project 4cc8b359904d4304a7b25954a46ae97b. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 19:58:38.371513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 19:58:38.375613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 19:58:38.553754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-169bdf3b-11f0-4284-9b29-cb7f38328e41 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.182740 Jul 28 19:58:38.554408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 27/49] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 19:58:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 4185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 19:58:38.568367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b05920a6-36c8-4139-9934-ebbe854038e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:38.569256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b05920a6-36c8-4139-9934-ebbe854038e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:38.678524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:38.679381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:38.695865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:38.698316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:38.705172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:38.705830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:39.102880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b05920a6-36c8-4139-9934-ebbe854038e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:39.112566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b05920a6-36c8-4139-9934-ebbe854038e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1222 microversion: 2.1 time: 0.549428 Jul 28 19:58:39.113461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 23/50] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:38 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1222 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:39.223767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d67360bf-a45f-4c0d-bf53-f1ca050d5c12 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:39.224386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d67360bf-a45f-4c0d-bf53-f1ca050d5c12 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:39.247388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d67360bf-a45f-4c0d-bf53-f1ca050d5c12 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:39.247764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d67360bf-a45f-4c0d-bf53-f1ca050d5c12 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:39.248893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d67360bf-a45f-4c0d-bf53-f1ca050d5c12 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:39.261105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d67360bf-a45f-4c0d-bf53-f1ca050d5c12 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:39.415308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:39.449868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:39.461388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:39.468179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b8f2183a-0968-4882-aa9c-78408ea8b193 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1339 microversion: 2.20 time: 0.793917 Jul 28 19:58:39.484697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 28/51] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:38 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1339 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:58:39.497470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2075256775", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:39.625432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d67360bf-a45f-4c0d-bf53-f1ca050d5c12 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:39.635373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] validate_networks() for [('345252fa-83ab-4000-840a-bbb735e163c1', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 19:58:39.638277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d67360bf-a45f-4c0d-bf53-f1ca050d5c12 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1272 microversion: 2.1 time: 0.418507 Jul 28 19:58:39.640874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 24/52] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:39 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1272 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:40.503919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:40.504532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:40.514440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:40.522238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:40.523369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:40.523947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:41.146376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:41.199850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:41.216350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:41.224461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f58d4c9f-aa4b-4974-93a1-5ee84699e4c5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1339 microversion: 2.20 time: 0.724830 Jul 28 19:58:41.226183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 25/53] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:40 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1339 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:58:41.262743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e7bb225-5b14-484b-ab86-00cf3a3005bf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:41.264243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9e7bb225-5b14-484b-ab86-00cf3a3005bf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:41.302684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e7bb225-5b14-484b-ab86-00cf3a3005bf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:41.306346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e7bb225-5b14-484b-ab86-00cf3a3005bf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:41.324348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e7bb225-5b14-484b-ab86-00cf3a3005bf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:41.326678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e7bb225-5b14-484b-ab86-00cf3a3005bf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:42.576513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 19:58:42.577676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 19:58:42.577925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 19:58:42.578436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 19:58:42.579138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 19:58:42.605519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:42.607966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:42.611192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:42.611773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:42.768411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Getting quotas for project 4cc8b359904d4304a7b25954a46ae97b. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 19:58:42.780632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9e7bb225-5b14-484b-ab86-00cf3a3005bf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:42.794549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Getting quotas for user 5be80ca35c954fdb963d6dc278fd62d3 and project 4cc8b359904d4304a7b25954a46ae97b. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 19:58:42.794967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e7bb225-5b14-484b-ab86-00cf3a3005bf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 1.560575 Jul 28 19:58:42.810118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 26/54] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:41 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:42.844124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 19:58:42.844787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:42.845628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:42.858040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 19:58:42.885014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:42.885645 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:42.886575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:42.888755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:43.021328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-edf9f2ef-254c-426f-aab9-51e7bea5a5a6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.546440 Jul 28 19:58:43.022329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 29/55] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 19:58:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 19:58:43.034974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0267a772-bb67-45df-9865-cd0608c17eaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:43.038620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0267a772-bb67-45df-9865-cd0608c17eaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:43.419816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:43.434313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:43.452059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0267a772-bb67-45df-9865-cd0608c17eaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:43.453872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:43.456986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-647c0ddb-e88b-4e21-a766-fb7ead01beed tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1339 microversion: 2.20 time: 0.645582 Jul 28 19:58:43.472894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0267a772-bb67-45df-9865-cd0608c17eaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1222 microversion: 2.1 time: 0.440282 Jul 28 19:58:43.474773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 27/56] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:42 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1339 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:43.485721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 30/57] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:43 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1222 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:43.819990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c04064ba-e7c0-4585-a969-766460004573 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:43.820664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c04064ba-e7c0-4585-a969-766460004573 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:43.832079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c04064ba-e7c0-4585-a969-766460004573 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:43.851646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c04064ba-e7c0-4585-a969-766460004573 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:43.853357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c04064ba-e7c0-4585-a969-766460004573 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:43.853853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c04064ba-e7c0-4585-a969-766460004573 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:44.499638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:44.501566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:44.550506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:44.551946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:44.554726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:44.569750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:44.629266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:45.190526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:45.277461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:45.285093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:45.295711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c04064ba-e7c0-4585-a969-766460004573 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:45.307481 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-517ca76f-69cd-4774-bbc2-b6f4dbc4af58 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1339 microversion: 2.20 time: 0.804913 Jul 28 19:58:45.313666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 31/58] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:44 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1339 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:45.321822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c04064ba-e7c0-4585-a969-766460004573 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 1.504514 Jul 28 19:58:45.325370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 28/59] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:43 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:45.343857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-23fc6813-a702-4f28-b49c-f3923f6321e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:45.344509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-23fc6813-a702-4f28-b49c-f3923f6321e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:45.377733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23fc6813-a702-4f28-b49c-f3923f6321e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:45.380675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23fc6813-a702-4f28-b49c-f3923f6321e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:45.384928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23fc6813-a702-4f28-b49c-f3923f6321e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:45.391967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23fc6813-a702-4f28-b49c-f3923f6321e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:45.654797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-23fc6813-a702-4f28-b49c-f3923f6321e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:45.677056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-23fc6813-a702-4f28-b49c-f3923f6321e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1274 microversion: 2.1 time: 0.358716 Jul 28 19:58:45.682715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 32/60] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:45 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1274 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:46.336175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:46.337940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:46.345298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4455cfc3-8150-4355-9a62-80c46911df74 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:46.345991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4455cfc3-8150-4355-9a62-80c46911df74 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:46.393181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:46.393721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:46.396219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4455cfc3-8150-4355-9a62-80c46911df74 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:46.396741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4455cfc3-8150-4355-9a62-80c46911df74 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:46.397527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4455cfc3-8150-4355-9a62-80c46911df74 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:46.398026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4455cfc3-8150-4355-9a62-80c46911df74 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:46.409703 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:46.415119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:47.442786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4455cfc3-8150-4355-9a62-80c46911df74 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:47.458581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4455cfc3-8150-4355-9a62-80c46911df74 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 1.118145 Jul 28 19:58:47.465074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 33/61] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:46 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:47.552110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:47.561961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:47.569682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:47.577614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cc2b4c2b-e6a9-456d-ae6a-9b70463f18fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 1.246060 Jul 28 19:58:47.595340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 29/62] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:46 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:47.608048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b8b538c4-0045-4931-8d3a-1e846019be20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:47.610432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b8b538c4-0045-4931-8d3a-1e846019be20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:47.637171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8b538c4-0045-4931-8d3a-1e846019be20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:47.637900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8b538c4-0045-4931-8d3a-1e846019be20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:47.638939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8b538c4-0045-4931-8d3a-1e846019be20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:47.639605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8b538c4-0045-4931-8d3a-1e846019be20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:47.692048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-63e29faa-d509-4488-b0c8-2a6732b2dee1 req-16475f03-cd90-4078-b8b4-4deb46a77d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa26aee5-f3e7-4c58-85d6-b8c664a022b3", "tag": "e71d1474-59b2-44cb-84e0-1f7071339719"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:47.733779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-63e29faa-d509-4488-b0c8-2a6732b2dee1 req-16475f03-cd90-4078-b8b4-4deb46a77d25 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:47.734130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-63e29faa-d509-4488-b0c8-2a6732b2dee1 req-16475f03-cd90-4078-b8b4-4deb46a77d25 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:47.829716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-63e29faa-d509-4488-b0c8-2a6732b2dee1 req-16475f03-cd90-4078-b8b4-4deb46a77d25 service nova] Creating event network-changed:e71d1474-59b2-44cb-84e0-1f7071339719 for instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 on hv-cinder-85144 Jul 28 19:58:47.830379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-63e29faa-d509-4488-b0c8-2a6732b2dee1 req-16475f03-cd90-4078-b8b4-4deb46a77d25 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117969) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 19:58:47.831645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed7d4ec4-37a7-4e14-8e49-390c247b24ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:47.832092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed7d4ec4-37a7-4e14-8e49-390c247b24ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:47.833118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed7d4ec4-37a7-4e14-8e49-390c247b24ca None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:47.833712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed7d4ec4-37a7-4e14-8e49-390c247b24ca None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:47.847144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.compute.rpcapi [None req-ed7d4ec4-37a7-4e14-8e49-390c247b24ca None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 19:58:47.848046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed7d4ec4-37a7-4e14-8e49-390c247b24ca None None] Releasing lock "compute-rpcapi-router" {{(pid=117969) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 19:58:47.871751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b8b538c4-0045-4931-8d3a-1e846019be20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:47.889379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b8b538c4-0045-4931-8d3a-1e846019be20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1280 microversion: 2.1 time: 0.291466 Jul 28 19:58:47.908176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 30/63] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:47 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:47.919322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ed7d4ec4-37a7-4e14-8e49-390c247b24ca None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.452698 Jul 28 19:58:47.919981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 34/64] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:48.488667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0d78b3da-cbad-4581-97e0-db7b94f8a547 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:48.491748 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0d78b3da-cbad-4581-97e0-db7b94f8a547 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:48.500885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d78b3da-cbad-4581-97e0-db7b94f8a547 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:48.511900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d78b3da-cbad-4581-97e0-db7b94f8a547 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:48.516317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d78b3da-cbad-4581-97e0-db7b94f8a547 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:48.517957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d78b3da-cbad-4581-97e0-db7b94f8a547 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:48.607285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:48.609159 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:48.631375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:48.634534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:48.639961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:48.640717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:49.106769 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=18 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:49.805973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:49.820692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:49.825138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:49.834642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-065ec7e3-58ac-4399-8c69-0f6b8a9bf859 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 1.232928 Jul 28 19:58:49.849470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 35/65] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:48 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:58:49.865039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-84494468-f370-4582-991f-fb90c25ae421 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:49.866009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-84494468-f370-4582-991f-fb90c25ae421 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:49.875956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84494468-f370-4582-991f-fb90c25ae421 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:49.879099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84494468-f370-4582-991f-fb90c25ae421 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:49.881041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84494468-f370-4582-991f-fb90c25ae421 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:49.886020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84494468-f370-4582-991f-fb90c25ae421 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:49.926387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0d78b3da-cbad-4581-97e0-db7b94f8a547 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:49.936335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0d78b3da-cbad-4581-97e0-db7b94f8a547 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 1.456319 Jul 28 19:58:49.939695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 31/66] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:48 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:50.047608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-d0bf478d-e463-4007-88a7-fad0ecce8317 req-11a303c5-bd19-49a6-82b5-81e678a30ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4889e06d-18cf-4e5e-9f68-8c168109c1d3", "tag": "e3b95cb5-58ef-47b5-a24c-57117b4da068"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:50.083770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-d0bf478d-e463-4007-88a7-fad0ecce8317 req-11a303c5-bd19-49a6-82b5-81e678a30ab6 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:50.084563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-d0bf478d-e463-4007-88a7-fad0ecce8317 req-11a303c5-bd19-49a6-82b5-81e678a30ab6 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:50.123567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-d0bf478d-e463-4007-88a7-fad0ecce8317 req-11a303c5-bd19-49a6-82b5-81e678a30ab6 service nova] Creating event network-changed:e3b95cb5-58ef-47b5-a24c-57117b4da068 for instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 on hv-cinder-85144 Jul 28 19:58:50.124769 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-d0bf478d-e463-4007-88a7-fad0ecce8317 req-11a303c5-bd19-49a6-82b5-81e678a30ab6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117968) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 19:58:50.126407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21f68df8-2ecd-4876-90c2-1b7bfe71c6cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:50.126980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21f68df8-2ecd-4876-90c2-1b7bfe71c6cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:50.127822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21f68df8-2ecd-4876-90c2-1b7bfe71c6cb None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:50.128251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21f68df8-2ecd-4876-90c2-1b7bfe71c6cb None None] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:50.148202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.compute.rpcapi [None req-21f68df8-2ecd-4876-90c2-1b7bfe71c6cb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 19:58:50.151272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21f68df8-2ecd-4876-90c2-1b7bfe71c6cb None None] Releasing lock "compute-rpcapi-router" {{(pid=117968) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 19:58:50.207138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-21f68df8-2ecd-4876-90c2-1b7bfe71c6cb None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256554 Jul 28 19:58:50.208011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 32/67] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:50.659049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-c2350f41-5054-427d-970b-9015e87f382b req-2d773a1d-9562-4875-a34e-b8cfda649a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea28ea30-1675-4f86-9a3d-8be8cf2b882d", "tag": "4ff28c7e-5433-4834-adf9-9e59ef20b859"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:50.718626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-c2350f41-5054-427d-970b-9015e87f382b req-2d773a1d-9562-4875-a34e-b8cfda649a36 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:50.718626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-c2350f41-5054-427d-970b-9015e87f382b req-2d773a1d-9562-4875-a34e-b8cfda649a36 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:50.741119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-c2350f41-5054-427d-970b-9015e87f382b req-2d773a1d-9562-4875-a34e-b8cfda649a36 service nova] Creating event network-changed:4ff28c7e-5433-4834-adf9-9e59ef20b859 for instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d on hv-cinder-85144 Jul 28 19:58:50.750282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-84494468-f370-4582-991f-fb90c25ae421 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:50.754205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-c2350f41-5054-427d-970b-9015e87f382b req-2d773a1d-9562-4875-a34e-b8cfda649a36 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107519 Jul 28 19:58:50.757143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 33/68] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:50.763671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-84494468-f370-4582-991f-fb90c25ae421 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1280 microversion: 2.1 time: 0.912670 Jul 28 19:58:50.793006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 36/69] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:49 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1280 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:50.880422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:50.887773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:50.901132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:50.903299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:50.905533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:50.906549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:50.964985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0d67c376-3857-4c59-9e08-b368a8a8ffbc tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:50.965875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0d67c376-3857-4c59-9e08-b368a8a8ffbc tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:50.983042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d67c376-3857-4c59-9e08-b368a8a8ffbc tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:50.984872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d67c376-3857-4c59-9e08-b368a8a8ffbc tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:50.986406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d67c376-3857-4c59-9e08-b368a8a8ffbc tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:50.987965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d67c376-3857-4c59-9e08-b368a8a8ffbc tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:51.625526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:51.673577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:51.689116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:51.694730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-97ee9285-0b86-48cb-b919-77de354bddd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.817066 Jul 28 19:58:51.722231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 34/70] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:50 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:51.790457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bf3be414-a9cf-468d-9e8f-7cdf9661c273 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:51.792111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bf3be414-a9cf-468d-9e8f-7cdf9661c273 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:51.804299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf3be414-a9cf-468d-9e8f-7cdf9661c273 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:51.805535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf3be414-a9cf-468d-9e8f-7cdf9661c273 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:51.819264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf3be414-a9cf-468d-9e8f-7cdf9661c273 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:51.820252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf3be414-a9cf-468d-9e8f-7cdf9661c273 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:51.827402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0d67c376-3857-4c59-9e08-b368a8a8ffbc tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:51.861257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0d67c376-3857-4c59-9e08-b368a8a8ffbc tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.901411 Jul 28 19:58:51.862923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 37/71] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:50 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:52.247788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bf3be414-a9cf-468d-9e8f-7cdf9661c273 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:52.272855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bf3be414-a9cf-468d-9e8f-7cdf9661c273 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.480402 Jul 28 19:58:52.275584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 35/72] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:51 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:58:52.734527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:52.735140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:52.741754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:52.747749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:52.747749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:52.747749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:52.890813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ce7156cd-605b-4a83-9a17-610deb66ea55 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:52.891450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ce7156cd-605b-4a83-9a17-610deb66ea55 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:52.906329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce7156cd-605b-4a83-9a17-610deb66ea55 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:52.907629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce7156cd-605b-4a83-9a17-610deb66ea55 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:52.908802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce7156cd-605b-4a83-9a17-610deb66ea55 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:52.911755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce7156cd-605b-4a83-9a17-610deb66ea55 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:53.457424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=22 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:53.519995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:53.546089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:53.550800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:53.554941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-984f592d-2e56-4793-ab38-ac552f69d607 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.824309 Jul 28 19:58:53.559284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 38/73] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:52 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:53.575871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6892f522-442e-4f84-85e4-642acc6daa8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:53.578482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6892f522-442e-4f84-85e4-642acc6daa8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:53.584048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ce7156cd-605b-4a83-9a17-610deb66ea55 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:53.590992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:53.608292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6892f522-442e-4f84-85e4-642acc6daa8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:53.609889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6892f522-442e-4f84-85e4-642acc6daa8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:53.611026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ce7156cd-605b-4a83-9a17-610deb66ea55 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.724175 Jul 28 19:58:53.612437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6892f522-442e-4f84-85e4-642acc6daa8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:53.614156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 36/74] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:52 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:58:53.614789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6892f522-442e-4f84-85e4-642acc6daa8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:54.442048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6892f522-442e-4f84-85e4-642acc6daa8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:54.459442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6892f522-442e-4f84-85e4-642acc6daa8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.897993 Jul 28 19:58:54.468979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 39/75] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:53 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:54.568913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-062f85f9-6d17-4d13-94c3-04444563736e req-642ea42f-a0b9-4e6c-bc97-bce315eb0a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feb2a989-29e7-4123-bb19-871b05d7f88e", "tag": "f92e97e3-b3c8-4bed-9bea-8dca7dcc33fc"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:58:54.579345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:54.579876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:54.582191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-062f85f9-6d17-4d13-94c3-04444563736e req-642ea42f-a0b9-4e6c-bc97-bce315eb0a1b service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:54.582838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-062f85f9-6d17-4d13-94c3-04444563736e req-642ea42f-a0b9-4e6c-bc97-bce315eb0a1b service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:54.589105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:54.589559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:54.590345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:54.590778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:54.607416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-062f85f9-6d17-4d13-94c3-04444563736e req-642ea42f-a0b9-4e6c-bc97-bce315eb0a1b service nova] Creating event network-changed:f92e97e3-b3c8-4bed-9bea-8dca7dcc33fc for instance feb2a989-29e7-4123-bb19-871b05d7f88e on hv-cinder-85144 Jul 28 19:58:54.618535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-062f85f9-6d17-4d13-94c3-04444563736e req-642ea42f-a0b9-4e6c-bc97-bce315eb0a1b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052180 Jul 28 19:58:54.621114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 37/76] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:58:54.636761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ff318dfe-17ca-4ab9-bb81-7e3ca0b8fd51 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:54.639210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ff318dfe-17ca-4ab9-bb81-7e3ca0b8fd51 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:54.649836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff318dfe-17ca-4ab9-bb81-7e3ca0b8fd51 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:54.650688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff318dfe-17ca-4ab9-bb81-7e3ca0b8fd51 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:54.651948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff318dfe-17ca-4ab9-bb81-7e3ca0b8fd51 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:54.652586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff318dfe-17ca-4ab9-bb81-7e3ca0b8fd51 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:55.139266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:55.153654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:55.158571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:55.159952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-78cf8ac5-74b1-42a5-ab23-7116b2efee1e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.584568 Jul 28 19:58:55.162167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 40/77] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:54 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:58:55.219485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ff318dfe-17ca-4ab9-bb81-7e3ca0b8fd51 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:55.231269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ff318dfe-17ca-4ab9-bb81-7e3ca0b8fd51 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.599674 Jul 28 19:58:55.232265 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 38/78] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:54 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:55.490320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-46879a21-ac05-40f1-aa65-2f62dae491ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:55.491704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-46879a21-ac05-40f1-aa65-2f62dae491ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:55.494125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:55.500006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46879a21-ac05-40f1-aa65-2f62dae491ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:55.500509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46879a21-ac05-40f1-aa65-2f62dae491ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:55.501405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46879a21-ac05-40f1-aa65-2f62dae491ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:55.501929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46879a21-ac05-40f1-aa65-2f62dae491ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:55.660593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-46879a21-ac05-40f1-aa65-2f62dae491ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:55.670857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-46879a21-ac05-40f1-aa65-2f62dae491ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.184862 Jul 28 19:58:55.684591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 41/79] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:55 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:56.187692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:56.189326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:56.197234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:56.198961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:56.199758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:56.201039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:56.201613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:56.258637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ac14cb94-5cf7-4374-8646-a865e30e4c44 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:56.259945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ac14cb94-5cf7-4374-8646-a865e30e4c44 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:56.268105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ac14cb94-5cf7-4374-8646-a865e30e4c44 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:56.268828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ac14cb94-5cf7-4374-8646-a865e30e4c44 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:56.270086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ac14cb94-5cf7-4374-8646-a865e30e4c44 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:56.270794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ac14cb94-5cf7-4374-8646-a865e30e4c44 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:56.503482 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:56.515518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:56.517076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:56.518244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fcf3203c-4309-471a-8ec8-632666fc7506 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.334899 Jul 28 19:58:56.530791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 39/80] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:56 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:56.546510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ac14cb94-5cf7-4374-8646-a865e30e4c44 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:56.559455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ac14cb94-5cf7-4374-8646-a865e30e4c44 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.305156 Jul 28 19:58:56.559973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 42/81] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:56 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:56.691906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5705bb97-c8df-41b5-ba69-fc7a99bad5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:56.692624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5705bb97-c8df-41b5-ba69-fc7a99bad5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:56.701503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5705bb97-c8df-41b5-ba69-fc7a99bad5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:56.702068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5705bb97-c8df-41b5-ba69-fc7a99bad5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:56.702965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5705bb97-c8df-41b5-ba69-fc7a99bad5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:56.703501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5705bb97-c8df-41b5-ba69-fc7a99bad5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:56.854787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5705bb97-c8df-41b5-ba69-fc7a99bad5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:56.862938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5705bb97-c8df-41b5-ba69-fc7a99bad5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.175400 Jul 28 19:58:56.873905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 40/82] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:56 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:57.544630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:57.544630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:57.550439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:57.551051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:57.551766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:57.552292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:57.582044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-88b3956e-f177-4e6e-9548-147227d40683 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:57.582617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-88b3956e-f177-4e6e-9548-147227d40683 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:57.591220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-88b3956e-f177-4e6e-9548-147227d40683 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:57.591666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-88b3956e-f177-4e6e-9548-147227d40683 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:57.593264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-88b3956e-f177-4e6e-9548-147227d40683 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:57.593849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-88b3956e-f177-4e6e-9548-147227d40683 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:57.777962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:57.786302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:57.788325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:57.790582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-975f3dd3-dbbe-41b8-85ce-a5370788ca64 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.251939 Jul 28 19:58:57.805500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 43/83] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:57 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:57.806944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-88b3956e-f177-4e6e-9548-147227d40683 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:57.814986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-88b3956e-f177-4e6e-9548-147227d40683 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.237039 Jul 28 19:58:57.815719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 41/84] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:57 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:58:57.884793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d5db9e5b-247e-41e8-be99-8fb424b6a2c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:57.885402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d5db9e5b-247e-41e8-be99-8fb424b6a2c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:57.888309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=6 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:58:57.893179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5db9e5b-247e-41e8-be99-8fb424b6a2c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:57.894078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5db9e5b-247e-41e8-be99-8fb424b6a2c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:57.894887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5db9e5b-247e-41e8-be99-8fb424b6a2c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:57.895732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5db9e5b-247e-41e8-be99-8fb424b6a2c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:58.057752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d5db9e5b-247e-41e8-be99-8fb424b6a2c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:58.065994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d5db9e5b-247e-41e8-be99-8fb424b6a2c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.185827 Jul 28 19:58:58.066726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 44/85] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:57 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:58.814177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:58.815648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:58.832826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:58.833275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:58.838049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:58.838919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:58.839001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3cf3414e-6d8d-4831-ae1e-e384bc0664a7 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:58.839788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3cf3414e-6d8d-4831-ae1e-e384bc0664a7 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:58.850148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cf3414e-6d8d-4831-ae1e-e384bc0664a7 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:58.856264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cf3414e-6d8d-4831-ae1e-e384bc0664a7 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:58.857290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cf3414e-6d8d-4831-ae1e-e384bc0664a7 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:58.858040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cf3414e-6d8d-4831-ae1e-e384bc0664a7 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:59.201285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:59.213925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:59.216025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:59.217210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-85991f1a-fe57-430d-9149-bcb797d3882e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.406928 Jul 28 19:58:59.217772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 42/86] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:58:58 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:58:59.229005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-41a2e069-fd8f-4192-a911-f9fe774e3ee3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:58:59.229638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-41a2e069-fd8f-4192-a911-f9fe774e3ee3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:58:59.231586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3cf3414e-6d8d-4831-ae1e-e384bc0664a7 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:59.242858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3cf3414e-6d8d-4831-ae1e-e384bc0664a7 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.409498 Jul 28 19:58:59.244021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 45/87] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:58 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:58:59.244611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41a2e069-fd8f-4192-a911-f9fe774e3ee3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:59.245235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41a2e069-fd8f-4192-a911-f9fe774e3ee3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:59.246866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41a2e069-fd8f-4192-a911-f9fe774e3ee3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:58:59.247499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41a2e069-fd8f-4192-a911-f9fe774e3ee3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:58:59.388173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-41a2e069-fd8f-4192-a911-f9fe774e3ee3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:58:59.395879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-41a2e069-fd8f-4192-a911-f9fe774e3ee3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.177124 Jul 28 19:58:59.396522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 43/88] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:58:59 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:00.243867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:00.244471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:00.250530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:00.251181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:00.251985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:00.252902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:00.258716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:00.263619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-961c8b72-fbd7-4d95-b6b0-0883f4c6d9c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:00.264259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-961c8b72-fbd7-4d95-b6b0-0883f4c6d9c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:00.267067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:00.272025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-961c8b72-fbd7-4d95-b6b0-0883f4c6d9c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:00.272479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-961c8b72-fbd7-4d95-b6b0-0883f4c6d9c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:00.273276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-961c8b72-fbd7-4d95-b6b0-0883f4c6d9c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:00.273809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-961c8b72-fbd7-4d95-b6b0-0883f4c6d9c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:00.478549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:00.490455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:00.490735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-961c8b72-fbd7-4d95-b6b0-0883f4c6d9c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:00.491943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:00.493768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f8341c94-274c-456b-8dc4-93d2ad19ae13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.254224 Jul 28 19:59:00.494475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 46/89] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:00 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:00.500253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-04eeb5b1-c5b2-4363-aded-1350b2a65314 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:00.501061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-04eeb5b1-c5b2-4363-aded-1350b2a65314 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:00.501405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-961c8b72-fbd7-4d95-b6b0-0883f4c6d9c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.241420 Jul 28 19:59:00.507660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04eeb5b1-c5b2-4363-aded-1350b2a65314 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:00.509151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04eeb5b1-c5b2-4363-aded-1350b2a65314 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:00.510038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04eeb5b1-c5b2-4363-aded-1350b2a65314 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:00.510595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04eeb5b1-c5b2-4363-aded-1350b2a65314 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:00.513255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 44/90] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:00 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:00.662249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-04eeb5b1-c5b2-4363-aded-1350b2a65314 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:00.671260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-04eeb5b1-c5b2-4363-aded-1350b2a65314 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.175609 Jul 28 19:59:00.672343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 47/91] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:00 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:01.519159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:01.519773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:01.523086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9635c4c3-4907-452f-a03d-f8d957f67b1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:01.524308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9635c4c3-4907-452f-a03d-f8d957f67b1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:01.527648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:01.528095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:01.528884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:01.529315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:01.530529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9635c4c3-4907-452f-a03d-f8d957f67b1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:01.530981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9635c4c3-4907-452f-a03d-f8d957f67b1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:01.531740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9635c4c3-4907-452f-a03d-f8d957f67b1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:01.532386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9635c4c3-4907-452f-a03d-f8d957f67b1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:01.731530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:01.735029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9635c4c3-4907-452f-a03d-f8d957f67b1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:01.739634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:01.741712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:01.743319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-16cd3896-0661-48e7-a3ee-afb47d41574e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.228071 Jul 28 19:59:01.744022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9635c4c3-4907-452f-a03d-f8d957f67b1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.224605 Jul 28 19:59:01.744234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 45/92] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:01 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:01.745933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 48/93] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:01 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:01.749350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-579506fd-1c60-44d6-9493-a78badc5268c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:01.749952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-579506fd-1c60-44d6-9493-a78badc5268c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:01.755898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-579506fd-1c60-44d6-9493-a78badc5268c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:01.756359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-579506fd-1c60-44d6-9493-a78badc5268c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:01.757130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-579506fd-1c60-44d6-9493-a78badc5268c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:01.757556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-579506fd-1c60-44d6-9493-a78badc5268c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:01.895155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-579506fd-1c60-44d6-9493-a78badc5268c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:01.903101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-579506fd-1c60-44d6-9493-a78badc5268c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.157528 Jul 28 19:59:01.903662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 46/94] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:01 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:02.767715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:02.768969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-162e5227-d728-4d07-8c62-d0f9592f0b80 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:02.769578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-162e5227-d728-4d07-8c62-d0f9592f0b80 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:02.770077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:02.776944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:02.777603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:02.777918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-162e5227-d728-4d07-8c62-d0f9592f0b80 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:02.778373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-162e5227-d728-4d07-8c62-d0f9592f0b80 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:02.779138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-162e5227-d728-4d07-8c62-d0f9592f0b80 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:02.779646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-162e5227-d728-4d07-8c62-d0f9592f0b80 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:02.780860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:02.782146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:02.994661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:02.995520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-162e5227-d728-4d07-8c62-d0f9592f0b80 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:03.016843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-162e5227-d728-4d07-8c62-d0f9592f0b80 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.253178 Jul 28 19:59:03.017412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 49/95] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:02 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:03.021772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e27e1fa1-a879-4c9f-bb80-63064f15b941 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:03.022364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e27e1fa1-a879-4c9f-bb80-63064f15b941 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:03.025004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:03.026711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:03.027844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-02cc9f9d-4cf2-4dfe-b517-c0cf01751e8b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.264284 Jul 28 19:59:03.028394 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 47/96] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:02 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:03.033177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e27e1fa1-a879-4c9f-bb80-63064f15b941 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:03.033618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e27e1fa1-a879-4c9f-bb80-63064f15b941 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:03.034362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e27e1fa1-a879-4c9f-bb80-63064f15b941 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:03.034987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e27e1fa1-a879-4c9f-bb80-63064f15b941 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:03.173893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e27e1fa1-a879-4c9f-bb80-63064f15b941 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:03.181450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e27e1fa1-a879-4c9f-bb80-63064f15b941 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.163085 Jul 28 19:59:03.182052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 50/97] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:03 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:04.039516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f4b413e6-ee0a-431a-a52f-0250a12e2f1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:04.040206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f4b413e6-ee0a-431a-a52f-0250a12e2f1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:04.047611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4b413e6-ee0a-431a-a52f-0250a12e2f1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:04.048271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4b413e6-ee0a-431a-a52f-0250a12e2f1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:04.049579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4b413e6-ee0a-431a-a52f-0250a12e2f1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:04.050186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4b413e6-ee0a-431a-a52f-0250a12e2f1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:04.053338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:04.054827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:04.063584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:04.064323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:04.065488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:04.066158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:04.302435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f4b413e6-ee0a-431a-a52f-0250a12e2f1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:04.324267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f4b413e6-ee0a-431a-a52f-0250a12e2f1d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.289530 Jul 28 19:59:04.325402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 48/98] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:04 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:04.331617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a41a725d-d7ee-4000-9a7a-a93b66ff4366 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:04.333239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a41a725d-d7ee-4000-9a7a-a93b66ff4366 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:04.346244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:04.350412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a41a725d-d7ee-4000-9a7a-a93b66ff4366 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:04.351269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a41a725d-d7ee-4000-9a7a-a93b66ff4366 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:04.353821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a41a725d-d7ee-4000-9a7a-a93b66ff4366 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:04.354749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a41a725d-d7ee-4000-9a7a-a93b66ff4366 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:04.355798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:04.357823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:04.359474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d2fbdacf-d902-48f2-8f99-c5d427546cdf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.311807 Jul 28 19:59:04.360233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 51/99] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:04 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:04.509620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a41a725d-d7ee-4000-9a7a-a93b66ff4366 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:04.516871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a41a725d-d7ee-4000-9a7a-a93b66ff4366 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.188937 Jul 28 19:59:04.517420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 49/100] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:04 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:05.355284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b04b74ce-2533-49bb-bc77-acc5f7b30b96 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:05.356009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b04b74ce-2533-49bb-bc77-acc5f7b30b96 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:05.362442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b04b74ce-2533-49bb-bc77-acc5f7b30b96 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:05.363086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b04b74ce-2533-49bb-bc77-acc5f7b30b96 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:05.364125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b04b74ce-2533-49bb-bc77-acc5f7b30b96 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:05.364489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b04b74ce-2533-49bb-bc77-acc5f7b30b96 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:05.383924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:05.384982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:05.390295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:05.390738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:05.391488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:05.392633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:05.589126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b04b74ce-2533-49bb-bc77-acc5f7b30b96 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:05.592588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:05.601345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:05.602022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b04b74ce-2533-49bb-bc77-acc5f7b30b96 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.252545 Jul 28 19:59:05.602599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 52/101] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:05 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:05.603902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:05.605288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c5977654-22ab-4171-9b85-757231daa89b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.225903 Jul 28 19:59:05.605903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 50/102] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:05 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:05.616766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-23943d6a-c0a5-4542-89b3-841fd5d76d23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:05.618258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-23943d6a-c0a5-4542-89b3-841fd5d76d23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:05.624719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23943d6a-c0a5-4542-89b3-841fd5d76d23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:05.625165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23943d6a-c0a5-4542-89b3-841fd5d76d23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:05.625943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23943d6a-c0a5-4542-89b3-841fd5d76d23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:05.626355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23943d6a-c0a5-4542-89b3-841fd5d76d23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:05.768647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-23943d6a-c0a5-4542-89b3-841fd5d76d23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:05.776483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-23943d6a-c0a5-4542-89b3-841fd5d76d23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.172876 Jul 28 19:59:05.777075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 53/103] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:05 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:06.623479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-81cd6334-3878-4c4a-b0d0-488237172d86 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:06.624094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-81cd6334-3878-4c4a-b0d0-488237172d86 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:06.628425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:06.629139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:06.630113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81cd6334-3878-4c4a-b0d0-488237172d86 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:06.630584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81cd6334-3878-4c4a-b0d0-488237172d86 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:06.631371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81cd6334-3878-4c4a-b0d0-488237172d86 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:06.631795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81cd6334-3878-4c4a-b0d0-488237172d86 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:06.635541 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:06.635979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:06.636760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:06.637185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:06.826148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-81cd6334-3878-4c4a-b0d0-488237172d86 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:06.829968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:06.833676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-81cd6334-3878-4c4a-b0d0-488237172d86 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.214196 Jul 28 19:59:06.834230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 51/104] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:06 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:06.838127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:06.838883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7ff57f2c-4bdc-4764-bd43-2388f241677f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:06.839480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7ff57f2c-4bdc-4764-bd43-2388f241677f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:06.839624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:06.841005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cd989f5a-34d3-4bb2-8687-0cfb9aa1c72e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.216509 Jul 28 19:59:06.841700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 54/105] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:06 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:06.849281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ff57f2c-4bdc-4764-bd43-2388f241677f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:06.849723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ff57f2c-4bdc-4764-bd43-2388f241677f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:06.850485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ff57f2c-4bdc-4764-bd43-2388f241677f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:06.850921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ff57f2c-4bdc-4764-bd43-2388f241677f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:06.979706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7ff57f2c-4bdc-4764-bd43-2388f241677f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:06.987118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7ff57f2c-4bdc-4764-bd43-2388f241677f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.151872 Jul 28 19:59:06.987609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 52/106] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:06 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:07.856348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7de79907-c2d4-46e2-b196-1b059530a13f tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:07.857037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7de79907-c2d4-46e2-b196-1b059530a13f tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:07.863296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:07.864421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:07.865164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7de79907-c2d4-46e2-b196-1b059530a13f tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:07.865871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7de79907-c2d4-46e2-b196-1b059530a13f tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:07.866915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7de79907-c2d4-46e2-b196-1b059530a13f tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:07.867450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7de79907-c2d4-46e2-b196-1b059530a13f tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:07.871181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:07.871836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:07.872825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:07.873264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:08.074644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7de79907-c2d4-46e2-b196-1b059530a13f tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:08.081417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:08.082008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7de79907-c2d4-46e2-b196-1b059530a13f tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.230177 Jul 28 19:59:08.082570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 55/107] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:07 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:08.087919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-46b31a05-ec77-4034-a82e-4e479c9846f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:08.088728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-46b31a05-ec77-4034-a82e-4e479c9846f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:08.090477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:08.091965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:08.093171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5c847da6-93c2-489c-b674-11158ea27f63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.233610 Jul 28 19:59:08.094028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 53/108] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:07 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:08.094609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46b31a05-ec77-4034-a82e-4e479c9846f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:08.095122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46b31a05-ec77-4034-a82e-4e479c9846f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:08.095882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46b31a05-ec77-4034-a82e-4e479c9846f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:08.096374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46b31a05-ec77-4034-a82e-4e479c9846f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:08.223444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-46b31a05-ec77-4034-a82e-4e479c9846f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:08.230750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-46b31a05-ec77-4034-a82e-4e479c9846f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.147244 Jul 28 19:59:08.231311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 56/109] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:08 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:09.105259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-661eeb86-2a18-420e-8463-1eb13f6d164b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:09.106141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-661eeb86-2a18-420e-8463-1eb13f6d164b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:09.112305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-661eeb86-2a18-420e-8463-1eb13f6d164b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:09.113163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-661eeb86-2a18-420e-8463-1eb13f6d164b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:09.113924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-661eeb86-2a18-420e-8463-1eb13f6d164b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:09.114630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-661eeb86-2a18-420e-8463-1eb13f6d164b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:09.118338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:09.119512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:09.120329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:09.126474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:09.127050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:09.127865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:09.128358 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:09.333994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-661eeb86-2a18-420e-8463-1eb13f6d164b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:09.342414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:09.343571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-661eeb86-2a18-420e-8463-1eb13f6d164b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.243465 Jul 28 19:59:09.344137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 54/110] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:09 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:09.348854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-06e6f16e-949e-4752-9262-fb97c27221dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:09.349619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-06e6f16e-949e-4752-9262-fb97c27221dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:09.364285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:09.364778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-06e6f16e-949e-4752-9262-fb97c27221dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:09.365220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-06e6f16e-949e-4752-9262-fb97c27221dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:09.365976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-06e6f16e-949e-4752-9262-fb97c27221dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:09.366080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:09.366403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-06e6f16e-949e-4752-9262-fb97c27221dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:09.367360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5be4a102-909f-4dd4-a353-bed0e10144a6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.254289 Jul 28 19:59:09.367921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 57/111] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:09 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:09.500989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-06e6f16e-949e-4752-9262-fb97c27221dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:09.511752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-06e6f16e-949e-4752-9262-fb97c27221dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.166253 Jul 28 19:59:09.512648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 55/112] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:09 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:10.367655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-66595213-70d5-4452-a0c4-47f046aaf7b1 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:10.368273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-66595213-70d5-4452-a0c4-47f046aaf7b1 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:10.374324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66595213-70d5-4452-a0c4-47f046aaf7b1 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:10.374760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66595213-70d5-4452-a0c4-47f046aaf7b1 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:10.375515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66595213-70d5-4452-a0c4-47f046aaf7b1 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:10.375941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66595213-70d5-4452-a0c4-47f046aaf7b1 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:10.396215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:10.397531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:10.406069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:10.406506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:10.407281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:10.408472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:10.622330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-66595213-70d5-4452-a0c4-47f046aaf7b1 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:10.629275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:10.630121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-66595213-70d5-4452-a0c4-47f046aaf7b1 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.266658 Jul 28 19:59:10.630692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 58/113] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:10 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:10.635621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ad7c6348-cd0e-458f-800c-ba6f2bbb124f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:10.636223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ad7c6348-cd0e-458f-800c-ba6f2bbb124f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:10.643117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:10.644961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:10.646288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cbdec0da-b24f-4a91-a050-38a7c4551029 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.254805 Jul 28 19:59:10.646818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad7c6348-cd0e-458f-800c-ba6f2bbb124f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:10.647091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 56/114] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:10 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:10.647563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad7c6348-cd0e-458f-800c-ba6f2bbb124f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:10.648531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad7c6348-cd0e-458f-800c-ba6f2bbb124f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:10.649346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad7c6348-cd0e-458f-800c-ba6f2bbb124f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:10.793281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ad7c6348-cd0e-458f-800c-ba6f2bbb124f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:10.800669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ad7c6348-cd0e-458f-800c-ba6f2bbb124f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.169006 Jul 28 19:59:10.801222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 59/115] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:10 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:11.651568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fb6ab7be-8136-45c0-a462-568ba7d5a1c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:11.652201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fb6ab7be-8136-45c0-a462-568ba7d5a1c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:11.658066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb6ab7be-8136-45c0-a462-568ba7d5a1c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:11.658508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb6ab7be-8136-45c0-a462-568ba7d5a1c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:11.659261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb6ab7be-8136-45c0-a462-568ba7d5a1c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:11.659788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb6ab7be-8136-45c0-a462-568ba7d5a1c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:11.669785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:11.670403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:11.677569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:11.678220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:11.679803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:11.680624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:11.861388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fb6ab7be-8136-45c0-a462-568ba7d5a1c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:11.869649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fb6ab7be-8136-45c0-a462-568ba7d5a1c2 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.222357 Jul 28 19:59:11.870208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 57/116] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:11 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:11.874799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9bd05217-3d30-4a24-86ee-f6ea292ebf10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:11.875616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9bd05217-3d30-4a24-86ee-f6ea292ebf10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:11.881426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9bd05217-3d30-4a24-86ee-f6ea292ebf10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:11.882048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9bd05217-3d30-4a24-86ee-f6ea292ebf10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:11.883576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9bd05217-3d30-4a24-86ee-f6ea292ebf10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:11.884023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9bd05217-3d30-4a24-86ee-f6ea292ebf10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:11.892667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:11.903394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:11.905123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:11.906386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0e5d4e01-3fa2-493a-b1d0-423df04fdb6e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.240597 Jul 28 19:59:11.907055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 60/117] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:11 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:12.027707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9bd05217-3d30-4a24-86ee-f6ea292ebf10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:12.043812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9bd05217-3d30-4a24-86ee-f6ea292ebf10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.172410 Jul 28 19:59:12.044946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 58/118] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:11 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:12.890827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-90d5691f-e175-4c61-a773-90fd4791d27d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:12.891446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-90d5691f-e175-4c61-a773-90fd4791d27d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:12.898835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90d5691f-e175-4c61-a773-90fd4791d27d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:12.899397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90d5691f-e175-4c61-a773-90fd4791d27d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:12.900362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90d5691f-e175-4c61-a773-90fd4791d27d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:12.900900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90d5691f-e175-4c61-a773-90fd4791d27d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:12.929876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:12.930684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:12.947752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:12.948294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:12.949134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:12.949571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:13.299181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-90d5691f-e175-4c61-a773-90fd4791d27d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:13.311832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-90d5691f-e175-4c61-a773-90fd4791d27d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.424873 Jul 28 19:59:13.315799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 61/119] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:12 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:13.329590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-29459331-358e-4c55-a9dd-7b409ca44ba6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:13.333105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-29459331-358e-4c55-a9dd-7b409ca44ba6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:13.340183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:13.340818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29459331-358e-4c55-a9dd-7b409ca44ba6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:13.341798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29459331-358e-4c55-a9dd-7b409ca44ba6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:13.342876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29459331-358e-4c55-a9dd-7b409ca44ba6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:13.343457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29459331-358e-4c55-a9dd-7b409ca44ba6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:13.366990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:13.369806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:13.370974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-289fa4d8-f1b8-420f-8c6a-4465afb3d898 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.445570 Jul 28 19:59:13.371628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 59/120] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:12 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:13.465091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-df5b5e6b-b5e3-4aa6-a723-246d52f98e25 req-fa8f5588-d3a8-45bb-936f-bb2afc00d03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa26aee5-f3e7-4c58-85d6-b8c664a022b3", "name": "network-vif-plugged", "status": "completed", "tag": "e71d1474-59b2-44cb-84e0-1f7071339719"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:59:13.475262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-df5b5e6b-b5e3-4aa6-a723-246d52f98e25 req-fa8f5588-d3a8-45bb-936f-bb2afc00d03f service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:13.476678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-df5b5e6b-b5e3-4aa6-a723-246d52f98e25 req-fa8f5588-d3a8-45bb-936f-bb2afc00d03f service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:13.488310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-df5b5e6b-b5e3-4aa6-a723-246d52f98e25 req-fa8f5588-d3a8-45bb-936f-bb2afc00d03f service nova] Creating event network-vif-plugged:e71d1474-59b2-44cb-84e0-1f7071339719 for instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 on hv-cinder-85144 Jul 28 19:59:13.494851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-df5b5e6b-b5e3-4aa6-a723-246d52f98e25 req-fa8f5588-d3a8-45bb-936f-bb2afc00d03f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108360 Jul 28 19:59:13.495512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 60/121] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:59:13.500681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-29459331-358e-4c55-a9dd-7b409ca44ba6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:13.504364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:13.511132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-29459331-358e-4c55-a9dd-7b409ca44ba6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.193433 Jul 28 19:59:13.512796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 62/122] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:13 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:14.335633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b2866616-dbce-4bf1-96f3-3350a8b5ef9b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:14.336325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b2866616-dbce-4bf1-96f3-3350a8b5ef9b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:14.342803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2866616-dbce-4bf1-96f3-3350a8b5ef9b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:14.343244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2866616-dbce-4bf1-96f3-3350a8b5ef9b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:14.344022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2866616-dbce-4bf1-96f3-3350a8b5ef9b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:14.344442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2866616-dbce-4bf1-96f3-3350a8b5ef9b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:14.399356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:14.399946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:14.405955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:14.406393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:14.407135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:14.407559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:14.519935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b2866616-dbce-4bf1-96f3-3350a8b5ef9b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:14.528076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b2866616-dbce-4bf1-96f3-3350a8b5ef9b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.196635 Jul 28 19:59:14.528653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 61/123] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:14 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:14.533633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-11a70e71-914f-4ef8-97f9-0278aa305e5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:14.534218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-11a70e71-914f-4ef8-97f9-0278aa305e5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:14.540953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11a70e71-914f-4ef8-97f9-0278aa305e5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:14.541384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11a70e71-914f-4ef8-97f9-0278aa305e5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:14.542129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11a70e71-914f-4ef8-97f9-0278aa305e5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:14.542554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11a70e71-914f-4ef8-97f9-0278aa305e5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:14.569401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:14.577938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:14.580276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:14.581564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-19075905-dd94-4089-9dd8-4b513cf0da69 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.186266 Jul 28 19:59:14.582403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 63/124] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:14 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:14.677354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-11a70e71-914f-4ef8-97f9-0278aa305e5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:14.685130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-11a70e71-914f-4ef8-97f9-0278aa305e5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.154974 Jul 28 19:59:14.685683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 62/125] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:14 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:15.510618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-0fd481bb-5961-4baa-aeee-1bbca4e4387d req-7e30efcf-8322-4008-89f2-eb44f4cb9634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea28ea30-1675-4f86-9a3d-8be8cf2b882d", "name": "network-vif-plugged", "status": "completed", "tag": "4ff28c7e-5433-4834-adf9-9e59ef20b859"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:59:15.520122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-0fd481bb-5961-4baa-aeee-1bbca4e4387d req-7e30efcf-8322-4008-89f2-eb44f4cb9634 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:15.520583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-0fd481bb-5961-4baa-aeee-1bbca4e4387d req-7e30efcf-8322-4008-89f2-eb44f4cb9634 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:15.531309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-0fd481bb-5961-4baa-aeee-1bbca4e4387d req-7e30efcf-8322-4008-89f2-eb44f4cb9634 service nova] Creating event network-vif-plugged:4ff28c7e-5433-4834-adf9-9e59ef20b859 for instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d on hv-cinder-85144 Jul 28 19:59:15.536179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-0fd481bb-5961-4baa-aeee-1bbca4e4387d req-7e30efcf-8322-4008-89f2-eb44f4cb9634 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030071 Jul 28 19:59:15.537030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 64/126] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:59:15.549926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fa1396a0-046d-44de-93a1-38dbc1688137 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:15.550565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fa1396a0-046d-44de-93a1-38dbc1688137 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:15.557612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa1396a0-046d-44de-93a1-38dbc1688137 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:15.558054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa1396a0-046d-44de-93a1-38dbc1688137 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:15.558802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa1396a0-046d-44de-93a1-38dbc1688137 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:15.559233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa1396a0-046d-44de-93a1-38dbc1688137 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:15.607077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:15.607883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:15.614347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:15.614850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:15.615698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:15.616200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:15.759476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fa1396a0-046d-44de-93a1-38dbc1688137 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:15.766718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fa1396a0-046d-44de-93a1-38dbc1688137 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.220535 Jul 28 19:59:15.767273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 63/127] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:15 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:15.771653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a2f87312-7eb6-46cb-8592-3447e344748e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:15.772245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a2f87312-7eb6-46cb-8592-3447e344748e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:15.777962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2f87312-7eb6-46cb-8592-3447e344748e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:15.778401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2f87312-7eb6-46cb-8592-3447e344748e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:15.779146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2f87312-7eb6-46cb-8592-3447e344748e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:15.779572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2f87312-7eb6-46cb-8592-3447e344748e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:15.785228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:15.794156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:15.795725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:15.796918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-81734ed8-e3ff-453f-96e9-3c2ab04eae16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.194118 Jul 28 19:59:15.797540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 65/128] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:15 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:15.946250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a2f87312-7eb6-46cb-8592-3447e344748e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:15.954553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a2f87312-7eb6-46cb-8592-3447e344748e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.186305 Jul 28 19:59:15.955193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 64/129] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:15 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:16.789293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c73cb44b-df76-4d51-a738-72a12fc8699a tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:16.790535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c73cb44b-df76-4d51-a738-72a12fc8699a tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:16.796658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c73cb44b-df76-4d51-a738-72a12fc8699a tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:16.797131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c73cb44b-df76-4d51-a738-72a12fc8699a tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:16.797858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c73cb44b-df76-4d51-a738-72a12fc8699a tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:16.798283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c73cb44b-df76-4d51-a738-72a12fc8699a tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:16.835086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:16.839862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:16.861541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:16.862143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:16.863157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:16.863599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:17.044472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c73cb44b-df76-4d51-a738-72a12fc8699a tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:17.053387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c73cb44b-df76-4d51-a738-72a12fc8699a tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.269059 Jul 28 19:59:17.054678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 66/130] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:16 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:17.074585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f05624f7-9025-4877-854d-d2d6f66f472d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:17.075461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f05624f7-9025-4877-854d-d2d6f66f472d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:17.082166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f05624f7-9025-4877-854d-d2d6f66f472d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:17.082915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f05624f7-9025-4877-854d-d2d6f66f472d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:17.084091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f05624f7-9025-4877-854d-d2d6f66f472d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:17.084792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f05624f7-9025-4877-854d-d2d6f66f472d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:17.111715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:17.121606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:17.123335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:17.124451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6dfd9879-58e4-48bb-88b3-dfbba92a728b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.305614 Jul 28 19:59:17.140351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 65/131] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:16 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:17.275143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f05624f7-9025-4877-854d-d2d6f66f472d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:17.283911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f05624f7-9025-4877-854d-d2d6f66f472d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.213549 Jul 28 19:59:17.284243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 67/132] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:17 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:17.551882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-3565b290-d473-4b2e-a062-2100c2953894 req-b89bbcd8-8ada-4b36-a70b-55950a27c6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4889e06d-18cf-4e5e-9f68-8c168109c1d3", "name": "network-vif-plugged", "status": "completed", "tag": "e3b95cb5-58ef-47b5-a24c-57117b4da068"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:59:17.562294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-3565b290-d473-4b2e-a062-2100c2953894 req-b89bbcd8-8ada-4b36-a70b-55950a27c6ac service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:17.562733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-3565b290-d473-4b2e-a062-2100c2953894 req-b89bbcd8-8ada-4b36-a70b-55950a27c6ac service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:17.574036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-3565b290-d473-4b2e-a062-2100c2953894 req-b89bbcd8-8ada-4b36-a70b-55950a27c6ac service nova] Creating event network-vif-plugged:e3b95cb5-58ef-47b5-a24c-57117b4da068 for instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 on hv-cinder-85144 Jul 28 19:59:17.579712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-3565b290-d473-4b2e-a062-2100c2953894 req-b89bbcd8-8ada-4b36-a70b-55950a27c6ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031448 Jul 28 19:59:17.580299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 66/133] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:59:18.075446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e8513a82-b1cf-41be-bec9-13811cf64fdf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:18.076068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e8513a82-b1cf-41be-bec9-13811cf64fdf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:18.082600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8513a82-b1cf-41be-bec9-13811cf64fdf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:18.083040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8513a82-b1cf-41be-bec9-13811cf64fdf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:18.083792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8513a82-b1cf-41be-bec9-13811cf64fdf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:18.084223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8513a82-b1cf-41be-bec9-13811cf64fdf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:18.148574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:18.149568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:18.155678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:18.156119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:18.156908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:18.157334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:18.246422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e8513a82-b1cf-41be-bec9-13811cf64fdf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:18.253892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e8513a82-b1cf-41be-bec9-13811cf64fdf tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.182364 Jul 28 19:59:18.254449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 68/134] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:18 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:18.306836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-96ea6746-dbfa-4486-9032-375bb215cab6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:18.307436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-96ea6746-dbfa-4486-9032-375bb215cab6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:18.310640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:18.313396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96ea6746-dbfa-4486-9032-375bb215cab6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:18.313831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96ea6746-dbfa-4486-9032-375bb215cab6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:18.314580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96ea6746-dbfa-4486-9032-375bb215cab6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:18.315009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96ea6746-dbfa-4486-9032-375bb215cab6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:18.318746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:18.321141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:18.322249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e97ecd2f-448d-47cf-82d2-eb96d51460a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.178659 Jul 28 19:59:18.322806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 67/135] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:18 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:18.444495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-96ea6746-dbfa-4486-9032-375bb215cab6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:18.451900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-96ea6746-dbfa-4486-9032-375bb215cab6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.149667 Jul 28 19:59:18.452447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 69/136] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:18 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:19.275580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3b846332-110b-4a33-8371-f1ce70af39d9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:19.276183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3b846332-110b-4a33-8371-f1ce70af39d9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:19.282263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b846332-110b-4a33-8371-f1ce70af39d9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:19.282703 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b846332-110b-4a33-8371-f1ce70af39d9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:19.283452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b846332-110b-4a33-8371-f1ce70af39d9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:19.283874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b846332-110b-4a33-8371-f1ce70af39d9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:19.344868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:19.345749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:19.353209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:19.353663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:19.354431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:19.354865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:19.443613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3b846332-110b-4a33-8371-f1ce70af39d9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:19.451000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3b846332-110b-4a33-8371-f1ce70af39d9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.179780 Jul 28 19:59:19.451568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 68/137] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:19 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:19.472239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cdcfc54f-b3f6-4371-9d20-3ee5ebdd3a1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:19.472885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cdcfc54f-b3f6-4371-9d20-3ee5ebdd3a1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:19.479333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdcfc54f-b3f6-4371-9d20-3ee5ebdd3a1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:19.479782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdcfc54f-b3f6-4371-9d20-3ee5ebdd3a1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:19.480560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdcfc54f-b3f6-4371-9d20-3ee5ebdd3a1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:19.480998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdcfc54f-b3f6-4371-9d20-3ee5ebdd3a1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:19.503944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:19.512678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:19.514200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:19.515303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-39c22cc6-7ba0-4d4e-ba63-b8e2a9309f56 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.174455 Jul 28 19:59:19.515872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 70/138] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:19 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:19.606777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cdcfc54f-b3f6-4371-9d20-3ee5ebdd3a1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:19.614507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cdcfc54f-b3f6-4371-9d20-3ee5ebdd3a1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.146100 Jul 28 19:59:19.615228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 69/139] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:19 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:20.471715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fc64fdb8-9444-4424-9573-43cf6aed24ca tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:20.472320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fc64fdb8-9444-4424-9573-43cf6aed24ca tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:20.478688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc64fdb8-9444-4424-9573-43cf6aed24ca tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:20.479133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc64fdb8-9444-4424-9573-43cf6aed24ca tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:20.479876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc64fdb8-9444-4424-9573-43cf6aed24ca tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:20.480303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc64fdb8-9444-4424-9573-43cf6aed24ca tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:20.539030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:20.541056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:20.548255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:20.549154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:20.550174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:20.550804 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:20.752372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fc64fdb8-9444-4424-9573-43cf6aed24ca tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:20.766348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fc64fdb8-9444-4424-9573-43cf6aed24ca tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.297166 Jul 28 19:59:20.768364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 71/140] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:20 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:20.781430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-78cdfa40-1408-4b49-9c55-df81d8b28ccc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:20.782505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-78cdfa40-1408-4b49-9c55-df81d8b28ccc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:20.784153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:20.792779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78cdfa40-1408-4b49-9c55-df81d8b28ccc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:20.793751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78cdfa40-1408-4b49-9c55-df81d8b28ccc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:20.794817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78cdfa40-1408-4b49-9c55-df81d8b28ccc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:20.795481 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78cdfa40-1408-4b49-9c55-df81d8b28ccc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:20.810768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:20.813714 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:20.815107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9cd07192-94b3-4742-a1d2-5cb585dcd6b8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.280378 Jul 28 19:59:20.816123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 70/141] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:20 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:21.023400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-78cdfa40-1408-4b49-9c55-df81d8b28ccc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:21.031438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-78cdfa40-1408-4b49-9c55-df81d8b28ccc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.260589 Jul 28 19:59:21.032009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 72/142] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:20 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:21.793805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ca7a55a0-a4dc-47ab-a3e2-99a191b9d7a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:21.796230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ca7a55a0-a4dc-47ab-a3e2-99a191b9d7a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:21.808143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ca7a55a0-a4dc-47ab-a3e2-99a191b9d7a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:21.808999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ca7a55a0-a4dc-47ab-a3e2-99a191b9d7a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:21.811153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ca7a55a0-a4dc-47ab-a3e2-99a191b9d7a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:21.812162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ca7a55a0-a4dc-47ab-a3e2-99a191b9d7a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:21.846926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:21.848265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:21.861113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:21.861840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:21.863168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:21.863749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:22.137136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ca7a55a0-a4dc-47ab-a3e2-99a191b9d7a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:22.153969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ca7a55a0-a4dc-47ab-a3e2-99a191b9d7a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1314 microversion: 2.1 time: 0.356442 Jul 28 19:59:22.166206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:22.177447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 71/143] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:21 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:22.192272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:22.195025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:22.196204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9bacc7df-54f6-4563-a5f7-1206ff517806 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.359207 Jul 28 19:59:22.197542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 73/144] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:21 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:22.202593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fb4f68e7-5400-4670-a651-fb450539f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:22.203142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fb4f68e7-5400-4670-a651-fb450539f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:22.213105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb4f68e7-5400-4670-a651-fb450539f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:22.213560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb4f68e7-5400-4670-a651-fb450539f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:22.214322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb4f68e7-5400-4670-a651-fb450539f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:22.214751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb4f68e7-5400-4670-a651-fb450539f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:22.219233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:22.364594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fb4f68e7-5400-4670-a651-fb450539f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:22.374217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fb4f68e7-5400-4670-a651-fb450539f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.192551 Jul 28 19:59:22.374796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 72/145] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:22 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:22.577532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-7e3ad0a7-5e6a-45cb-be42-dcbc60cbbbf0 req-d1dcf9bc-1365-4dcb-a030-a7059fbe66c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb2a989-29e7-4123-bb19-871b05d7f88e", "name": "network-vif-plugged", "status": "completed", "tag": "f92e97e3-b3c8-4bed-9bea-8dca7dcc33fc"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:59:22.589391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-7e3ad0a7-5e6a-45cb-be42-dcbc60cbbbf0 req-d1dcf9bc-1365-4dcb-a030-a7059fbe66c0 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:22.590223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-7e3ad0a7-5e6a-45cb-be42-dcbc60cbbbf0 req-d1dcf9bc-1365-4dcb-a030-a7059fbe66c0 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:22.603688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-7e3ad0a7-5e6a-45cb-be42-dcbc60cbbbf0 req-d1dcf9bc-1365-4dcb-a030-a7059fbe66c0 service nova] Creating event network-vif-plugged:f92e97e3-b3c8-4bed-9bea-8dca7dcc33fc for instance feb2a989-29e7-4123-bb19-871b05d7f88e on hv-cinder-85144 Jul 28 19:59:22.609696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-7e3ad0a7-5e6a-45cb-be42-dcbc60cbbbf0 req-d1dcf9bc-1365-4dcb-a030-a7059fbe66c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035960 Jul 28 19:59:22.609696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 74/146] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:59:23.196220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f2c5c0ad-5840-4572-a0a1-c2a30102b32e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:23.197600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f2c5c0ad-5840-4572-a0a1-c2a30102b32e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:23.203603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f2c5c0ad-5840-4572-a0a1-c2a30102b32e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:23.204037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f2c5c0ad-5840-4572-a0a1-c2a30102b32e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:23.205113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f2c5c0ad-5840-4572-a0a1-c2a30102b32e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:23.205537 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f2c5c0ad-5840-4572-a0a1-c2a30102b32e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:23.223153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:23.224094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:23.232962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:23.233902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:23.235596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:23.237125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:23.456768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:23.468341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f2c5c0ad-5840-4572-a0a1-c2a30102b32e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:23.469383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:23.473708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:23.474870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6e1ca717-13b9-4322-968f-84ab96ce003b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.256371 Jul 28 19:59:23.476644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 75/147] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:23 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 19:59:23.478824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f2c5c0ad-5840-4572-a0a1-c2a30102b32e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1502 microversion: 2.1 time: 0.286974 Jul 28 19:59:23.479805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 73/148] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:23 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:23.499660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bea53688-c3fb-46ea-b3f7-3bc7a0ef5baa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:23.500346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bea53688-c3fb-46ea-b3f7-3bc7a0ef5baa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:23.507584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bea53688-c3fb-46ea-b3f7-3bc7a0ef5baa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:23.508080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bea53688-c3fb-46ea-b3f7-3bc7a0ef5baa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:23.509500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bea53688-c3fb-46ea-b3f7-3bc7a0ef5baa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:23.510208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bea53688-c3fb-46ea-b3f7-3bc7a0ef5baa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:23.789583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bea53688-c3fb-46ea-b3f7-3bc7a0ef5baa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:23.801538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bea53688-c3fb-46ea-b3f7-3bc7a0ef5baa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.323871 Jul 28 19:59:23.806778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 76/149] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:23 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:24.499143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:24.500477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:24.508685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:24.509374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:24.510220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:24.510845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:24.716514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:24.736087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:24.738132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:24.739292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0e020e81-75a1-4905-8b48-0241cade02f4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.244329 Jul 28 19:59:24.752566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 74/150] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:24 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:24.826719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c85674f0-8a5b-49b2-94a7-8b3ab77965a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:24.827887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c85674f0-8a5b-49b2-94a7-8b3ab77965a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:24.836000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c85674f0-8a5b-49b2-94a7-8b3ab77965a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:24.836704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c85674f0-8a5b-49b2-94a7-8b3ab77965a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:24.837509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c85674f0-8a5b-49b2-94a7-8b3ab77965a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:24.837905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c85674f0-8a5b-49b2-94a7-8b3ab77965a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:25.048289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c85674f0-8a5b-49b2-94a7-8b3ab77965a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:25.058367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c85674f0-8a5b-49b2-94a7-8b3ab77965a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.235384 Jul 28 19:59:25.058968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 77/151] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:24 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:25.765756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:25.766930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:25.773145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:25.773586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:25.774370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:25.774799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:25.953632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:25.963507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:25.965599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:25.966714 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-36d1d436-ad4c-4f33-acba-468f838bbdd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1406 microversion: 2.20 time: 0.205319 Jul 28 19:59:25.967411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 75/152] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:25 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:26.103557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-205ba9e0-f4e8-40e9-be32-ea3b1e53f3dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:26.104180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-205ba9e0-f4e8-40e9-be32-ea3b1e53f3dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:26.106231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=74 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:26.121377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-205ba9e0-f4e8-40e9-be32-ea3b1e53f3dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:26.122084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-205ba9e0-f4e8-40e9-be32-ea3b1e53f3dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:26.123231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-205ba9e0-f4e8-40e9-be32-ea3b1e53f3dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:26.123958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-205ba9e0-f4e8-40e9-be32-ea3b1e53f3dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:26.305430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-205ba9e0-f4e8-40e9-be32-ea3b1e53f3dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:26.314303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-205ba9e0-f4e8-40e9-be32-ea3b1e53f3dd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.225560 Jul 28 19:59:26.322044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 78/153] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:26 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:26.994930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:26.995691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:27.001701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=74 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:27.003809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:27.004616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:27.005700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:27.006329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:27.183841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:27.194758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:27.196305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:27.197588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-97c8323a-79e8-4cd3-b85c-1f0fbd79339f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1597 microversion: 2.20 time: 0.207009 Jul 28 19:59:27.204932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 76/154] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 19:59:26 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1597 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 19:59:27.222530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6bb45dd-0c2d-4dd8-a537-3dcdfe20f551 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:27.223009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b6bb45dd-0c2d-4dd8-a537-3dcdfe20f551 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:27.229787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6bb45dd-0c2d-4dd8-a537-3dcdfe20f551 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:27.230459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6bb45dd-0c2d-4dd8-a537-3dcdfe20f551 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:27.231377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6bb45dd-0c2d-4dd8-a537-3dcdfe20f551 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:27.231946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6bb45dd-0c2d-4dd8-a537-3dcdfe20f551 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:27.338238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e8853cc-2ac1-4998-94a2-af5513f528ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:27.338846 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9e8853cc-2ac1-4998-94a2-af5513f528ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:27.346276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e8853cc-2ac1-4998-94a2-af5513f528ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:27.346720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e8853cc-2ac1-4998-94a2-af5513f528ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:27.347473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e8853cc-2ac1-4998-94a2-af5513f528ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:27.347896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e8853cc-2ac1-4998-94a2-af5513f528ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:27.373114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b6bb45dd-0c2d-4dd8-a537-3dcdfe20f551 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.154150 Jul 28 19:59:27.374019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 79/155] 10.222.0.67 () {60 vars in 1316 bytes} [Thu Jul 28 19:59:27 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 19:59:27.529563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9e8853cc-2ac1-4998-94a2-af5513f528ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:27.538286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e8853cc-2ac1-4998-94a2-af5513f528ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.205556 Jul 28 19:59:27.549213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 77/156] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:27 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:28.561006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fe6650c9-4613-44ac-8758-441c35026e91 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:28.561740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fe6650c9-4613-44ac-8758-441c35026e91 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:28.568453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe6650c9-4613-44ac-8758-441c35026e91 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:28.568935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe6650c9-4613-44ac-8758-441c35026e91 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:28.570374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe6650c9-4613-44ac-8758-441c35026e91 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:28.570804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe6650c9-4613-44ac-8758-441c35026e91 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:28.739107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fe6650c9-4613-44ac-8758-441c35026e91 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:28.748452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fe6650c9-4613-44ac-8758-441c35026e91 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.191515 Jul 28 19:59:28.749059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 80/157] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:28 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:28.942652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-6df4ccf2-79e2-4b88-b119-d8dbffaa5967 req-33e8430c-21a4-406c-b335-a884fa40c433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4889e06d-18cf-4e5e-9f68-8c168109c1d3", "tag": "e3b95cb5-58ef-47b5-a24c-57117b4da068"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:59:28.961389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-6df4ccf2-79e2-4b88-b119-d8dbffaa5967 req-33e8430c-21a4-406c-b335-a884fa40c433 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:28.962616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-6df4ccf2-79e2-4b88-b119-d8dbffaa5967 req-33e8430c-21a4-406c-b335-a884fa40c433 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:28.974727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-6df4ccf2-79e2-4b88-b119-d8dbffaa5967 req-33e8430c-21a4-406c-b335-a884fa40c433 service nova] Creating event network-changed:e3b95cb5-58ef-47b5-a24c-57117b4da068 for instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 on hv-cinder-85144 Jul 28 19:59:28.981451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-6df4ccf2-79e2-4b88-b119-d8dbffaa5967 req-33e8430c-21a4-406c-b335-a884fa40c433 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042224 Jul 28 19:59:28.982378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 78/158] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:59:29.773960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8ae4f889-432d-41e1-91f4-49cc00011e29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:29.774548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8ae4f889-432d-41e1-91f4-49cc00011e29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:29.784896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ae4f889-432d-41e1-91f4-49cc00011e29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:29.785352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ae4f889-432d-41e1-91f4-49cc00011e29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:29.787554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ae4f889-432d-41e1-91f4-49cc00011e29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:29.788065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ae4f889-432d-41e1-91f4-49cc00011e29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:29.793773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:30.087657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8ae4f889-432d-41e1-91f4-49cc00011e29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:30.100633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8ae4f889-432d-41e1-91f4-49cc00011e29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.331264 Jul 28 19:59:30.113427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 81/159] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:29 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:30.493797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7ac906f3-0384-4d0a-aa9f-62492f7994df tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b9d4777-861a-4b43-a844-9597c54f850b"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:59:30.497367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7ac906f3-0384-4d0a-aa9f-62492f7994df tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:30.507519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ac906f3-0384-4d0a-aa9f-62492f7994df tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:30.508184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ac906f3-0384-4d0a-aa9f-62492f7994df tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:30.509554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ac906f3-0384-4d0a-aa9f-62492f7994df tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:30.510425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ac906f3-0384-4d0a-aa9f-62492f7994df tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:31.122677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5eb6246b-e391-41fd-8284-27c77c83009a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:31.123281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5eb6246b-e391-41fd-8284-27c77c83009a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:31.129904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5eb6246b-e391-41fd-8284-27c77c83009a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:31.130525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5eb6246b-e391-41fd-8284-27c77c83009a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:31.132117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5eb6246b-e391-41fd-8284-27c77c83009a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:31.132770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5eb6246b-e391-41fd-8284-27c77c83009a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:31.310585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5eb6246b-e391-41fd-8284-27c77c83009a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:31.318313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5eb6246b-e391-41fd-8284-27c77c83009a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.199286 Jul 28 19:59:31.331783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 82/160] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:31 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 19:59:32.339905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a209f69c-3788-4dd1-8aad-0e04b181cc32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:32.340591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a209f69c-3788-4dd1-8aad-0e04b181cc32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:32.346881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a209f69c-3788-4dd1-8aad-0e04b181cc32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:32.347335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a209f69c-3788-4dd1-8aad-0e04b181cc32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:32.352385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a209f69c-3788-4dd1-8aad-0e04b181cc32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:32.353003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a209f69c-3788-4dd1-8aad-0e04b181cc32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:32.516028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a209f69c-3788-4dd1-8aad-0e04b181cc32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:32.524726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a209f69c-3788-4dd1-8aad-0e04b181cc32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.190194 Jul 28 19:59:32.529150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 83/161] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:32 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:33.556891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7248d1e2-d65d-428e-8fa9-8ffc801e6369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:33.557889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7248d1e2-d65d-428e-8fa9-8ffc801e6369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:33.570751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7248d1e2-d65d-428e-8fa9-8ffc801e6369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:33.572926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7248d1e2-d65d-428e-8fa9-8ffc801e6369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:33.575287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7248d1e2-d65d-428e-8fa9-8ffc801e6369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:33.575605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7248d1e2-d65d-428e-8fa9-8ffc801e6369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:33.850490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7248d1e2-d65d-428e-8fa9-8ffc801e6369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:33.860975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7248d1e2-d65d-428e-8fa9-8ffc801e6369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1322 microversion: 2.1 time: 0.311344 Jul 28 19:59:33.863833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 84/162] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:33 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:34.051502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7ac906f3-0384-4d0a-aa9f-62492f7994df tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "POST /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.567364 Jul 28 19:59:34.052146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 79/163] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 19:59:30 2022] POST /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3/os-volume_attachments => generated 194 bytes in 3569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:59:34.888325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d4be5529-f8a8-43df-ae32-1e49f65f851d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:34.889013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d4be5529-f8a8-43df-ae32-1e49f65f851d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:34.902177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d4be5529-f8a8-43df-ae32-1e49f65f851d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:34.904806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d4be5529-f8a8-43df-ae32-1e49f65f851d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:34.905863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d4be5529-f8a8-43df-ae32-1e49f65f851d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:34.910297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d4be5529-f8a8-43df-ae32-1e49f65f851d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:35.137844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d4be5529-f8a8-43df-ae32-1e49f65f851d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:35.147478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d4be5529-f8a8-43df-ae32-1e49f65f851d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1516 microversion: 2.1 time: 0.262743 Jul 28 19:59:35.148826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 85/164] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:34 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1516 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:35.172699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1975c7eb-84c4-4246-ba96-e43ed0e7ef69 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:59:35.175165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1975c7eb-84c4-4246-ba96-e43ed0e7ef69 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:35.189207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1975c7eb-84c4-4246-ba96-e43ed0e7ef69 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:35.189840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1975c7eb-84c4-4246-ba96-e43ed0e7ef69 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:35.190997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1975c7eb-84c4-4246-ba96-e43ed0e7ef69 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:35.193235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1975c7eb-84c4-4246-ba96-e43ed0e7ef69 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:35.260314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-1975c7eb-84c4-4246-ba96-e43ed0e7ef69 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'flavor' on Instance uuid feb2a989-29e7-4123-bb19-871b05d7f88e {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 19:59:35.424131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1975c7eb-84c4-4246-ba96-e43ed0e7ef69 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e/action" status: 200 len: 32 microversion: 2.1 time: 0.258006 Jul 28 19:59:35.426156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 80/165] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 19:59:35 2022] POST /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 19:59:35.434306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3f8782e6-67f9-4d97-bd3a-5211e3e3edaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:35.435111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3f8782e6-67f9-4d97-bd3a-5211e3e3edaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:35.441969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f8782e6-67f9-4d97-bd3a-5211e3e3edaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:35.442597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f8782e6-67f9-4d97-bd3a-5211e3e3edaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:35.443513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f8782e6-67f9-4d97-bd3a-5211e3e3edaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:35.444734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f8782e6-67f9-4d97-bd3a-5211e3e3edaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:35.656071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f8782e6-67f9-4d97-bd3a-5211e3e3edaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:35.664596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3f8782e6-67f9-4d97-bd3a-5211e3e3edaa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.233967 Jul 28 19:59:35.665863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 86/166] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:35 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:36.689186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5299f991-d458-49d7-ad73-2d10a7738e36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:36.689898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5299f991-d458-49d7-ad73-2d10a7738e36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:36.698448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5299f991-d458-49d7-ad73-2d10a7738e36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:36.699171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5299f991-d458-49d7-ad73-2d10a7738e36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:36.700100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5299f991-d458-49d7-ad73-2d10a7738e36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:36.700865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5299f991-d458-49d7-ad73-2d10a7738e36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:36.997743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5299f991-d458-49d7-ad73-2d10a7738e36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:37.005307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5299f991-d458-49d7-ad73-2d10a7738e36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.320717 Jul 28 19:59:37.005867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 81/167] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:36 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:38.029303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-69668dd0-d138-4d2f-a4f2-6f78cf2bcba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:38.030367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-69668dd0-d138-4d2f-a4f2-6f78cf2bcba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:38.038272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-69668dd0-d138-4d2f-a4f2-6f78cf2bcba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:38.039115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-69668dd0-d138-4d2f-a4f2-6f78cf2bcba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:38.040741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-69668dd0-d138-4d2f-a4f2-6f78cf2bcba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:38.041558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-69668dd0-d138-4d2f-a4f2-6f78cf2bcba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:38.374042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-69668dd0-d138-4d2f-a4f2-6f78cf2bcba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:38.385649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-69668dd0-d138-4d2f-a4f2-6f78cf2bcba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.360940 Jul 28 19:59:38.386483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 87/168] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:38 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:39.410874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5a3d1901-28c5-4aff-8076-7082b301234a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:39.411739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5a3d1901-28c5-4aff-8076-7082b301234a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:39.432989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a3d1901-28c5-4aff-8076-7082b301234a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:39.433407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a3d1901-28c5-4aff-8076-7082b301234a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:39.434181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a3d1901-28c5-4aff-8076-7082b301234a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:39.436672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a3d1901-28c5-4aff-8076-7082b301234a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:39.844966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5a3d1901-28c5-4aff-8076-7082b301234a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:39.860818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5a3d1901-28c5-4aff-8076-7082b301234a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.453969 Jul 28 19:59:39.863556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 82/169] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:39 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:40.894587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bde4ce15-aaee-47c4-bcaf-9ff1e8a5698d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:40.895757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bde4ce15-aaee-47c4-bcaf-9ff1e8a5698d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:40.918811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bde4ce15-aaee-47c4-bcaf-9ff1e8a5698d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:40.918811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bde4ce15-aaee-47c4-bcaf-9ff1e8a5698d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:40.918811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bde4ce15-aaee-47c4-bcaf-9ff1e8a5698d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:40.919213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bde4ce15-aaee-47c4-bcaf-9ff1e8a5698d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:41.355462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bde4ce15-aaee-47c4-bcaf-9ff1e8a5698d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:41.370318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bde4ce15-aaee-47c4-bcaf-9ff1e8a5698d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.476702 Jul 28 19:59:41.372912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 88/170] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:40 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:42.394556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0815b7b9-50b2-4a52-89d5-27bfbb2538f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:42.395362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0815b7b9-50b2-4a52-89d5-27bfbb2538f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:42.406103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0815b7b9-50b2-4a52-89d5-27bfbb2538f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:42.406688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0815b7b9-50b2-4a52-89d5-27bfbb2538f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:42.408284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0815b7b9-50b2-4a52-89d5-27bfbb2538f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:42.409110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0815b7b9-50b2-4a52-89d5-27bfbb2538f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:42.623702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0815b7b9-50b2-4a52-89d5-27bfbb2538f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:42.634919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0815b7b9-50b2-4a52-89d5-27bfbb2538f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.244986 Jul 28 19:59:42.636150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 83/171] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:42 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:43.658031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2207ea35-f810-4f74-bb49-00fed90ced34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:43.658942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2207ea35-f810-4f74-bb49-00fed90ced34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:43.666802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2207ea35-f810-4f74-bb49-00fed90ced34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:43.667480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2207ea35-f810-4f74-bb49-00fed90ced34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:43.668401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2207ea35-f810-4f74-bb49-00fed90ced34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:43.668981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2207ea35-f810-4f74-bb49-00fed90ced34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:43.965534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2207ea35-f810-4f74-bb49-00fed90ced34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:43.980751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2207ea35-f810-4f74-bb49-00fed90ced34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.326245 Jul 28 19:59:43.982904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 89/172] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:43 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:45.004018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ff6a0e41-1047-40d0-827e-04eb18b93b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:45.007039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ff6a0e41-1047-40d0-827e-04eb18b93b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:45.017630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff6a0e41-1047-40d0-827e-04eb18b93b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:45.020891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff6a0e41-1047-40d0-827e-04eb18b93b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:45.022637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff6a0e41-1047-40d0-827e-04eb18b93b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:45.023263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff6a0e41-1047-40d0-827e-04eb18b93b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:45.303903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ff6a0e41-1047-40d0-827e-04eb18b93b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:45.331727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ff6a0e41-1047-40d0-827e-04eb18b93b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.313210 Jul 28 19:59:45.338282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 84/173] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:44 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:46.362118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c2a480eb-d9dc-4035-952d-ea1650dfb611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:46.362740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c2a480eb-d9dc-4035-952d-ea1650dfb611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:46.374762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2a480eb-d9dc-4035-952d-ea1650dfb611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:46.375215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2a480eb-d9dc-4035-952d-ea1650dfb611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:46.375990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2a480eb-d9dc-4035-952d-ea1650dfb611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:46.376420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2a480eb-d9dc-4035-952d-ea1650dfb611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:46.861654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c2a480eb-d9dc-4035-952d-ea1650dfb611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:46.879576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c2a480eb-d9dc-4035-952d-ea1650dfb611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.521292 Jul 28 19:59:46.880732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 90/174] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:46 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:47.049041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c0751e4c-ac51-4eee-8ecd-a7a1b11c2912 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:47.050115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c0751e4c-ac51-4eee-8ecd-a7a1b11c2912 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:47.062949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c0751e4c-ac51-4eee-8ecd-a7a1b11c2912 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:47.063987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c0751e4c-ac51-4eee-8ecd-a7a1b11c2912 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:47.066575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c0751e4c-ac51-4eee-8ecd-a7a1b11c2912 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:47.067919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c0751e4c-ac51-4eee-8ecd-a7a1b11c2912 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:47.116773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c0751e4c-ac51-4eee-8ecd-a7a1b11c2912 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 19:59:47.158184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:47.328402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c0751e4c-ac51-4eee-8ecd-a7a1b11c2912 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 204 len: 0 microversion: 2.1 time: 0.283525 Jul 28 19:59:47.330302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 85/175] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 19:59:47 2022] DELETE /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 19:59:47.347723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-90f486d4-68e6-46e2-bac4-46014d541393 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:47.348392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-90f486d4-68e6-46e2-bac4-46014d541393 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:47.374469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90f486d4-68e6-46e2-bac4-46014d541393 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:47.376772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90f486d4-68e6-46e2-bac4-46014d541393 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:47.380448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90f486d4-68e6-46e2-bac4-46014d541393 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:47.386001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90f486d4-68e6-46e2-bac4-46014d541393 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:47.728344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-90f486d4-68e6-46e2-bac4-46014d541393 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:47.745344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-90f486d4-68e6-46e2-bac4-46014d541393 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1554 microversion: 2.1 time: 0.409118 Jul 28 19:59:47.747224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 91/176] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:47 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1554 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:47.906736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c8276a94-264d-4518-afc2-173ac23f98c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:47.907652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c8276a94-264d-4518-afc2-173ac23f98c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:47.932229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c8276a94-264d-4518-afc2-173ac23f98c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:47.932888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c8276a94-264d-4518-afc2-173ac23f98c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:47.933827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c8276a94-264d-4518-afc2-173ac23f98c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:47.934425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c8276a94-264d-4518-afc2-173ac23f98c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:48.232010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c8276a94-264d-4518-afc2-173ac23f98c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:48.241970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c8276a94-264d-4518-afc2-173ac23f98c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.340493 Jul 28 19:59:48.257884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 86/177] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:47 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:48.767689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c391291-86df-4836-907c-ff22d1717a8d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:48.768306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1c391291-86df-4836-907c-ff22d1717a8d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:48.777460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c391291-86df-4836-907c-ff22d1717a8d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:48.778212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c391291-86df-4836-907c-ff22d1717a8d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:48.779438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c391291-86df-4836-907c-ff22d1717a8d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:48.780111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c391291-86df-4836-907c-ff22d1717a8d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:49.106257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1c391291-86df-4836-907c-ff22d1717a8d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:49.120467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1c391291-86df-4836-907c-ff22d1717a8d tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1554 microversion: 2.1 time: 0.354919 Jul 28 19:59:49.121920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 92/178] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:48 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1554 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:49.263830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-34783220-84b0-4cc8-bb8f-08ea518a2891 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:49.264483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-34783220-84b0-4cc8-bb8f-08ea518a2891 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:49.273869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34783220-84b0-4cc8-bb8f-08ea518a2891 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:49.274315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34783220-84b0-4cc8-bb8f-08ea518a2891 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:49.275201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34783220-84b0-4cc8-bb8f-08ea518a2891 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:49.275508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34783220-84b0-4cc8-bb8f-08ea518a2891 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:49.522122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-34783220-84b0-4cc8-bb8f-08ea518a2891 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:49.534682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-34783220-84b0-4cc8-bb8f-08ea518a2891 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.274492 Jul 28 19:59:49.535994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 87/179] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:49 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:50.151156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ce21c1b2-8a9a-4e1f-b98b-477761635e3e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:50.157700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ce21c1b2-8a9a-4e1f-b98b-477761635e3e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:50.191479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ce21c1b2-8a9a-4e1f-b98b-477761635e3e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:50.192165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ce21c1b2-8a9a-4e1f-b98b-477761635e3e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:50.194450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ce21c1b2-8a9a-4e1f-b98b-477761635e3e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:50.196828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ce21c1b2-8a9a-4e1f-b98b-477761635e3e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:50.376492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ce21c1b2-8a9a-4e1f-b98b-477761635e3e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:50.386648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ce21c1b2-8a9a-4e1f-b98b-477761635e3e tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1512 microversion: 2.1 time: 0.240395 Jul 28 19:59:50.388925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 93/180] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:50 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:50.458574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-ca535f6c-2c1e-42f2-b1b2-d587bb24d298 req-2ba4400e-e6b4-4e2e-addc-d94c8d000612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa26aee5-f3e7-4c58-85d6-b8c664a022b3", "name": "network-vif-deleted", "tag": "e71d1474-59b2-44cb-84e0-1f7071339719"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:59:50.492905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-ca535f6c-2c1e-42f2-b1b2-d587bb24d298 req-2ba4400e-e6b4-4e2e-addc-d94c8d000612 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:50.494510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-ca535f6c-2c1e-42f2-b1b2-d587bb24d298 req-2ba4400e-e6b4-4e2e-addc-d94c8d000612 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:50.509226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-ca535f6c-2c1e-42f2-b1b2-d587bb24d298 req-2ba4400e-e6b4-4e2e-addc-d94c8d000612 service nova] Creating event network-vif-deleted:e71d1474-59b2-44cb-84e0-1f7071339719 for instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 on hv-cinder-85144 Jul 28 19:59:50.527654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-ca535f6c-2c1e-42f2-b1b2-d587bb24d298 req-2ba4400e-e6b4-4e2e-addc-d94c8d000612 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074973 Jul 28 19:59:50.528748 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 88/181] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 19:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 19:59:50.563158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a72107f5-b060-483d-849b-d6433751097e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:50.564013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a72107f5-b060-483d-849b-d6433751097e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:50.575035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a72107f5-b060-483d-849b-d6433751097e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:50.576128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a72107f5-b060-483d-849b-d6433751097e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:50.578072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a72107f5-b060-483d-849b-d6433751097e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:50.578705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a72107f5-b060-483d-849b-d6433751097e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:50.826767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a72107f5-b060-483d-849b-d6433751097e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:50.835653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a72107f5-b060-483d-849b-d6433751097e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.277628 Jul 28 19:59:50.837936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 94/182] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:50 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:51.408816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:51.409763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:51.419341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:51.419975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:51.420966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:51.421546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:51.480165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:51.481270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:51.482426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lazy-loading 'fault' on Instance uuid fa26aee5-f3e7-4c58-85d6-b8c664a022b3 {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 19:59:51.593805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ada142ef49a48afa2b07267c75901a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0110b3b94c904e6587c182873daed000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:51.627096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bb5e7e6a-7be0-4b5f-ae02-2007d5e904a4 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 200 len: 1350 microversion: 2.1 time: 0.221797 Jul 28 19:59:51.640606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 89/183] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:51 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 1350 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:51.873800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-085f5e81-26ef-4509-bd84-5a7b2aa2a8cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:51.874430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-085f5e81-26ef-4509-bd84-5a7b2aa2a8cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:51.887278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-085f5e81-26ef-4509-bd84-5a7b2aa2a8cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:51.889269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-085f5e81-26ef-4509-bd84-5a7b2aa2a8cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:51.891134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-085f5e81-26ef-4509-bd84-5a7b2aa2a8cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:51.894229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-085f5e81-26ef-4509-bd84-5a7b2aa2a8cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:52.271802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-085f5e81-26ef-4509-bd84-5a7b2aa2a8cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:52.281951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-085f5e81-26ef-4509-bd84-5a7b2aa2a8cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.423780 Jul 28 19:59:52.283073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 95/184] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:51 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:52.658184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:52.659573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:52.667969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:52.671367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:52.673152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:52.674266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:52.706718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] HTTP exception thrown: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Request method failure captured: Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 HTTP/1.1 Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uplW0vFRAy-4_JFapUbF_czU6gMG5694uO8ps6LhdUL5bV3R4sxKx3UoIXb75l9nBgqERnqlWnfdO0OXKSBbBOQQf7VrD2F2ZCNyhcPTddDCxpSUjMjZMhZFojFqBYHQGWcBjbI9LeTSUxjqFeWs8Jt5PHBlO_mWlKsK7PHP4_OoSo Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 0110b3b94c904e6587c182873daed000 Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 19:59:52.730383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0110b3b94c904e6587c182873daed000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0110b3b94c904e6587c182873daed000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0110b3b94c904e6587c182873daed000"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0110b3b94c904e6587c182873daed000"}]}] Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 0110b3b94c904e6587c182873daed000 Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-DeleteServersTestJSON-1904989970-project Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 3ada142ef49a48afa2b07267c75901a4 Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-DeleteServersTestJSON-1904989970-project Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.731664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'fa26aee5-f3e7-4c58-85d6-b8c664a022b3'} Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:59:52.732327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.733468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.734542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Returning 404 to user: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:59:52.734542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2fd460e4-c365-4d97-a65d-1fb78e9ef4a9 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 404 len: 111 microversion: 2.1 time: 0.078388 Jul 28 19:59:52.734542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 90/185] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:52 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 19:59:52.895515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:52.898569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:52.908805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:52.909800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:52.911032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:52.912177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:52.937625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] HTTP exception thrown: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Request method failure captured: Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3/os-volume_attachments HTTP/1.1 Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uplW0vFRAy-4_JFapUbF_czU6gMG5694uO8ps6LhdUL5bV3R4sxKx3UoIXb75l9nBgqERnqlWnfdO0OXKSBbBOQQf7VrD2F2ZCNyhcPTddDCxpSUjMjZMhZFojFqBYHQGWcBjbI9LeTSUxjqFeWs8Jt5PHBlO_mWlKsK7PHP4_OoSo Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 0110b3b94c904e6587c182873daed000 Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 19:59:52.952867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0110b3b94c904e6587c182873daed000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0110b3b94c904e6587c182873daed000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0110b3b94c904e6587c182873daed000"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0110b3b94c904e6587c182873daed000"}]}] Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 0110b3b94c904e6587c182873daed000 Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-DeleteServersTestJSON-1904989970-project Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 3ada142ef49a48afa2b07267c75901a4 Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-DeleteServersTestJSON-1904989970-project Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.954073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': 'fa26aee5-f3e7-4c58-85d6-b8c664a022b3'} Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:59:52.954751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:52.955873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:52.958596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Returning 404 to user: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:59:52.958596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bcfed265-e263-4622-85d0-a7a8e12b9d78 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063606 Jul 28 19:59:52.963164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 96/186] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 19:59:52 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 19:59:53.304230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3911d25b-a72c-4c9e-b947-6a0145eb2838 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:53.304884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3911d25b-a72c-4c9e-b947-6a0145eb2838 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:53.312817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3911d25b-a72c-4c9e-b947-6a0145eb2838 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:53.313270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3911d25b-a72c-4c9e-b947-6a0145eb2838 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:53.314069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3911d25b-a72c-4c9e-b947-6a0145eb2838 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:53.314503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3911d25b-a72c-4c9e-b947-6a0145eb2838 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:53.532439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3911d25b-a72c-4c9e-b947-6a0145eb2838 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:53.541428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3911d25b-a72c-4c9e-b947-6a0145eb2838 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.241444 Jul 28 19:59:53.553480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 91/187] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:53 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:54.322746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:54.323275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:54.337497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:54.337952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:54.338730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:54.339324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:54.372062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] HTTP exception thrown: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Request method failure captured: Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 HTTP/1.1 Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uplW0vFRAy-4_JFapUbF_czU6gMG5694uO8ps6LhdUL5bV3R4sxKx3UoIXb75l9nBgqERnqlWnfdO0OXKSBbBOQQf7VrD2F2ZCNyhcPTddDCxpSUjMjZMhZFojFqBYHQGWcBjbI9LeTSUxjqFeWs8Jt5PHBlO_mWlKsK7PHP4_OoSo Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 0110b3b94c904e6587c182873daed000 Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 19:59:54.376528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0110b3b94c904e6587c182873daed000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0110b3b94c904e6587c182873daed000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0110b3b94c904e6587c182873daed000"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0110b3b94c904e6587c182873daed000"}]}] Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 0110b3b94c904e6587c182873daed000 Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-DeleteServersTestJSON-1904989970-project Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 3ada142ef49a48afa2b07267c75901a4 Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-DeleteServersTestJSON-1904989970-project Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.377706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'fa26aee5-f3e7-4c58-85d6-b8c664a022b3'} Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:59:54.378329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.379494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.383948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Returning 404 to user: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:59:54.387698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5c18bd61-3318-4189-8310-fb6908eb75b5 tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 404 len: 111 microversion: 2.1 time: 0.069268 Jul 28 19:59:54.388421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 97/188] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 19:59:54 2022] DELETE /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 19:59:54.398608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:54.399862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] [instance: fa26aee5-f3e7-4c58-85d6-b8c664a022b3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:54.412878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:54.413334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:54.414132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:54.415900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:54.436674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] HTTP exception thrown: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Request method failure captured: Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 HTTP/1.1 Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uplW0vFRAy-4_JFapUbF_czU6gMG5694uO8ps6LhdUL5bV3R4sxKx3UoIXb75l9nBgqERnqlWnfdO0OXKSBbBOQQf7VrD2F2ZCNyhcPTddDCxpSUjMjZMhZFojFqBYHQGWcBjbI9LeTSUxjqFeWs8Jt5PHBlO_mWlKsK7PHP4_OoSo Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 0110b3b94c904e6587c182873daed000 Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 19:59:54.439091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0110b3b94c904e6587c182873daed000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0110b3b94c904e6587c182873daed000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0110b3b94c904e6587c182873daed000"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0110b3b94c904e6587c182873daed000"}]}] Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 0110b3b94c904e6587c182873daed000 Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904989970 Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-DeleteServersTestJSON-1904989970-project Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 3ada142ef49a48afa2b07267c75901a4 Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-DeleteServersTestJSON-1904989970-project Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.440652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'fa26aee5-f3e7-4c58-85d6-b8c664a022b3'} Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 19:59:54.441466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. Jul 28 19:59:54.442770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 19:59:54.443947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] Returning 404 to user: Instance fa26aee5-f3e7-4c58-85d6-b8c664a022b3 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 19:59:54.445084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-552a8c14-488e-452f-8190-99e9528c453b tempest-DeleteServersTestJSON-1904989970 tempest-DeleteServersTestJSON-1904989970-project] 10.222.0.67 "GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3" status: 404 len: 111 microversion: 2.1 time: 0.051806 Jul 28 19:59:54.449222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 92/189] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:54 2022] GET /compute/v2.1/servers/fa26aee5-f3e7-4c58-85d6-b8c664a022b3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 19:59:54.567707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-890c432b-1307-40b5-946e-efba6f487c71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:54.569564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-890c432b-1307-40b5-946e-efba6f487c71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:54.583890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-890c432b-1307-40b5-946e-efba6f487c71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:54.585910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-890c432b-1307-40b5-946e-efba6f487c71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:54.590342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-890c432b-1307-40b5-946e-efba6f487c71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:54.591677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-890c432b-1307-40b5-946e-efba6f487c71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:54.878722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-890c432b-1307-40b5-946e-efba6f487c71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:54.889779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-890c432b-1307-40b5-946e-efba6f487c71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.327197 Jul 28 19:59:54.901007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 98/190] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:54 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:55.919791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9a619158-9f5b-427d-9b93-ee766500ae00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:55.921662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9a619158-9f5b-427d-9b93-ee766500ae00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:55.939743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a619158-9f5b-427d-9b93-ee766500ae00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:55.949372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a619158-9f5b-427d-9b93-ee766500ae00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:55.955105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a619158-9f5b-427d-9b93-ee766500ae00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:55.959963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a619158-9f5b-427d-9b93-ee766500ae00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:56.097231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-760425737", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452"}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 19:59:56.156446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=43 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:56.247036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] validate_networks() for None {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 19:59:56.847983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9a619158-9f5b-427d-9b93-ee766500ae00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:56.874734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9a619158-9f5b-427d-9b93-ee766500ae00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.965667 Jul 28 19:59:56.891077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 93/191] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:55 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:57.269303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 19:59:57.269802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 19:59:57.270385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 19:59:57.272220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 19:59:57.272830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 19:59:57.288589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:57.289041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:57.292495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:57.292969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:57.315474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:57.342204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Getting quotas for project 38eaadda07744c0a82352f164f354662. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 19:59:57.351171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Getting quotas for user f51975ec85694d9fa69620946cad39b7 and project 38eaadda07744c0a82352f164f354662. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 19:59:57.373613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 19:59:57.375837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 19:59:57.485505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3d1e6ed6-b801-497c-83f5-7fae37a6ef60 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389837 Jul 28 19:59:57.487055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 99/192] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 19:59:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 19:59:57.499240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ba837735-58e5-45cd-8552-ed83c2688f31 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:57.501416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ba837735-58e5-45cd-8552-ed83c2688f31 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:57.525033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 19:59:57.785328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ba837735-58e5-45cd-8552-ed83c2688f31 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:57.798085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ba837735-58e5-45cd-8552-ed83c2688f31 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1214 microversion: 2.1 time: 0.299646 Jul 28 19:59:57.799276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 94/193] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:57 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1214 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:57.902210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-91362204-8925-401c-a3f6-5df7126fc4f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:57.903631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-91362204-8925-401c-a3f6-5df7126fc4f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:57.929079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91362204-8925-401c-a3f6-5df7126fc4f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:57.930021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91362204-8925-401c-a3f6-5df7126fc4f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:57.931072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91362204-8925-401c-a3f6-5df7126fc4f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:57.936620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91362204-8925-401c-a3f6-5df7126fc4f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:58.211389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-91362204-8925-401c-a3f6-5df7126fc4f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:58.219278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-91362204-8925-401c-a3f6-5df7126fc4f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.322952 Jul 28 19:59:58.236712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 100/194] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:57 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:58.825565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fdda32ad-9b7e-483d-b957-fbfb5ee582f9 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:58.827621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fdda32ad-9b7e-483d-b957-fbfb5ee582f9 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:58.836133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fdda32ad-9b7e-483d-b957-fbfb5ee582f9 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:58.837348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fdda32ad-9b7e-483d-b957-fbfb5ee582f9 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:58.838643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fdda32ad-9b7e-483d-b957-fbfb5ee582f9 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:58.843107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fdda32ad-9b7e-483d-b957-fbfb5ee582f9 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:58.982436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fdda32ad-9b7e-483d-b957-fbfb5ee582f9 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:59.000577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fdda32ad-9b7e-483d-b957-fbfb5ee582f9 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1218 microversion: 2.1 time: 0.178779 Jul 28 19:59:59.002065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 95/195] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:58 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 19:59:59.243644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-11b94cb8-37d3-4fa9-add2-648443ed4e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 19:59:59.244222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-11b94cb8-37d3-4fa9-add2-648443ed4e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 19:59:59.252476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-11b94cb8-37d3-4fa9-add2-648443ed4e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:59.252957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-11b94cb8-37d3-4fa9-add2-648443ed4e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:59.253732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-11b94cb8-37d3-4fa9-add2-648443ed4e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 19:59:59.254164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-11b94cb8-37d3-4fa9-add2-648443ed4e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 19:59:59.633619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-11b94cb8-37d3-4fa9-add2-648443ed4e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 19:59:59.654921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-11b94cb8-37d3-4fa9-add2-648443ed4e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.415139 Jul 28 19:59:59.655488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 101/196] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 19:59:59 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:00.035272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c55ee61d-a55f-419b-946a-08ef2ccc97b5 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:00.037267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c55ee61d-a55f-419b-946a-08ef2ccc97b5 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:00.044613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c55ee61d-a55f-419b-946a-08ef2ccc97b5 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:00.045371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c55ee61d-a55f-419b-946a-08ef2ccc97b5 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:00.046363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c55ee61d-a55f-419b-946a-08ef2ccc97b5 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:00.047180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c55ee61d-a55f-419b-946a-08ef2ccc97b5 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:00.260291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c55ee61d-a55f-419b-946a-08ef2ccc97b5 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:00.270419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c55ee61d-a55f-419b-946a-08ef2ccc97b5 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1274 microversion: 2.1 time: 0.245042 Jul 28 20:00:00.287010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 96/197] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:00 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:00.684754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ebf9897b-c659-47d2-8718-213c92debed5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:00.686227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ebf9897b-c659-47d2-8718-213c92debed5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:00.705198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ebf9897b-c659-47d2-8718-213c92debed5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:00.706139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ebf9897b-c659-47d2-8718-213c92debed5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:00.707184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ebf9897b-c659-47d2-8718-213c92debed5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:00.710106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ebf9897b-c659-47d2-8718-213c92debed5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:01.294467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-67f34b96-38ac-4958-8e4e-511d34091400 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:01.301296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-67f34b96-38ac-4958-8e4e-511d34091400 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:01.321555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67f34b96-38ac-4958-8e4e-511d34091400 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:01.322855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67f34b96-38ac-4958-8e4e-511d34091400 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:01.323924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67f34b96-38ac-4958-8e4e-511d34091400 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:01.325367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67f34b96-38ac-4958-8e4e-511d34091400 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:01.614262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ebf9897b-c659-47d2-8718-213c92debed5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:01.631042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ebf9897b-c659-47d2-8718-213c92debed5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.950014 Jul 28 20:00:01.644417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 102/198] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:00 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:01.860336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-67f34b96-38ac-4958-8e4e-511d34091400 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:01.875019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-67f34b96-38ac-4958-8e4e-511d34091400 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1314 microversion: 2.1 time: 0.586543 Jul 28 20:00:01.875623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 97/199] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:01 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:02.652480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5900e783-131f-4d32-baf3-3d64c11d1255 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:02.653219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5900e783-131f-4d32-baf3-3d64c11d1255 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:02.662592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5900e783-131f-4d32-baf3-3d64c11d1255 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:02.663036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5900e783-131f-4d32-baf3-3d64c11d1255 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:02.666682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5900e783-131f-4d32-baf3-3d64c11d1255 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:02.669048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5900e783-131f-4d32-baf3-3d64c11d1255 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:02.705038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-162511cf-6a18-45cc-8af9-6edf1811cf8f req-08d0eecf-3629-4d80-aef6-d6a860032419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8478d16f-7aa0-4e82-9c17-1762010a1ab3", "tag": "1178e68d-74ed-4107-8c8d-70dc7c9ffe5d"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:02.758679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-162511cf-6a18-45cc-8af9-6edf1811cf8f req-08d0eecf-3629-4d80-aef6-d6a860032419 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:02.759425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-162511cf-6a18-45cc-8af9-6edf1811cf8f req-08d0eecf-3629-4d80-aef6-d6a860032419 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:02.793799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-162511cf-6a18-45cc-8af9-6edf1811cf8f req-08d0eecf-3629-4d80-aef6-d6a860032419 service nova] Creating event network-changed:1178e68d-74ed-4107-8c8d-70dc7c9ffe5d for instance 8478d16f-7aa0-4e82-9c17-1762010a1ab3 on hv-cinder-85144 Jul 28 20:00:02.800165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-162511cf-6a18-45cc-8af9-6edf1811cf8f req-08d0eecf-3629-4d80-aef6-d6a860032419 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100248 Jul 28 20:00:02.801057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 98/200] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:00:02.902705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a09d0785-9fa4-4760-8c99-704c199fa785 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:02.903590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a09d0785-9fa4-4760-8c99-704c199fa785 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:02.924858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a09d0785-9fa4-4760-8c99-704c199fa785 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:02.928099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a09d0785-9fa4-4760-8c99-704c199fa785 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:02.932358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a09d0785-9fa4-4760-8c99-704c199fa785 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:02.932842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a09d0785-9fa4-4760-8c99-704c199fa785 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:02.947306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5900e783-131f-4d32-baf3-3d64c11d1255 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:02.964275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5900e783-131f-4d32-baf3-3d64c11d1255 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.316360 Jul 28 20:00:02.967905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 103/201] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:02 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:03.218027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a09d0785-9fa4-4760-8c99-704c199fa785 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:03.238175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a09d0785-9fa4-4760-8c99-704c199fa785 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1314 microversion: 2.1 time: 0.341915 Jul 28 20:00:03.240992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 99/202] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:02 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:03.544169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e3e40dfa-f392-4624-958b-aacf428becad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Action: 'create', calling method: .version_select at 0x7f50362343a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-274658827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKZvWy9teXAse3FecnVG1dqMVjIdPnRpQB6RkC3Fk/ZPshCryVZUnUudoQEhEuwKYbfgzLmxuYH6xDeLKV4CeGr+mePYO6Y7A38z5vBd6vL3o+oHxb8ZFacvcqW+deMNw=="}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:03.570310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-e3e40dfa-f392-4624-958b-aacf428becad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Getting quotas for project 1a73bb1237bb4bcfa86aa6dc5bf413c7. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:00:03.575465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-e3e40dfa-f392-4624-958b-aacf428becad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Getting quotas for user 3f7d1d13bfb843df855bc4d57374a8ab and project 1a73bb1237bb4bcfa86aa6dc5bf413c7. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:00:03.610805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e3e40dfa-f392-4624-958b-aacf428becad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.073968 Jul 28 20:00:03.612851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 104/203] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:00:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:03.785343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-377003342", "imageRef": "9aee84dd-a432-4935-b987-19ff6529d73a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-274658827", "networks": [{"uuid": "01c0945f-6926-4382-a626-0790356e5991"}]}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:03.906033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.network.neutron [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] validate_networks() for [('01c0945f-6926-4382-a626-0790356e5991', None, None, None, None, None)] {{(pid=117968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:00:03.993442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7ab43f9d-557a-44bb-bd18-3426e66eda45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:03.994900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7ab43f9d-557a-44bb-bd18-3426e66eda45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:04.006575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ab43f9d-557a-44bb-bd18-3426e66eda45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:04.007631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ab43f9d-557a-44bb-bd18-3426e66eda45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:04.008596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ab43f9d-557a-44bb-bd18-3426e66eda45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:04.009175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ab43f9d-557a-44bb-bd18-3426e66eda45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:04.244072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7ab43f9d-557a-44bb-bd18-3426e66eda45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:04.256645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7ab43f9d-557a-44bb-bd18-3426e66eda45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.269776 Jul 28 20:00:04.256991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 105/204] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:03 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:04.264413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7706d3a4-ab59-4540-bdb7-37851c43b824 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:04.265601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7706d3a4-ab59-4540-bdb7-37851c43b824 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:04.278746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7706d3a4-ab59-4540-bdb7-37851c43b824 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:04.279784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7706d3a4-ab59-4540-bdb7-37851c43b824 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:04.280804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7706d3a4-ab59-4540-bdb7-37851c43b824 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:04.281375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7706d3a4-ab59-4540-bdb7-37851c43b824 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:04.639660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7706d3a4-ab59-4540-bdb7-37851c43b824 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:04.648731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7706d3a4-ab59-4540-bdb7-37851c43b824 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1314 microversion: 2.1 time: 0.390423 Jul 28 20:00:04.649697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 106/205] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:04 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:04.676822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Flavor limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:00:04.677252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Image limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:00:04.677865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Flavor pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:00:04.678274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Image pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:00:04.678689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:00:04.687597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:04.688045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:04.688879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:04.689324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:04.720254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Getting quotas for project 1a73bb1237bb4bcfa86aa6dc5bf413c7. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:00:04.725040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Getting quotas for user 3f7d1d13bfb843df855bc4d57374a8ab and project 1a73bb1237bb4bcfa86aa6dc5bf413c7. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:00:04.758436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Going to run 1 instances... {{(pid=117968) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:00:04.760688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aee84dd-a432-4935-b987-19ff6529d73a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:00:04.856332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a41982c1-08c4-4206-94e6-c32eec188b03 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.068161 Jul 28 20:00:04.857497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 100/206] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:00:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:00:04.869179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-de8ded51-6a97-4060-8972-00b93663ac87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:04.870228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-de8ded51-6a97-4060-8972-00b93663ac87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:04.987980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-de8ded51-6a97-4060-8972-00b93663ac87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:05.003301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-de8ded51-6a97-4060-8972-00b93663ac87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1257 microversion: 2.1 time: 0.138226 Jul 28 20:00:05.009295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 107/207] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1257 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:05.292518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f43bc24a-06dc-4a09-99ff-e74060215609 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:05.293491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f43bc24a-06dc-4a09-99ff-e74060215609 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:05.306342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43bc24a-06dc-4a09-99ff-e74060215609 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:05.306791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43bc24a-06dc-4a09-99ff-e74060215609 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:05.307807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43bc24a-06dc-4a09-99ff-e74060215609 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:05.308397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43bc24a-06dc-4a09-99ff-e74060215609 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:05.505458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f43bc24a-06dc-4a09-99ff-e74060215609 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:05.518862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f43bc24a-06dc-4a09-99ff-e74060215609 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.239155 Jul 28 20:00:05.519760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 101/208] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:05 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:05.669746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9b4a5f39-c784-4fe2-b2d1-ea7f500db902 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:05.670599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9b4a5f39-c784-4fe2-b2d1-ea7f500db902 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:05.683231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9b4a5f39-c784-4fe2-b2d1-ea7f500db902 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:05.683688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9b4a5f39-c784-4fe2-b2d1-ea7f500db902 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:05.698248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9b4a5f39-c784-4fe2-b2d1-ea7f500db902 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:05.701703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9b4a5f39-c784-4fe2-b2d1-ea7f500db902 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:05.997583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9b4a5f39-c784-4fe2-b2d1-ea7f500db902 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:06.010172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9b4a5f39-c784-4fe2-b2d1-ea7f500db902 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1314 microversion: 2.1 time: 0.343772 Jul 28 20:00:06.026471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 108/209] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:05 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:06.031592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e58463b-7b12-4c2e-ad83-16df1bc80872 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:06.032241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9e58463b-7b12-4c2e-ad83-16df1bc80872 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:06.040583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e58463b-7b12-4c2e-ad83-16df1bc80872 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:06.041036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e58463b-7b12-4c2e-ad83-16df1bc80872 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:06.042053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e58463b-7b12-4c2e-ad83-16df1bc80872 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:06.042496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e58463b-7b12-4c2e-ad83-16df1bc80872 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:06.135705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9e58463b-7b12-4c2e-ad83-16df1bc80872 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:06.144640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e58463b-7b12-4c2e-ad83-16df1bc80872 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1309 microversion: 2.1 time: 0.119571 Jul 28 20:00:06.145229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 102/210] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:06.545230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c123c181-5580-4f3e-baff-477e1f289d86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:06.545991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c123c181-5580-4f3e-baff-477e1f289d86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:06.565211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c123c181-5580-4f3e-baff-477e1f289d86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:06.569962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c123c181-5580-4f3e-baff-477e1f289d86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:06.586744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c123c181-5580-4f3e-baff-477e1f289d86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:06.609179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c123c181-5580-4f3e-baff-477e1f289d86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:06.891947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c123c181-5580-4f3e-baff-477e1f289d86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:06.919022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c123c181-5580-4f3e-baff-477e1f289d86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.379042 Jul 28 20:00:06.920026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 109/211] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:06 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:07.037233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2b7b31eb-b9a0-4a3e-be71-9095a025da15 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:07.038053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2b7b31eb-b9a0-4a3e-be71-9095a025da15 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:07.050683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b7b31eb-b9a0-4a3e-be71-9095a025da15 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:07.051133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b7b31eb-b9a0-4a3e-be71-9095a025da15 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:07.052281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b7b31eb-b9a0-4a3e-be71-9095a025da15 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:07.053096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b7b31eb-b9a0-4a3e-be71-9095a025da15 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:07.166705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-23ada497-1b33-43d3-a6e3-ae6d955860a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:07.167890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-23ada497-1b33-43d3-a6e3-ae6d955860a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:07.174902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23ada497-1b33-43d3-a6e3-ae6d955860a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:07.175516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23ada497-1b33-43d3-a6e3-ae6d955860a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:07.176451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23ada497-1b33-43d3-a6e3-ae6d955860a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:07.177763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23ada497-1b33-43d3-a6e3-ae6d955860a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:07.287958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-23ada497-1b33-43d3-a6e3-ae6d955860a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:07.302134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-23ada497-1b33-43d3-a6e3-ae6d955860a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1315 microversion: 2.1 time: 0.138835 Jul 28 20:00:07.316897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 110/212] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:07.367082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2b7b31eb-b9a0-4a3e-be71-9095a025da15 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:07.375270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2b7b31eb-b9a0-4a3e-be71-9095a025da15 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1314 microversion: 2.1 time: 0.342639 Jul 28 20:00:07.375940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 103/213] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:07 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:07.952111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6f0ab007-302e-4dc7-a192-82ac5d4cf6b1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:07.953156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6f0ab007-302e-4dc7-a192-82ac5d4cf6b1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:07.962553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:07.965805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f0ab007-302e-4dc7-a192-82ac5d4cf6b1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:07.966750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f0ab007-302e-4dc7-a192-82ac5d4cf6b1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:07.968689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f0ab007-302e-4dc7-a192-82ac5d4cf6b1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:07.969357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f0ab007-302e-4dc7-a192-82ac5d4cf6b1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:08.199275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6f0ab007-302e-4dc7-a192-82ac5d4cf6b1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:08.202283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6f0ab007-302e-4dc7-a192-82ac5d4cf6b1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.262631 Jul 28 20:00:08.218406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 111/214] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:07 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:08.324907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0b706c3e-167e-482b-a07f-eeaa9baef23d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:08.326190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0b706c3e-167e-482b-a07f-eeaa9baef23d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:08.338598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b706c3e-167e-482b-a07f-eeaa9baef23d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:08.339322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b706c3e-167e-482b-a07f-eeaa9baef23d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:08.340262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b706c3e-167e-482b-a07f-eeaa9baef23d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:08.343529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b706c3e-167e-482b-a07f-eeaa9baef23d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:08.409979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3fed1414-2ca4-48ad-802d-7e2a157e00b2 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:08.411621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3fed1414-2ca4-48ad-802d-7e2a157e00b2 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:08.428163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fed1414-2ca4-48ad-802d-7e2a157e00b2 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:08.431858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fed1414-2ca4-48ad-802d-7e2a157e00b2 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:08.433047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fed1414-2ca4-48ad-802d-7e2a157e00b2 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:08.433625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fed1414-2ca4-48ad-802d-7e2a157e00b2 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:08.707176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3fed1414-2ca4-48ad-802d-7e2a157e00b2 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:08.721304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3fed1414-2ca4-48ad-802d-7e2a157e00b2 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1314 microversion: 2.1 time: 0.320371 Jul 28 20:00:08.727904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 112/215] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:08 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:08.809499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0b706c3e-167e-482b-a07f-eeaa9baef23d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:08.825371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0b706c3e-167e-482b-a07f-eeaa9baef23d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.504694 Jul 28 20:00:08.827086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 104/216] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:08.876379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-70de14c9-a6f4-4d84-a0f2-0977ddaa1ed5 req-8831e95c-9c26-4274-a938-f4738f487688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8478d16f-7aa0-4e82-9c17-1762010a1ab3", "name": "network-vif-plugged", "status": "completed", "tag": "1178e68d-74ed-4107-8c8d-70dc7c9ffe5d"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:08.902460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-70de14c9-a6f4-4d84-a0f2-0977ddaa1ed5 req-8831e95c-9c26-4274-a938-f4738f487688 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:08.903198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-70de14c9-a6f4-4d84-a0f2-0977ddaa1ed5 req-8831e95c-9c26-4274-a938-f4738f487688 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:08.923887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-70de14c9-a6f4-4d84-a0f2-0977ddaa1ed5 req-8831e95c-9c26-4274-a938-f4738f487688 service nova] Creating event network-vif-plugged:1178e68d-74ed-4107-8c8d-70dc7c9ffe5d for instance 8478d16f-7aa0-4e82-9c17-1762010a1ab3 on hv-cinder-85144 Jul 28 20:00:08.939223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-70de14c9-a6f4-4d84-a0f2-0977ddaa1ed5 req-8831e95c-9c26-4274-a938-f4738f487688 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068699 Jul 28 20:00:08.940652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 113/217] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:09.227067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4802e8d8-6ab8-4eec-92c0-0264ebbaf73a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:09.227675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4802e8d8-6ab8-4eec-92c0-0264ebbaf73a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:09.234174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4802e8d8-6ab8-4eec-92c0-0264ebbaf73a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:09.234932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4802e8d8-6ab8-4eec-92c0-0264ebbaf73a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:09.236306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4802e8d8-6ab8-4eec-92c0-0264ebbaf73a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:09.236979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4802e8d8-6ab8-4eec-92c0-0264ebbaf73a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:09.243971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:09.498138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4802e8d8-6ab8-4eec-92c0-0264ebbaf73a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:09.534023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4802e8d8-6ab8-4eec-92c0-0264ebbaf73a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.310858 Jul 28 20:00:09.534840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 105/218] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:09 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:09.744090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-95f5d82e-2d1b-4a17-a1d4-5d013ccae6c7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:09.745347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-95f5d82e-2d1b-4a17-a1d4-5d013ccae6c7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:09.760002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95f5d82e-2d1b-4a17-a1d4-5d013ccae6c7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:09.761491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95f5d82e-2d1b-4a17-a1d4-5d013ccae6c7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:09.763774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95f5d82e-2d1b-4a17-a1d4-5d013ccae6c7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:09.768005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95f5d82e-2d1b-4a17-a1d4-5d013ccae6c7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:09.849863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9670c841-5424-4792-b6a4-e84755255066 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:09.850746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9670c841-5424-4792-b6a4-e84755255066 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:09.860867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9670c841-5424-4792-b6a4-e84755255066 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:09.871190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9670c841-5424-4792-b6a4-e84755255066 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:09.872389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9670c841-5424-4792-b6a4-e84755255066 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:09.873007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9670c841-5424-4792-b6a4-e84755255066 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:10.090086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-95f5d82e-2d1b-4a17-a1d4-5d013ccae6c7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:10.118327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-95f5d82e-2d1b-4a17-a1d4-5d013ccae6c7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1314 microversion: 2.1 time: 0.377711 Jul 28 20:00:10.146297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 114/219] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:09 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:10.155737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-eb18ba8d-ed9b-45c1-b2ec-9c8a515f4612 req-3e0f4bbb-ef9b-48d4-bc05-42b2e573e381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed7c90e0-e87c-42b9-b14d-6c06761c1eef", "tag": "65dd95c0-2195-45fd-8275-f4c90145660b"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:10.171717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9670c841-5424-4792-b6a4-e84755255066 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:10.181324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-eb18ba8d-ed9b-45c1-b2ec-9c8a515f4612 req-3e0f4bbb-ef9b-48d4-bc05-42b2e573e381 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:10.181324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-eb18ba8d-ed9b-45c1-b2ec-9c8a515f4612 req-3e0f4bbb-ef9b-48d4-bc05-42b2e573e381 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:10.186138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9670c841-5424-4792-b6a4-e84755255066 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.341065 Jul 28 20:00:10.200813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 106/220] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:09 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:10.214447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-eb18ba8d-ed9b-45c1-b2ec-9c8a515f4612 req-3e0f4bbb-ef9b-48d4-bc05-42b2e573e381 service nova] Creating event network-changed:65dd95c0-2195-45fd-8275-f4c90145660b for instance ed7c90e0-e87c-42b9-b14d-6c06761c1eef on hv-cinder-85144 Jul 28 20:00:10.224302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-eb18ba8d-ed9b-45c1-b2ec-9c8a515f4612 req-3e0f4bbb-ef9b-48d4-bc05-42b2e573e381 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072547 Jul 28 20:00:10.225476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 115/221] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:10.560779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9dfd52f9-530e-4da6-bc2d-3201b534f590 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:10.562391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9dfd52f9-530e-4da6-bc2d-3201b534f590 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:10.574878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9dfd52f9-530e-4da6-bc2d-3201b534f590 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:10.575334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9dfd52f9-530e-4da6-bc2d-3201b534f590 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:10.576115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9dfd52f9-530e-4da6-bc2d-3201b534f590 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:10.576576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9dfd52f9-530e-4da6-bc2d-3201b534f590 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:10.819040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9dfd52f9-530e-4da6-bc2d-3201b534f590 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:10.837220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9dfd52f9-530e-4da6-bc2d-3201b534f590 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.282561 Jul 28 20:00:10.852966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 107/222] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:10 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:11.151111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4ad189d9-90d1-424a-8a5a-9f80477e479a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:11.152504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4ad189d9-90d1-424a-8a5a-9f80477e479a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:11.159167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ad189d9-90d1-424a-8a5a-9f80477e479a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:11.159563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ad189d9-90d1-424a-8a5a-9f80477e479a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:11.160475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ad189d9-90d1-424a-8a5a-9f80477e479a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:11.162097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ad189d9-90d1-424a-8a5a-9f80477e479a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:11.210089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3a2ea527-c82b-44c9-8609-60897b2a06a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:11.212143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3a2ea527-c82b-44c9-8609-60897b2a06a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:11.222535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a2ea527-c82b-44c9-8609-60897b2a06a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:11.223944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a2ea527-c82b-44c9-8609-60897b2a06a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:11.240211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a2ea527-c82b-44c9-8609-60897b2a06a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:11.241314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a2ea527-c82b-44c9-8609-60897b2a06a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:11.547037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4ad189d9-90d1-424a-8a5a-9f80477e479a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:11.555631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4ad189d9-90d1-424a-8a5a-9f80477e479a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1314 microversion: 2.1 time: 0.413986 Jul 28 20:00:11.556525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 116/223] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:11 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:11.572259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3a2ea527-c82b-44c9-8609-60897b2a06a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:11.583944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3a2ea527-c82b-44c9-8609-60897b2a06a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.379834 Jul 28 20:00:11.600961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 108/224] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:11.858419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b7f94cc9-05c6-4d6a-8c01-4012432297c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:11.859462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b7f94cc9-05c6-4d6a-8c01-4012432297c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:11.871446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7f94cc9-05c6-4d6a-8c01-4012432297c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:11.872255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7f94cc9-05c6-4d6a-8c01-4012432297c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:11.873374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7f94cc9-05c6-4d6a-8c01-4012432297c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:11.874541 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7f94cc9-05c6-4d6a-8c01-4012432297c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:12.115797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b7f94cc9-05c6-4d6a-8c01-4012432297c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:12.124080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b7f94cc9-05c6-4d6a-8c01-4012432297c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.269768 Jul 28 20:00:12.130226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 117/225] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:11 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:12.579454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e13ef896-7cb3-4549-9311-5bea415f3286 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:12.581239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e13ef896-7cb3-4549-9311-5bea415f3286 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:12.588295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e13ef896-7cb3-4549-9311-5bea415f3286 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:12.588800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e13ef896-7cb3-4549-9311-5bea415f3286 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:12.589612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e13ef896-7cb3-4549-9311-5bea415f3286 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:12.590049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e13ef896-7cb3-4549-9311-5bea415f3286 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:12.617046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-db3201b0-a61d-4767-b649-123ae41305ec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:12.617651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-db3201b0-a61d-4767-b649-123ae41305ec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:12.626694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db3201b0-a61d-4767-b649-123ae41305ec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:12.627359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db3201b0-a61d-4767-b649-123ae41305ec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:12.628378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db3201b0-a61d-4767-b649-123ae41305ec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:12.628969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db3201b0-a61d-4767-b649-123ae41305ec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:12.875157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-db3201b0-a61d-4767-b649-123ae41305ec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:12.884469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-db3201b0-a61d-4767-b649-123ae41305ec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.273016 Jul 28 20:00:12.892839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e13ef896-7cb3-4549-9311-5bea415f3286 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:12.893965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 118/226] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:12.899422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e13ef896-7cb3-4549-9311-5bea415f3286 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1464 microversion: 2.1 time: 0.323990 Jul 28 20:00:12.900244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 109/227] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:12 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:12.971043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f998956c-1ad7-46bd-9486-63bc829f8026 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:12.971541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f998956c-1ad7-46bd-9486-63bc829f8026 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:12.978210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f998956c-1ad7-46bd-9486-63bc829f8026 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:12.979161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f998956c-1ad7-46bd-9486-63bc829f8026 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:12.980117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f998956c-1ad7-46bd-9486-63bc829f8026 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:12.980747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f998956c-1ad7-46bd-9486-63bc829f8026 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:13.015723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f998956c-1ad7-46bd-9486-63bc829f8026 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:00:13.120368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f998956c-1ad7-46bd-9486-63bc829f8026 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 204 len: 0 microversion: 2.1 time: 0.153656 Jul 28 20:00:13.121373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 110/228] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:00:12 2022] DELETE /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:00:13.135226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a5109103-3320-4ece-8f23-d0c2eb416072 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:13.139600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a5109103-3320-4ece-8f23-d0c2eb416072 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:13.153701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5109103-3320-4ece-8f23-d0c2eb416072 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:13.154238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5109103-3320-4ece-8f23-d0c2eb416072 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:13.155166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5109103-3320-4ece-8f23-d0c2eb416072 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:13.155697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5109103-3320-4ece-8f23-d0c2eb416072 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:13.167542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a02677c3-ce20-45b9-8140-b727e83c7d0f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: .version_select at 0x7f50361db4c0>, body: {"keypair": {"name": "tempest-keypair-1544778110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy/vTZ8JcdW+uYPndpqRhC3AqTEn+tqwKOcqJ16m+zntG3ybe1/Qx3KRVuHlKurHOUBf+8jsIzeXfagLEjBJk+pa4D3u1d+ba71WCVnszypyZIjoGPMU+5Fyob0I6Gz2Q=="}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:13.203091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-a02677c3-ce20-45b9-8140-b727e83c7d0f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for project d6612a467ab54632a74cf113b4666eb1. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:00:13.209615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-a02677c3-ce20-45b9-8140-b727e83c7d0f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for user bd0b2bfa3d014222afd4e050ca8498f9 and project d6612a467ab54632a74cf113b4666eb1. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:00:13.244135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a02677c3-ce20-45b9-8140-b727e83c7d0f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.348777 Jul 28 20:00:13.245131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 119/229] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:00:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:13.251177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6cbb9865-d5dd-492d-926a-8be4ccf41d8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:13.252040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6cbb9865-d5dd-492d-926a-8be4ccf41d8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:13.260479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cbb9865-d5dd-492d-926a-8be4ccf41d8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:13.260966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cbb9865-d5dd-492d-926a-8be4ccf41d8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:13.261948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cbb9865-d5dd-492d-926a-8be4ccf41d8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:13.262240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cbb9865-d5dd-492d-926a-8be4ccf41d8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:13.412204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a5109103-3320-4ece-8f23-d0c2eb416072 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:13.424035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a5109103-3320-4ece-8f23-d0c2eb416072 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1470 microversion: 2.1 time: 0.297991 Jul 28 20:00:13.425243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 111/230] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:13 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1470 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:13.478040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6cbb9865-d5dd-492d-926a-8be4ccf41d8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:13.482941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:13.488142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6cbb9865-d5dd-492d-926a-8be4ccf41d8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.241128 Jul 28 20:00:13.488865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 120/231] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:13 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:13.905779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4ebafafe-cc99-439c-aa01-3fe989510a51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:13.906475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4ebafafe-cc99-439c-aa01-3fe989510a51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:13.915106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ebafafe-cc99-439c-aa01-3fe989510a51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:13.915806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ebafafe-cc99-439c-aa01-3fe989510a51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:13.916785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ebafafe-cc99-439c-aa01-3fe989510a51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:13.917428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ebafafe-cc99-439c-aa01-3fe989510a51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:14.168071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4ebafafe-cc99-439c-aa01-3fe989510a51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:14.175781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4ebafafe-cc99-439c-aa01-3fe989510a51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.273971 Jul 28 20:00:14.177915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 112/232] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:13 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:14.448325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a23598b6-d728-4d8f-a94b-b6e33c2a47fe tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:14.448964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a23598b6-d728-4d8f-a94b-b6e33c2a47fe tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:14.456466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a23598b6-d728-4d8f-a94b-b6e33c2a47fe tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:14.456969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a23598b6-d728-4d8f-a94b-b6e33c2a47fe tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:14.459374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a23598b6-d728-4d8f-a94b-b6e33c2a47fe tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:14.476380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a23598b6-d728-4d8f-a94b-b6e33c2a47fe tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:14.510691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8bf6206b-af86-4fdf-a341-63ca94c1bdcc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:14.511656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8bf6206b-af86-4fdf-a341-63ca94c1bdcc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:14.524830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8bf6206b-af86-4fdf-a341-63ca94c1bdcc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:14.530723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8bf6206b-af86-4fdf-a341-63ca94c1bdcc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:14.532989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8bf6206b-af86-4fdf-a341-63ca94c1bdcc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:14.533688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8bf6206b-af86-4fdf-a341-63ca94c1bdcc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:14.699032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:14.748915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=8 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:15.300090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a23598b6-d728-4d8f-a94b-b6e33c2a47fe tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:15.303245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8bf6206b-af86-4fdf-a341-63ca94c1bdcc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:15.318419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8bf6206b-af86-4fdf-a341-63ca94c1bdcc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.812258 Jul 28 20:00:15.318632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a23598b6-d728-4d8f-a94b-b6e33c2a47fe tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1470 microversion: 2.1 time: 0.873801 Jul 28 20:00:15.318996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 113/233] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:14 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:15.325214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 121/234] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:14 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1470 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:15.337001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4bfbbb3b-345d-4115-843b-a287f349f2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:15.337612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4bfbbb3b-345d-4115-843b-a287f349f2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:15.354809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bfbbb3b-345d-4115-843b-a287f349f2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:15.356310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bfbbb3b-345d-4115-843b-a287f349f2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:15.357888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bfbbb3b-345d-4115-843b-a287f349f2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:15.358449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bfbbb3b-345d-4115-843b-a287f349f2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:15.772938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4bfbbb3b-345d-4115-843b-a287f349f2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:15.788020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4bfbbb3b-345d-4115-843b-a287f349f2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.464790 Jul 28 20:00:15.791626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 114/235] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:16.248559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1551819255", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5173547b-0aef-47cd-835f-b2a192d02fb4"}], "security_groups": [{"name": "tempest-securitygroup--1157757374"}], "key_name": "tempest-keypair-1544778110", "user_data": "}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:16.347235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f0b04ee0-7866-4bee-af10-2bdbd789c7ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:16.349413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f0b04ee0-7866-4bee-af10-2bdbd789c7ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:16.367411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0b04ee0-7866-4bee-af10-2bdbd789c7ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:16.381035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0b04ee0-7866-4bee-af10-2bdbd789c7ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:16.382181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0b04ee0-7866-4bee-af10-2bdbd789c7ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:16.382809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0b04ee0-7866-4bee-af10-2bdbd789c7ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:16.716944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f0b04ee0-7866-4bee-af10-2bdbd789c7ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:16.756102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f0b04ee0-7866-4bee-af10-2bdbd789c7ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.413731 Jul 28 20:00:16.756711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 115/236] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:16 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:16.805508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c33fca7d-d7bb-49a7-b344-d09c1469453d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:16.808074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c33fca7d-d7bb-49a7-b344-d09c1469453d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:16.833241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c33fca7d-d7bb-49a7-b344-d09c1469453d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:16.837343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c33fca7d-d7bb-49a7-b344-d09c1469453d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:16.838499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c33fca7d-d7bb-49a7-b344-d09c1469453d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:16.839091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c33fca7d-d7bb-49a7-b344-d09c1469453d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:16.974855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c33fca7d-d7bb-49a7-b344-d09c1469453d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:16.990217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c33fca7d-d7bb-49a7-b344-d09c1469453d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1428 microversion: 2.1 time: 0.208872 Jul 28 20:00:17.000939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 116/237] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:16 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1428 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:17.021222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-71708a7b-65b3-42d1-a7af-1e287b1b8157 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:17.021222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-71708a7b-65b3-42d1-a7af-1e287b1b8157 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:17.035189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71708a7b-65b3-42d1-a7af-1e287b1b8157 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:17.038477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71708a7b-65b3-42d1-a7af-1e287b1b8157 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:17.039979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71708a7b-65b3-42d1-a7af-1e287b1b8157 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:17.041002 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71708a7b-65b3-42d1-a7af-1e287b1b8157 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:17.100012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-71708a7b-65b3-42d1-a7af-1e287b1b8157 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/ips" status: 200 len: 151 microversion: 2.20 time: 0.097934 Jul 28 20:00:17.100984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 117/238] 10.222.0.67 () {60 vars in 1289 bytes} [Thu Jul 28 20:00:17 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/ips => generated 151 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:00:17.106628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8c589cc3-90a9-4b73-8d51-c8bf9c2969d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:17.108118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8c589cc3-90a9-4b73-8d51-c8bf9c2969d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:17.117556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8c589cc3-90a9-4b73-8d51-c8bf9c2969d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:17.118175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8c589cc3-90a9-4b73-8d51-c8bf9c2969d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:17.119224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8c589cc3-90a9-4b73-8d51-c8bf9c2969d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:17.119847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8c589cc3-90a9-4b73-8d51-c8bf9c2969d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:17.391271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8c589cc3-90a9-4b73-8d51-c8bf9c2969d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:17.401291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8c589cc3-90a9-4b73-8d51-c8bf9c2969d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.299005 Jul 28 20:00:17.402518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 118/239] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:17.417601 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-87609a69-00a4-4158-a487-5fcba355bd24 req-1f53ccd3-f8f6-4e56-a9b8-7b27a2a8b6db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8478d16f-7aa0-4e82-9c17-1762010a1ab3", "name": "network-vif-deleted", "tag": "1178e68d-74ed-4107-8c8d-70dc7c9ffe5d"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:17.430377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-87609a69-00a4-4158-a487-5fcba355bd24 req-1f53ccd3-f8f6-4e56-a9b8-7b27a2a8b6db service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:17.430939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-87609a69-00a4-4158-a487-5fcba355bd24 req-1f53ccd3-f8f6-4e56-a9b8-7b27a2a8b6db service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:17.450241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-87609a69-00a4-4158-a487-5fcba355bd24 req-1f53ccd3-f8f6-4e56-a9b8-7b27a2a8b6db service nova] Creating event network-vif-deleted:1178e68d-74ed-4107-8c8d-70dc7c9ffe5d for instance 8478d16f-7aa0-4e82-9c17-1762010a1ab3 on hv-cinder-85144 Jul 28 20:00:17.458485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-87609a69-00a4-4158-a487-5fcba355bd24 req-1f53ccd3-f8f6-4e56-a9b8-7b27a2a8b6db service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054444 Jul 28 20:00:17.459110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 119/240] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:17.777880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-148f1bdb-6e24-41f5-a892-121fba5a2f17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:17.778619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-148f1bdb-6e24-41f5-a892-121fba5a2f17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:17.788102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-148f1bdb-6e24-41f5-a892-121fba5a2f17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:17.788634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-148f1bdb-6e24-41f5-a892-121fba5a2f17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:17.789745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-148f1bdb-6e24-41f5-a892-121fba5a2f17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:17.790265 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-148f1bdb-6e24-41f5-a892-121fba5a2f17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:17.954497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-148f1bdb-6e24-41f5-a892-121fba5a2f17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:17.963750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-148f1bdb-6e24-41f5-a892-121fba5a2f17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.190076 Jul 28 20:00:17.964401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 120/241] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:17 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:18.027239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c86ea388-f5af-4b75-9ef9-52dc70130f91 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:18.027855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c86ea388-f5af-4b75-9ef9-52dc70130f91 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:18.034295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c86ea388-f5af-4b75-9ef9-52dc70130f91 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:18.034887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c86ea388-f5af-4b75-9ef9-52dc70130f91 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:18.036066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c86ea388-f5af-4b75-9ef9-52dc70130f91 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:18.036508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c86ea388-f5af-4b75-9ef9-52dc70130f91 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:18.041439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:18.109351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c86ea388-f5af-4b75-9ef9-52dc70130f91 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:18.118414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c86ea388-f5af-4b75-9ef9-52dc70130f91 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1428 microversion: 2.1 time: 0.094978 Jul 28 20:00:18.119183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 121/242] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:18 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1428 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:18.424436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-92366178-ce96-4e4b-9c7d-d588ce637312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:18.425142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-92366178-ce96-4e4b-9c7d-d588ce637312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:18.432291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92366178-ce96-4e4b-9c7d-d588ce637312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:18.432764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92366178-ce96-4e4b-9c7d-d588ce637312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:18.433520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92366178-ce96-4e4b-9c7d-d588ce637312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:18.433946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92366178-ce96-4e4b-9c7d-d588ce637312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:18.567765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-92366178-ce96-4e4b-9c7d-d588ce637312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:18.579010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-92366178-ce96-4e4b-9c7d-d588ce637312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.158150 Jul 28 20:00:18.579865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 122/243] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:18.985653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3be35ef8-b357-43ff-88ca-0d539567f9e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:18.985936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3be35ef8-b357-43ff-88ca-0d539567f9e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:18.994332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3be35ef8-b357-43ff-88ca-0d539567f9e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:18.994878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3be35ef8-b357-43ff-88ca-0d539567f9e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:18.995727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3be35ef8-b357-43ff-88ca-0d539567f9e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:18.996331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3be35ef8-b357-43ff-88ca-0d539567f9e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:19.137983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3be35ef8-b357-43ff-88ca-0d539567f9e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:19.145434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3be35ef8-b357-43ff-88ca-0d539567f9e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.164256 Jul 28 20:00:19.145982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 123/244] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:18 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:19.150582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4b38072c-5194-41c8-bfdd-b6bf1e275f9a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:19.151164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4b38072c-5194-41c8-bfdd-b6bf1e275f9a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:19.157947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b38072c-5194-41c8-bfdd-b6bf1e275f9a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:19.158405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b38072c-5194-41c8-bfdd-b6bf1e275f9a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:19.159253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b38072c-5194-41c8-bfdd-b6bf1e275f9a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:19.159766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b38072c-5194-41c8-bfdd-b6bf1e275f9a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:19.237807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4b38072c-5194-41c8-bfdd-b6bf1e275f9a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:19.246532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4b38072c-5194-41c8-bfdd-b6bf1e275f9a tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1428 microversion: 2.1 time: 0.099495 Jul 28 20:00:19.247170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 124/245] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:19 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1428 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:19.610567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b71b350b-0be2-4a32-a97e-8c186ddb64fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:19.612093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b71b350b-0be2-4a32-a97e-8c186ddb64fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:19.625870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b71b350b-0be2-4a32-a97e-8c186ddb64fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:19.626318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b71b350b-0be2-4a32-a97e-8c186ddb64fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:19.627094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b71b350b-0be2-4a32-a97e-8c186ddb64fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:19.627531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b71b350b-0be2-4a32-a97e-8c186ddb64fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:19.765641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b71b350b-0be2-4a32-a97e-8c186ddb64fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:19.775785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b71b350b-0be2-4a32-a97e-8c186ddb64fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.170467 Jul 28 20:00:19.777384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 125/246] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:20.171731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cc923388-181c-46d6-8bcf-e0d9805ad249 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:20.171731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cc923388-181c-46d6-8bcf-e0d9805ad249 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:20.177325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc923388-181c-46d6-8bcf-e0d9805ad249 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:20.177784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc923388-181c-46d6-8bcf-e0d9805ad249 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:20.178563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc923388-181c-46d6-8bcf-e0d9805ad249 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:20.178995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc923388-181c-46d6-8bcf-e0d9805ad249 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:20.328206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cc923388-181c-46d6-8bcf-e0d9805ad249 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:20.336455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cc923388-181c-46d6-8bcf-e0d9805ad249 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.172159 Jul 28 20:00:20.337850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 126/247] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:20 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:20.343086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f0d71f99-e65d-4ed1-8d96-b01114b03052 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:20.343887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f0d71f99-e65d-4ed1-8d96-b01114b03052 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:20.351214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0d71f99-e65d-4ed1-8d96-b01114b03052 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:20.351743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0d71f99-e65d-4ed1-8d96-b01114b03052 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:20.352606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0d71f99-e65d-4ed1-8d96-b01114b03052 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:20.353124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0d71f99-e65d-4ed1-8d96-b01114b03052 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:20.431353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f0d71f99-e65d-4ed1-8d96-b01114b03052 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:20.440341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f0d71f99-e65d-4ed1-8d96-b01114b03052 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1428 microversion: 2.1 time: 0.101164 Jul 28 20:00:20.441659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 127/248] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:20 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:20.798873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-885df8f7-f18d-4fff-9793-1b2c5e67af4a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:20.800817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-885df8f7-f18d-4fff-9793-1b2c5e67af4a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:20.809725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-885df8f7-f18d-4fff-9793-1b2c5e67af4a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:20.810630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-885df8f7-f18d-4fff-9793-1b2c5e67af4a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:20.811624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-885df8f7-f18d-4fff-9793-1b2c5e67af4a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:20.812242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-885df8f7-f18d-4fff-9793-1b2c5e67af4a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:20.989905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-885df8f7-f18d-4fff-9793-1b2c5e67af4a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:20.999354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-885df8f7-f18d-4fff-9793-1b2c5e67af4a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.204941 Jul 28 20:00:20.999926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 128/249] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:20 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:21.359800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c84bd521-98e0-4e37-a3e6-bbfd6b9ee978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:21.360407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c84bd521-98e0-4e37-a3e6-bbfd6b9ee978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:21.367236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c84bd521-98e0-4e37-a3e6-bbfd6b9ee978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:21.367683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c84bd521-98e0-4e37-a3e6-bbfd6b9ee978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:21.368437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c84bd521-98e0-4e37-a3e6-bbfd6b9ee978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:21.368901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c84bd521-98e0-4e37-a3e6-bbfd6b9ee978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:21.514884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c84bd521-98e0-4e37-a3e6-bbfd6b9ee978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:21.523281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c84bd521-98e0-4e37-a3e6-bbfd6b9ee978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.167066 Jul 28 20:00:21.524008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 129/250] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:21 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:21.528991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-95084e1d-12df-4eeb-9c31-48aec3c81c7b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:21.529690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-95084e1d-12df-4eeb-9c31-48aec3c81c7b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:21.536195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95084e1d-12df-4eeb-9c31-48aec3c81c7b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:21.536855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95084e1d-12df-4eeb-9c31-48aec3c81c7b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:21.537971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95084e1d-12df-4eeb-9c31-48aec3c81c7b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:21.538521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95084e1d-12df-4eeb-9c31-48aec3c81c7b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:21.620976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-95084e1d-12df-4eeb-9c31-48aec3c81c7b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:21.631514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-95084e1d-12df-4eeb-9c31-48aec3c81c7b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1428 microversion: 2.1 time: 0.105936 Jul 28 20:00:21.632228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 130/251] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:21 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:22.021907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f097aac3-0c30-4109-ae56-91894ac28d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:22.038413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f097aac3-0c30-4109-ae56-91894ac28d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:22.056897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f097aac3-0c30-4109-ae56-91894ac28d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:22.057542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f097aac3-0c30-4109-ae56-91894ac28d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:22.058604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f097aac3-0c30-4109-ae56-91894ac28d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:22.059230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f097aac3-0c30-4109-ae56-91894ac28d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:22.219614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f097aac3-0c30-4109-ae56-91894ac28d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:22.228513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f097aac3-0c30-4109-ae56-91894ac28d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.211050 Jul 28 20:00:22.241354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 131/252] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:22 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:22.545014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c249c226-a6e3-4634-89a9-9d4f2ee06dc8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:22.545542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c249c226-a6e3-4634-89a9-9d4f2ee06dc8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:22.547391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:22.553826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c249c226-a6e3-4634-89a9-9d4f2ee06dc8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:22.554273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c249c226-a6e3-4634-89a9-9d4f2ee06dc8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:22.555286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c249c226-a6e3-4634-89a9-9d4f2ee06dc8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:22.555517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c249c226-a6e3-4634-89a9-9d4f2ee06dc8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:22.704218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c249c226-a6e3-4634-89a9-9d4f2ee06dc8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:22.713308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c249c226-a6e3-4634-89a9-9d4f2ee06dc8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.172154 Jul 28 20:00:22.715459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 132/253] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:22 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:22.718283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fbfaefb4-b459-4bff-aeb6-c96313e9f9d6 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:22.718881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fbfaefb4-b459-4bff-aeb6-c96313e9f9d6 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:22.725913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbfaefb4-b459-4bff-aeb6-c96313e9f9d6 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:22.726353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbfaefb4-b459-4bff-aeb6-c96313e9f9d6 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:22.727106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbfaefb4-b459-4bff-aeb6-c96313e9f9d6 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:22.727530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbfaefb4-b459-4bff-aeb6-c96313e9f9d6 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:22.809996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fbfaefb4-b459-4bff-aeb6-c96313e9f9d6 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:22.817866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fbfaefb4-b459-4bff-aeb6-c96313e9f9d6 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1428 microversion: 2.1 time: 0.102863 Jul 28 20:00:22.818647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 133/254] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:22 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1428 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:22.829636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] validate_networks() for [('5173547b-0aef-47cd-835f-b2a192d02fb4', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:00:22.845352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2908d2d0-e57b-4d9f-b36d-e928a4a74003 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:22.845892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2908d2d0-e57b-4d9f-b36d-e928a4a74003 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:22.852604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2908d2d0-e57b-4d9f-b36d-e928a4a74003 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:22.853049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2908d2d0-e57b-4d9f-b36d-e928a4a74003 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:22.853986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2908d2d0-e57b-4d9f-b36d-e928a4a74003 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:22.854395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2908d2d0-e57b-4d9f-b36d-e928a4a74003 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:22.882330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-2908d2d0-e57b-4d9f-b36d-e928a4a74003 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lazy-loading 'flavor' on Instance uuid 4889e06d-18cf-4e5e-9f68-8c168109c1d3 {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:00:23.218897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=16 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:23.324678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2908d2d0-e57b-4d9f-b36d-e928a4a74003 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "POST /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/action" status: 202 len: 0 microversion: 2.20 time: 0.483152 Jul 28 20:00:23.328589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 134/255] 10.222.0.67 () {62 vars in 1319 bytes} [Thu Jul 28 20:00:22 2022] POST /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:00:23.335682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b975739f-9f78-4922-8267-a909bcb05f75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:23.338900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b975739f-9f78-4922-8267-a909bcb05f75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:23.346762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:00:23.347173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:00:23.347635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:00:23.348042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:00:23.348527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:00:23.351578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b975739f-9f78-4922-8267-a909bcb05f75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.351578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b975739f-9f78-4922-8267-a909bcb05f75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:23.351789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b975739f-9f78-4922-8267-a909bcb05f75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.352126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b975739f-9f78-4922-8267-a909bcb05f75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:23.365579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.366315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:23.367120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.367524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:23.389539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for project d6612a467ab54632a74cf113b4666eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:00:23.399388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for user bd0b2bfa3d014222afd4e050ca8498f9 and project d6612a467ab54632a74cf113b4666eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:00:23.414940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:00:23.417664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:00:23.494657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bf289801-65ae-4c57-b71b-dcb83e4e0992 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.251940 Jul 28 20:00:23.495865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 122/256] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:00:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 7254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:00:23.500884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:23.502261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:23.507093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:23.513824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.513824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:23.514576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.515119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:23.518381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b975739f-9f78-4922-8267-a909bcb05f75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:23.522725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:23.527541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b975739f-9f78-4922-8267-a909bcb05f75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.196935 Jul 28 20:00:23.542979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 135/257] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:23.548573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-daa827bd-c857-4b61-a952-dc26cb49fc82 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:23.549294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-daa827bd-c857-4b61-a952-dc26cb49fc82 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:23.648838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-daa827bd-c857-4b61-a952-dc26cb49fc82 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:23.655553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-daa827bd-c857-4b61-a952-dc26cb49fc82 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1242 microversion: 2.1 time: 0.111451 Jul 28 20:00:23.656324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 136/258] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:23 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:23.735207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9a2e40dd-e2c3-40e3-a1e8-270b57a0b2a9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:23.735837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9a2e40dd-e2c3-40e3-a1e8-270b57a0b2a9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:23.743735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:23.745367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a2e40dd-e2c3-40e3-a1e8-270b57a0b2a9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.745812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a2e40dd-e2c3-40e3-a1e8-270b57a0b2a9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:23.746571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a2e40dd-e2c3-40e3-a1e8-270b57a0b2a9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.747055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a2e40dd-e2c3-40e3-a1e8-270b57a0b2a9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:23.752963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:23.755105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:23.756499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-32ad7508-63b1-4eef-a438-dd5b6812a92f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.259505 Jul 28 20:00:23.757234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 123/259] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:23 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:23.851689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-041704a7-a4bb-4c22-b7b5-159219da624b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:23.853379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-041704a7-a4bb-4c22-b7b5-159219da624b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:23.885727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-041704a7-a4bb-4c22-b7b5-159219da624b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.890124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-041704a7-a4bb-4c22-b7b5-159219da624b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:23.892705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-041704a7-a4bb-4c22-b7b5-159219da624b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:23.892705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-041704a7-a4bb-4c22-b7b5-159219da624b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:24.002929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9a2e40dd-e2c3-40e3-a1e8-270b57a0b2a9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:24.020984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9a2e40dd-e2c3-40e3-a1e8-270b57a0b2a9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.289370 Jul 28 20:00:24.021674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 137/260] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:23 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:24.042707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-041704a7-a4bb-4c22-b7b5-159219da624b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:24.051797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-041704a7-a4bb-4c22-b7b5-159219da624b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1428 microversion: 2.1 time: 0.212423 Jul 28 20:00:24.053187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 124/261] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:23 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1428 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:24.549680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8298e3ba-0201-4cdf-a8ff-99d48ff72970 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:24.550281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8298e3ba-0201-4cdf-a8ff-99d48ff72970 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:24.557478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8298e3ba-0201-4cdf-a8ff-99d48ff72970 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:24.557928 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8298e3ba-0201-4cdf-a8ff-99d48ff72970 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:24.558708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8298e3ba-0201-4cdf-a8ff-99d48ff72970 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:24.559263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8298e3ba-0201-4cdf-a8ff-99d48ff72970 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:24.677475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2bd01b23-a704-4279-8e31-6f312a0e0a3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:24.678086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2bd01b23-a704-4279-8e31-6f312a0e0a3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:24.684038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2bd01b23-a704-4279-8e31-6f312a0e0a3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:24.684481 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2bd01b23-a704-4279-8e31-6f312a0e0a3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:24.685555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2bd01b23-a704-4279-8e31-6f312a0e0a3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:24.685996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2bd01b23-a704-4279-8e31-6f312a0e0a3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:24.695979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8298e3ba-0201-4cdf-a8ff-99d48ff72970 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:24.703412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8298e3ba-0201-4cdf-a8ff-99d48ff72970 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.157735 Jul 28 20:00:24.704271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 138/262] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:24.750386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2bd01b23-a704-4279-8e31-6f312a0e0a3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:24.758748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2bd01b23-a704-4279-8e31-6f312a0e0a3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1246 microversion: 2.1 time: 0.085475 Jul 28 20:00:24.759204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 125/263] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:24.781237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:24.781855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:24.790997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:24.791242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:24.792007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:24.792433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:24.939481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:24.947944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:24.949478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:24.950664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d030dd31-7449-4de3-a50c-ee79453beeb5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.173702 Jul 28 20:00:24.951217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 139/264] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:24 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:25.044896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-43de5884-2101-4fa8-983a-8f1fc8fb6235 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:25.045538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-43de5884-2101-4fa8-983a-8f1fc8fb6235 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:25.052431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43de5884-2101-4fa8-983a-8f1fc8fb6235 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.052905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43de5884-2101-4fa8-983a-8f1fc8fb6235 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:25.053674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43de5884-2101-4fa8-983a-8f1fc8fb6235 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.054086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43de5884-2101-4fa8-983a-8f1fc8fb6235 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:25.074808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5f609e13-7bc5-4368-a310-248b9933047b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:25.075412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5f609e13-7bc5-4368-a310-248b9933047b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:25.081276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5f609e13-7bc5-4368-a310-248b9933047b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.081713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5f609e13-7bc5-4368-a310-248b9933047b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:25.082467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5f609e13-7bc5-4368-a310-248b9933047b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.083075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5f609e13-7bc5-4368-a310-248b9933047b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:25.168500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5f609e13-7bc5-4368-a310-248b9933047b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:25.181128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5f609e13-7bc5-4368-a310-248b9933047b tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1428 microversion: 2.1 time: 0.110113 Jul 28 20:00:25.181913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 140/265] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:25 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:25.205619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-43de5884-2101-4fa8-983a-8f1fc8fb6235 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:25.217346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-43de5884-2101-4fa8-983a-8f1fc8fb6235 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.176272 Jul 28 20:00:25.218033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 126/266] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:25 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:25.726176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-77c2411b-053e-4e66-812f-15c88dd1c475 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:25.726756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-77c2411b-053e-4e66-812f-15c88dd1c475 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:25.733180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77c2411b-053e-4e66-812f-15c88dd1c475 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.733623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77c2411b-053e-4e66-812f-15c88dd1c475 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:25.734493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77c2411b-053e-4e66-812f-15c88dd1c475 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.734922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77c2411b-053e-4e66-812f-15c88dd1c475 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:25.781746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2b1b9451-000e-46dc-a44d-a751d3d5a6f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:25.782357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2b1b9451-000e-46dc-a44d-a751d3d5a6f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:25.789396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b1b9451-000e-46dc-a44d-a751d3d5a6f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.789841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b1b9451-000e-46dc-a44d-a751d3d5a6f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:25.790590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b1b9451-000e-46dc-a44d-a751d3d5a6f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.791020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b1b9451-000e-46dc-a44d-a751d3d5a6f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:25.869271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2b1b9451-000e-46dc-a44d-a751d3d5a6f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:25.888854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2b1b9451-000e-46dc-a44d-a751d3d5a6f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1246 microversion: 2.1 time: 0.110878 Jul 28 20:00:25.889613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 127/267] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1246 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:25.903558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-77c2411b-053e-4e66-812f-15c88dd1c475 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:25.910507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-77c2411b-053e-4e66-812f-15c88dd1c475 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.188765 Jul 28 20:00:25.911932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 141/268] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:25.975694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:25.976351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:25.982379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.982832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:25.983594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:25.984029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:26.133222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:26.141496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:26.143027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:26.144186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fed6dac3-e05c-4e59-8fad-facef5006e06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.173109 Jul 28 20:00:26.144774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 128/269] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:25 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:26.202738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2d105e69-ac7a-4c06-af6c-71670a8a371d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:26.203351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2d105e69-ac7a-4c06-af6c-71670a8a371d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:26.210477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d105e69-ac7a-4c06-af6c-71670a8a371d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:26.210930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d105e69-ac7a-4c06-af6c-71670a8a371d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:26.211698 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d105e69-ac7a-4c06-af6c-71670a8a371d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:26.212134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d105e69-ac7a-4c06-af6c-71670a8a371d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:26.242078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-619bba48-864a-4820-9a45-d4af9fdcb16d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:26.242989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-619bba48-864a-4820-9a45-d4af9fdcb16d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:26.249385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-619bba48-864a-4820-9a45-d4af9fdcb16d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:26.249820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-619bba48-864a-4820-9a45-d4af9fdcb16d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:26.250850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-619bba48-864a-4820-9a45-d4af9fdcb16d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:26.251428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-619bba48-864a-4820-9a45-d4af9fdcb16d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:26.283599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2d105e69-ac7a-4c06-af6c-71670a8a371d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:26.292308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2d105e69-ac7a-4c06-af6c-71670a8a371d tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1299 microversion: 2.1 time: 0.093554 Jul 28 20:00:26.293078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 142/270] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:26 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:26.386035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-619bba48-864a-4820-9a45-d4af9fdcb16d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:26.394336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-619bba48-864a-4820-9a45-d4af9fdcb16d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.157212 Jul 28 20:00:26.394902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 129/271] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:26 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:26.912850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ca527c0-32df-462a-8ec0-7f06c811c0b0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:26.913479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0ca527c0-32df-462a-8ec0-7f06c811c0b0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:26.919956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ca527c0-32df-462a-8ec0-7f06c811c0b0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:26.920398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ca527c0-32df-462a-8ec0-7f06c811c0b0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:26.921192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ca527c0-32df-462a-8ec0-7f06c811c0b0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:26.921623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ca527c0-32df-462a-8ec0-7f06c811c0b0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:26.931667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b583726a-468d-44db-89d1-098597a269c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:26.932268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b583726a-468d-44db-89d1-098597a269c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:26.938415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b583726a-468d-44db-89d1-098597a269c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:26.938853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b583726a-468d-44db-89d1-098597a269c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:26.939607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b583726a-468d-44db-89d1-098597a269c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:26.940031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b583726a-468d-44db-89d1-098597a269c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:26.986674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0ca527c0-32df-462a-8ec0-7f06c811c0b0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:26.995050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0ca527c0-32df-462a-8ec0-7f06c811c0b0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1246 microversion: 2.1 time: 0.087451 Jul 28 20:00:26.995614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 143/272] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:27.085045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b583726a-468d-44db-89d1-098597a269c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:27.092426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b583726a-468d-44db-89d1-098597a269c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.165217 Jul 28 20:00:27.093016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 130/273] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:27.168699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:27.168838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:27.174871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:27.175322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:27.176086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:27.176518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:27.312767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:27.314384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:27.315098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:27.321731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:27.322057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:27.322503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:27.332755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:27.332844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:27.332961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:27.333061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6587df2b-859d-480b-aa95-46a6b7feee72 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.160579 Jul 28 20:00:27.333061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 144/274] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:27 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:27.356451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:27.356926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:27.357380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lazy-loading 'fault' on Instance uuid 8478d16f-7aa0-4e82-9c17-1762010a1ab3 {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:00:27.401736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:27.408954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d6b2c9c3-fc76-4805-90f6-77d1ad9c9dc7 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1304 microversion: 2.1 time: 0.098649 Jul 28 20:00:27.409554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 131/275] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:27 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:27.416100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-27018321-71ea-4db0-8a83-3208b08c0ba0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:27.416731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-27018321-71ea-4db0-8a83-3208b08c0ba0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:27.422843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27018321-71ea-4db0-8a83-3208b08c0ba0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:27.423225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27018321-71ea-4db0-8a83-3208b08c0ba0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:27.423971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27018321-71ea-4db0-8a83-3208b08c0ba0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:27.424395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27018321-71ea-4db0-8a83-3208b08c0ba0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:27.552530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-27018321-71ea-4db0-8a83-3208b08c0ba0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:27.559958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-27018321-71ea-4db0-8a83-3208b08c0ba0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.148599 Jul 28 20:00:27.560505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 145/276] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:27 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:28.015120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3ba60d91-6d9c-4059-b5ae-dc136433a3ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:28.015636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3ba60d91-6d9c-4059-b5ae-dc136433a3ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:28.022125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ba60d91-6d9c-4059-b5ae-dc136433a3ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.022559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ba60d91-6d9c-4059-b5ae-dc136433a3ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.023304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ba60d91-6d9c-4059-b5ae-dc136433a3ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.023731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ba60d91-6d9c-4059-b5ae-dc136433a3ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.086630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3ba60d91-6d9c-4059-b5ae-dc136433a3ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:28.094030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3ba60d91-6d9c-4059-b5ae-dc136433a3ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1246 microversion: 2.1 time: 0.082785 Jul 28 20:00:28.094566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 132/277] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:28 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:28.113370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1fa101f7-3ac9-4a98-bf6a-7b4d477a5be0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:28.113976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1fa101f7-3ac9-4a98-bf6a-7b4d477a5be0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:28.121050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1fa101f7-3ac9-4a98-bf6a-7b4d477a5be0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.121489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1fa101f7-3ac9-4a98-bf6a-7b4d477a5be0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.122260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1fa101f7-3ac9-4a98-bf6a-7b4d477a5be0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.122688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1fa101f7-3ac9-4a98-bf6a-7b4d477a5be0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.249018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1fa101f7-3ac9-4a98-bf6a-7b4d477a5be0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:28.257434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1fa101f7-3ac9-4a98-bf6a-7b4d477a5be0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.147774 Jul 28 20:00:28.257989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 146/278] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:28.351286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:28.352440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:28.358415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.358859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.359637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.360068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.431522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:28.432213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:28.438243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.438792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.439589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.440016 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.470924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.471372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.471820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lazy-loading 'fault' on Instance uuid 8478d16f-7aa0-4e82-9c17-1762010a1ab3 {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:00:28.504173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:28.512709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:28.514227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:28.515379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e8588a0a-6221-4213-83a0-bc339ffe1b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.170889 Jul 28 20:00:28.515936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 133/279] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:28 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:28.520396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:28.528438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-223ea453-3adc-47ae-aba8-0000691c7b75 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1304 microversion: 2.1 time: 0.101578 Jul 28 20:00:28.529050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 147/280] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:28 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:28.581282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8b753b85-613a-4a1a-a592-15f1379851a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:28.581887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8b753b85-613a-4a1a-a592-15f1379851a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:28.588553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b753b85-613a-4a1a-a592-15f1379851a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.589063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b753b85-613a-4a1a-a592-15f1379851a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.589840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b753b85-613a-4a1a-a592-15f1379851a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:28.590290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b753b85-613a-4a1a-a592-15f1379851a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:28.717855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8b753b85-613a-4a1a-a592-15f1379851a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:28.725463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8b753b85-613a-4a1a-a592-15f1379851a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.147951 Jul 28 20:00:28.726026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 134/281] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:28 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:29.114806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5d1b3bf2-18f4-41bc-ace9-088f84ec456d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:29.115388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5d1b3bf2-18f4-41bc-ace9-088f84ec456d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:29.121820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d1b3bf2-18f4-41bc-ace9-088f84ec456d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.122245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d1b3bf2-18f4-41bc-ace9-088f84ec456d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.122997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d1b3bf2-18f4-41bc-ace9-088f84ec456d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.123428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d1b3bf2-18f4-41bc-ace9-088f84ec456d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.188629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5d1b3bf2-18f4-41bc-ace9-088f84ec456d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:29.196318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5d1b3bf2-18f4-41bc-ace9-088f84ec456d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1246 microversion: 2.1 time: 0.085637 Jul 28 20:00:29.196895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 148/282] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:29 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:29.279361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9a31cdf4-501a-4cef-936d-44ce04301664 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:29.279970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9a31cdf4-501a-4cef-936d-44ce04301664 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:29.287352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a31cdf4-501a-4cef-936d-44ce04301664 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.287807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a31cdf4-501a-4cef-936d-44ce04301664 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.288674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a31cdf4-501a-4cef-936d-44ce04301664 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.289209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a31cdf4-501a-4cef-936d-44ce04301664 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.420501 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9a31cdf4-501a-4cef-936d-44ce04301664 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:29.428118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9a31cdf4-501a-4cef-936d-44ce04301664 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.152696 Jul 28 20:00:29.428690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 135/283] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:29.539139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:29.539752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:29.545907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.546349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.547136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.547596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.549014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:29.549644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:29.556904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.557354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.558149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.558603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.589862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.590318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.590767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lazy-loading 'fault' on Instance uuid 8478d16f-7aa0-4e82-9c17-1762010a1ab3 {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:00:29.649785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:29.657320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3f653f62-a2a0-46dc-bc93-918a38c9fa56 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1304 microversion: 2.1 time: 0.112028 Jul 28 20:00:29.657882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 136/284] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:29 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:29.705746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:29.713633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:29.715124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:29.716263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-033b60ca-4fe6-4311-b5df-ed0ea19fd2f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.181434 Jul 28 20:00:29.716838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 149/285] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:29 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:29.746191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eadbb57e-b6f2-44bb-938e-c1511d3b48d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:29.746804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eadbb57e-b6f2-44bb-938e-c1511d3b48d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:29.753089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eadbb57e-b6f2-44bb-938e-c1511d3b48d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.753536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eadbb57e-b6f2-44bb-938e-c1511d3b48d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.754288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eadbb57e-b6f2-44bb-938e-c1511d3b48d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:29.754715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eadbb57e-b6f2-44bb-938e-c1511d3b48d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:29.774822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:29.887185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eadbb57e-b6f2-44bb-938e-c1511d3b48d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:29.894586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eadbb57e-b6f2-44bb-938e-c1511d3b48d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1522 microversion: 2.1 time: 0.152222 Jul 28 20:00:29.895149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 137/286] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:29 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:30.217161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4fa80d9d-d330-4375-9c26-343c0bcf21f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:30.217767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4fa80d9d-d330-4375-9c26-343c0bcf21f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:30.225273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fa80d9d-d330-4375-9c26-343c0bcf21f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.225791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fa80d9d-d330-4375-9c26-343c0bcf21f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.226571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fa80d9d-d330-4375-9c26-343c0bcf21f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.226992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fa80d9d-d330-4375-9c26-343c0bcf21f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.289262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4fa80d9d-d330-4375-9c26-343c0bcf21f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:30.296466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4fa80d9d-d330-4375-9c26-343c0bcf21f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1238 microversion: 2.1 time: 0.083259 Jul 28 20:00:30.297039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 150/287] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:30 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:30.448405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ea0fdec8-b54e-403e-814d-74047c70a851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:30.449304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ea0fdec8-b54e-403e-814d-74047c70a851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:30.455486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea0fdec8-b54e-403e-814d-74047c70a851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.455930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea0fdec8-b54e-403e-814d-74047c70a851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.456727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea0fdec8-b54e-403e-814d-74047c70a851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.457158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea0fdec8-b54e-403e-814d-74047c70a851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.590944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ea0fdec8-b54e-403e-814d-74047c70a851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:30.598346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ea0fdec8-b54e-403e-814d-74047c70a851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.153718 Jul 28 20:00:30.599518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 138/288] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:30.681324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:30.682127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:30.691531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.692145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.694339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.694964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.738103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.738754 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.739586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lazy-loading 'fault' on Instance uuid 8478d16f-7aa0-4e82-9c17-1762010a1ab3 {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:00:30.742225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:30.743406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:30.757502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.757670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.759757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.760420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.788301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f51975ec85694d9fa69620946cad39b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38eaadda07744c0a82352f164f354662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:30.795826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9afd127c-f1fa-4f07-942e-a2a82b6bb576 tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 200 len: 1304 microversion: 2.1 time: 0.120532 Jul 28 20:00:30.796390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 151/289] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:30 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:30.892382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:30.901432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:30.903013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:30.904246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5fb88c36-25bf-411f-b8cb-b5c2acbe0835 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.167883 Jul 28 20:00:30.904938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 139/290] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:30 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:00:30.918157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5ece9ed7-d3bc-4ced-a6b8-edacaf0b7a54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:30.918911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5ece9ed7-d3bc-4ced-a6b8-edacaf0b7a54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:30.925082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ece9ed7-d3bc-4ced-a6b8-edacaf0b7a54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.925616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ece9ed7-d3bc-4ced-a6b8-edacaf0b7a54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:30.926473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ece9ed7-d3bc-4ced-a6b8-edacaf0b7a54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:30.927003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ece9ed7-d3bc-4ced-a6b8-edacaf0b7a54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.066532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5ece9ed7-d3bc-4ced-a6b8-edacaf0b7a54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:31.070834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:31.075917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5ece9ed7-d3bc-4ced-a6b8-edacaf0b7a54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1502 microversion: 2.1 time: 0.161973 Jul 28 20:00:31.076484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 152/291] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:30 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:31.096685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-72b84526-46af-4686-a5f6-310cbe2ec824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:31.097315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-72b84526-46af-4686-a5f6-310cbe2ec824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:31.103381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72b84526-46af-4686-a5f6-310cbe2ec824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.103834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72b84526-46af-4686-a5f6-310cbe2ec824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.104623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72b84526-46af-4686-a5f6-310cbe2ec824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.105126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72b84526-46af-4686-a5f6-310cbe2ec824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.276781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-72b84526-46af-4686-a5f6-310cbe2ec824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:31.288762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-72b84526-46af-4686-a5f6-310cbe2ec824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1517 microversion: 2.1 time: 0.195323 Jul 28 20:00:31.301164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 140/292] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:31 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1517 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:31.319354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fa06ad32-81d8-4534-9fa7-eba4ea75208b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:31.320160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fa06ad32-81d8-4534-9fa7-eba4ea75208b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:31.330395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa06ad32-81d8-4534-9fa7-eba4ea75208b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.331001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa06ad32-81d8-4534-9fa7-eba4ea75208b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.331997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa06ad32-81d8-4534-9fa7-eba4ea75208b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.332623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa06ad32-81d8-4534-9fa7-eba4ea75208b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.469746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fa06ad32-81d8-4534-9fa7-eba4ea75208b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:31.482782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fa06ad32-81d8-4534-9fa7-eba4ea75208b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1294 microversion: 2.1 time: 0.168678 Jul 28 20:00:31.483778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 153/293] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1294 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:31.621083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-56a3235a-7877-47fe-b183-57affe5b06f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:31.621821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-56a3235a-7877-47fe-b183-57affe5b06f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:31.632363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56a3235a-7877-47fe-b183-57affe5b06f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.637202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56a3235a-7877-47fe-b183-57affe5b06f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.638190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56a3235a-7877-47fe-b183-57affe5b06f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.640170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56a3235a-7877-47fe-b183-57affe5b06f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.823682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:31.824289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] [instance: 8478d16f-7aa0-4e82-9c17-1762010a1ab3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:31.835444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.836000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.837800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.838956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.858516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] HTTP exception thrown: Instance 8478d16f-7aa0-4e82-9c17-1762010a1ab3 could not be found. Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Request method failure captured: Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 HTTP/1.1 Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uq5oF-o2T4zv0bd3mvhdCGp4t2C540LmZ0EzMsCio_593dFnj4CXPh3zNQNga2Y6YgNpRbJl89CX1Jfrk_GizQ3jklb7MYn8RUduhWJ9e64-SliXvQOQOxOgbTlbuatoxbGD4OexdYWhcUChMBIEruXc6cF8wFoMsaZhpoukMYBzqY Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 38eaadda07744c0a82352f164f354662 Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-VolumesNegativeTest-1847297790 Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:00:31.861432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38eaadda07744c0a82352f164f354662"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/38eaadda07744c0a82352f164f354662"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/38eaadda07744c0a82352f164f354662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_38eaadda07744c0a82352f164f354662"}]}] Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-VolumesNegativeTest-1847297790 Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 38eaadda07744c0a82352f164f354662 Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-VolumesNegativeTest-1847297790 Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-VolumesNegativeTest-1847297790-project Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: f51975ec85694d9fa69620946cad39b7 Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-VolumesNegativeTest-1847297790-project Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance 8478d16f-7aa0-4e82-9c17-1762010a1ab3 could not be found. Jul 28 20:00:31.862685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': '8478d16f-7aa0-4e82-9c17-1762010a1ab3'} Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8478d16f-7aa0-4e82-9c17-1762010a1ab3 could not be found. Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:00:31.863721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8478d16f-7aa0-4e82-9c17-1762010a1ab3 could not be found. Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8478d16f-7aa0-4e82-9c17-1762010a1ab3 could not be found. Jul 28 20:00:31.865178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:00:31.866640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] Returning 404 to user: Instance 8478d16f-7aa0-4e82-9c17-1762010a1ab3 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:00:31.868317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-56a3235a-7877-47fe-b183-57affe5b06f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:31.870218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a13353ad-fff4-481b-9ac8-cc2c3486c5ab tempest-VolumesNegativeTest-1847297790 tempest-VolumesNegativeTest-1847297790-project] 10.222.0.67 "GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3" status: 404 len: 111 microversion: 2.1 time: 0.057629 Jul 28 20:00:31.871542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 154/294] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:31 2022] GET /compute/v2.1/servers/8478d16f-7aa0-4e82-9c17-1762010a1ab3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 20:00:31.883301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-56a3235a-7877-47fe-b183-57affe5b06f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.265832 Jul 28 20:00:31.897281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 141/295] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:31.929816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:31.930502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:31.944931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.945405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:31.946144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:31.946568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:32.124666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:32.136476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:32.138012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:32.140286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d5df58c6-0b3f-4485-af09-2af19d5c48f9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.214116 Jul 28 20:00:32.153619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 155/296] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:31 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:32.506338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-13f3e692-5f25-4563-9a88-a52f92b5ab92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:32.506864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-13f3e692-5f25-4563-9a88-a52f92b5ab92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:32.515383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13f3e692-5f25-4563-9a88-a52f92b5ab92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:32.516224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13f3e692-5f25-4563-9a88-a52f92b5ab92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:32.517132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13f3e692-5f25-4563-9a88-a52f92b5ab92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:32.517790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13f3e692-5f25-4563-9a88-a52f92b5ab92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:32.601290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-13f3e692-5f25-4563-9a88-a52f92b5ab92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:32.611924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-13f3e692-5f25-4563-9a88-a52f92b5ab92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1294 microversion: 2.1 time: 0.110252 Jul 28 20:00:32.617423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 142/297] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1294 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:32.886909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1d3099a3-2810-40a0-8508-acb1b7f72642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:32.889262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1d3099a3-2810-40a0-8508-acb1b7f72642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:32.897264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d3099a3-2810-40a0-8508-acb1b7f72642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:32.898065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d3099a3-2810-40a0-8508-acb1b7f72642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:32.900036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d3099a3-2810-40a0-8508-acb1b7f72642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:32.900673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d3099a3-2810-40a0-8508-acb1b7f72642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:32.908094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-96299663-3bf0-4fdd-bd17-bd9f6f0c2ada tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:32.908940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-96299663-3bf0-4fdd-bd17-bd9f6f0c2ada tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:32.929855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96299663-3bf0-4fdd-bd17-bd9f6f0c2ada tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:32.931450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96299663-3bf0-4fdd-bd17-bd9f6f0c2ada tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:32.933844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96299663-3bf0-4fdd-bd17-bd9f6f0c2ada tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:32.937232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96299663-3bf0-4fdd-bd17-bd9f6f0c2ada tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:32.943108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-1d3099a3-2810-40a0-8508-acb1b7f72642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'flavor' on Instance uuid ea28ea30-1675-4f86-9a3d-8be8cf2b882d {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:00:33.151007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1d3099a3-2810-40a0-8508-acb1b7f72642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d/action" status: 200 len: 32 microversion: 2.1 time: 0.259061 Jul 28 20:00:33.154961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 156/298] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:00:32 2022] POST /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d/action => generated 32 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 20:00:33.175572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9a4f0925-ef59-42bb-9387-a34bac98963b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:33.179959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9a4f0925-ef59-42bb-9387-a34bac98963b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:33.194782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a4f0925-ef59-42bb-9387-a34bac98963b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:33.195329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a4f0925-ef59-42bb-9387-a34bac98963b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:33.196220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a4f0925-ef59-42bb-9387-a34bac98963b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:33.198129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a4f0925-ef59-42bb-9387-a34bac98963b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:33.287072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-96299663-3bf0-4fdd-bd17-bd9f6f0c2ada tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:33.334792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-96299663-3bf0-4fdd-bd17-bd9f6f0c2ada tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.428737 Jul 28 20:00:33.348360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 143/299] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:33.352269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:33.353287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:33.383107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:33.386343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:33.390887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:33.393664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:33.394417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:33.414901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=6 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:33.662815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:33.958659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9a4f0925-ef59-42bb-9387-a34bac98963b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:33.974361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9a4f0925-ef59-42bb-9387-a34bac98963b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.809958 Jul 28 20:00:33.975002 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 157/300] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:33 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:33.981728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:33.991139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dfaa9ef8-9bfe-4eae-abff-05a9ea5a0631 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:33.991287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:33.991752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dfaa9ef8-9bfe-4eae-abff-05a9ea5a0631 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:33.992694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:33.999480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9546892a-123c-4f5e-8d38-c02c7da8de8c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.663033 Jul 28 20:00:34.000058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 144/301] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:33 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:34.008775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dfaa9ef8-9bfe-4eae-abff-05a9ea5a0631 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:34.010992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dfaa9ef8-9bfe-4eae-abff-05a9ea5a0631 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:34.013535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dfaa9ef8-9bfe-4eae-abff-05a9ea5a0631 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:34.015205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dfaa9ef8-9bfe-4eae-abff-05a9ea5a0631 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:34.202341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dfaa9ef8-9bfe-4eae-abff-05a9ea5a0631 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:34.219879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dfaa9ef8-9bfe-4eae-abff-05a9ea5a0631 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1300 microversion: 2.1 time: 0.236576 Jul 28 20:00:34.221533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 158/302] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1300 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:34.356168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-da515883-5cce-4797-a007-588d389dbb7b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:34.357021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-da515883-5cce-4797-a007-588d389dbb7b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:34.363641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da515883-5cce-4797-a007-588d389dbb7b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:34.368941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da515883-5cce-4797-a007-588d389dbb7b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:34.369793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da515883-5cce-4797-a007-588d389dbb7b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:34.370945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da515883-5cce-4797-a007-588d389dbb7b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:34.577738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-da515883-5cce-4797-a007-588d389dbb7b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:34.592470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-da515883-5cce-4797-a007-588d389dbb7b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.239428 Jul 28 20:00:34.593330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 145/303] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:35.005937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8ce51cd0-c7ac-4358-8020-424513e06352 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:35.006561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8ce51cd0-c7ac-4358-8020-424513e06352 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:35.026965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:35.028710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:35.033788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8ce51cd0-c7ac-4358-8020-424513e06352 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:35.039776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:35.040462 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8ce51cd0-c7ac-4358-8020-424513e06352 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:35.041480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8ce51cd0-c7ac-4358-8020-424513e06352 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:35.043324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8ce51cd0-c7ac-4358-8020-424513e06352 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:35.044746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:35.048334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:35.049149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:35.289913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8ce51cd0-c7ac-4358-8020-424513e06352 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:35.309342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8ce51cd0-c7ac-4358-8020-424513e06352 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.317241 Jul 28 20:00:35.310228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 159/304] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:34 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:35.315297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ee5f162c-4db4-4b0e-8897-2eec2c396467 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:35.316102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ee5f162c-4db4-4b0e-8897-2eec2c396467 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:35.344285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee5f162c-4db4-4b0e-8897-2eec2c396467 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:35.344790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee5f162c-4db4-4b0e-8897-2eec2c396467 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:35.345557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee5f162c-4db4-4b0e-8897-2eec2c396467 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:35.345989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee5f162c-4db4-4b0e-8897-2eec2c396467 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:35.457394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:35.474265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:35.478691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:35.482703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fe5e0b18-8912-4a72-96a6-4b86d2cac9f3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.458841 Jul 28 20:00:35.483510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 146/305] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:35 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:35.495178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-3061bac3-f637-4e90-b2fb-65dedb1f0251 req-3de9869d-2f3d-44d8-801e-42b96f72ccbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed7c90e0-e87c-42b9-b14d-6c06761c1eef", "name": "network-vif-plugged", "status": "completed", "tag": "65dd95c0-2195-45fd-8275-f4c90145660b"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:35.515864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-3061bac3-f637-4e90-b2fb-65dedb1f0251 req-3de9869d-2f3d-44d8-801e-42b96f72ccbc service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:35.518396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-3061bac3-f637-4e90-b2fb-65dedb1f0251 req-3de9869d-2f3d-44d8-801e-42b96f72ccbc service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:35.557923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-3061bac3-f637-4e90-b2fb-65dedb1f0251 req-3de9869d-2f3d-44d8-801e-42b96f72ccbc service nova] Creating event network-vif-plugged:65dd95c0-2195-45fd-8275-f4c90145660b for instance ed7c90e0-e87c-42b9-b14d-6c06761c1eef on hv-cinder-85144 Jul 28 20:00:35.579938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-3061bac3-f637-4e90-b2fb-65dedb1f0251 req-3de9869d-2f3d-44d8-801e-42b96f72ccbc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094997 Jul 28 20:00:35.580528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 147/306] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:35.601192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ee5f162c-4db4-4b0e-8897-2eec2c396467 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:35.617895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-63cf690a-765c-483c-a16d-eb288a7fc978 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:35.618599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-63cf690a-765c-483c-a16d-eb288a7fc978 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:35.624528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ee5f162c-4db4-4b0e-8897-2eec2c396467 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.311154 Jul 28 20:00:35.625357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 160/307] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:35 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:35.628288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-63cf690a-765c-483c-a16d-eb288a7fc978 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:35.629148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-63cf690a-765c-483c-a16d-eb288a7fc978 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:35.632094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-63cf690a-765c-483c-a16d-eb288a7fc978 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:35.633390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-63cf690a-765c-483c-a16d-eb288a7fc978 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:35.855292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-63cf690a-765c-483c-a16d-eb288a7fc978 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:35.866473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-63cf690a-765c-483c-a16d-eb288a7fc978 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.252871 Jul 28 20:00:35.879544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 148/308] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:36.076908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-f1d096d0-3ab4-49a6-8fda-73c8fa83bbab req-71631c16-8827-4ec9-af39-4be4a599a150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cb56a8-6993-4767-9e30-5786f3b94743", "tag": "3420a2fe-6251-47ba-bc14-fdf7b2db8f58"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:36.090919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-f1d096d0-3ab4-49a6-8fda-73c8fa83bbab req-71631c16-8827-4ec9-af39-4be4a599a150 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:36.092362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-f1d096d0-3ab4-49a6-8fda-73c8fa83bbab req-71631c16-8827-4ec9-af39-4be4a599a150 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:36.112948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-f1d096d0-3ab4-49a6-8fda-73c8fa83bbab req-71631c16-8827-4ec9-af39-4be4a599a150 service nova] Creating event network-changed:3420a2fe-6251-47ba-bc14-fdf7b2db8f58 for instance c1cb56a8-6993-4767-9e30-5786f3b94743 on hv-cinder-85144 Jul 28 20:00:36.118102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-f1d096d0-3ab4-49a6-8fda-73c8fa83bbab req-71631c16-8827-4ec9-af39-4be4a599a150 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044803 Jul 28 20:00:36.118700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 161/309] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:36.335902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-40ca2d80-e940-4dc3-822b-173fe54479e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:36.336512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-40ca2d80-e940-4dc3-822b-173fe54479e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:36.342830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40ca2d80-e940-4dc3-822b-173fe54479e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:36.343235 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40ca2d80-e940-4dc3-822b-173fe54479e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:36.344005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40ca2d80-e940-4dc3-822b-173fe54479e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:36.344443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40ca2d80-e940-4dc3-822b-173fe54479e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:36.475672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-40ca2d80-e940-4dc3-822b-173fe54479e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:36.483635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-40ca2d80-e940-4dc3-822b-173fe54479e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.152639 Jul 28 20:00:36.484179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 149/310] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:36 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:36.511993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:36.512710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:36.518790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:36.519237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:36.519985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:36.520476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:36.647464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e5a1a8a9-6780-40d6-bc54-93d799c9ac77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:36.648097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e5a1a8a9-6780-40d6-bc54-93d799c9ac77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:36.651032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:36.654221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a1a8a9-6780-40d6-bc54-93d799c9ac77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:36.654662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a1a8a9-6780-40d6-bc54-93d799c9ac77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:36.655425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a1a8a9-6780-40d6-bc54-93d799c9ac77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:36.655851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a1a8a9-6780-40d6-bc54-93d799c9ac77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:36.659168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:36.661608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:36.662860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-507c8446-eade-43d6-b66b-c3fe4788d819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.155096 Jul 28 20:00:36.663492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 162/311] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:36 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:36.786934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5a1a8a9-6780-40d6-bc54-93d799c9ac77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:36.794264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e5a1a8a9-6780-40d6-bc54-93d799c9ac77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.150862 Jul 28 20:00:36.794810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 150/312] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:36 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:36.890673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-605da2dd-a528-42cd-955f-836f7bb75eac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:36.891286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-605da2dd-a528-42cd-955f-836f7bb75eac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:36.898190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-605da2dd-a528-42cd-955f-836f7bb75eac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:36.898639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-605da2dd-a528-42cd-955f-836f7bb75eac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:36.899398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-605da2dd-a528-42cd-955f-836f7bb75eac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:36.899835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-605da2dd-a528-42cd-955f-836f7bb75eac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:37.034701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-605da2dd-a528-42cd-955f-836f7bb75eac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:37.042255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-605da2dd-a528-42cd-955f-836f7bb75eac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.155648 Jul 28 20:00:37.043058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 163/313] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:36 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:37.504766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d3791870-b571-4146-92e2-ab5eaf72d552 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:37.505312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d3791870-b571-4146-92e2-ab5eaf72d552 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:37.511809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3791870-b571-4146-92e2-ab5eaf72d552 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:37.512250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3791870-b571-4146-92e2-ab5eaf72d552 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:37.513017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3791870-b571-4146-92e2-ab5eaf72d552 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:37.513441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3791870-b571-4146-92e2-ab5eaf72d552 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:37.644858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d3791870-b571-4146-92e2-ab5eaf72d552 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:37.653103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d3791870-b571-4146-92e2-ab5eaf72d552 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.152204 Jul 28 20:00:37.653666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 151/314] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:37 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:37.686637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:37.687253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:37.693820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:37.694266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:37.695024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:37.695463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:37.814450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-74cb828d-2f09-440a-9053-627dd374ac47 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:37.815054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-74cb828d-2f09-440a-9053-627dd374ac47 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:37.821097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74cb828d-2f09-440a-9053-627dd374ac47 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:37.821534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74cb828d-2f09-440a-9053-627dd374ac47 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:37.822282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74cb828d-2f09-440a-9053-627dd374ac47 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:37.822705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74cb828d-2f09-440a-9053-627dd374ac47 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:37.822985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:37.830964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:37.832468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:37.834224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-86c017f9-351a-4447-bfe2-624b4d41818a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.150930 Jul 28 20:00:37.835261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 164/315] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:37 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:37.958048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-74cb828d-2f09-440a-9053-627dd374ac47 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:37.966625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-74cb828d-2f09-440a-9053-627dd374ac47 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.155993 Jul 28 20:00:37.967183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 152/316] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:37 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:38.063919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8fc77ac3-ed2d-4e80-bdc9-a2d336d1e432 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:38.064531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8fc77ac3-ed2d-4e80-bdc9-a2d336d1e432 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:38.071398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fc77ac3-ed2d-4e80-bdc9-a2d336d1e432 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:38.071847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fc77ac3-ed2d-4e80-bdc9-a2d336d1e432 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:38.072638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fc77ac3-ed2d-4e80-bdc9-a2d336d1e432 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:38.073243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fc77ac3-ed2d-4e80-bdc9-a2d336d1e432 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:38.220454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8fc77ac3-ed2d-4e80-bdc9-a2d336d1e432 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:38.231802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8fc77ac3-ed2d-4e80-bdc9-a2d336d1e432 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.172353 Jul 28 20:00:38.232966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 165/317] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:38.674980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f2d040b8-ccdb-4d9c-a0f2-fe07c7b13eba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:38.675592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f2d040b8-ccdb-4d9c-a0f2-fe07c7b13eba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:38.683197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2d040b8-ccdb-4d9c-a0f2-fe07c7b13eba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:38.683716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2d040b8-ccdb-4d9c-a0f2-fe07c7b13eba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:38.684491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2d040b8-ccdb-4d9c-a0f2-fe07c7b13eba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:38.684951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2d040b8-ccdb-4d9c-a0f2-fe07c7b13eba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:38.825696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f2d040b8-ccdb-4d9c-a0f2-fe07c7b13eba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:38.833203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f2d040b8-ccdb-4d9c-a0f2-fe07c7b13eba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.162349 Jul 28 20:00:38.833816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 153/318] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:38 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:38.857307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:38.857928 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:38.864802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:38.865805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:38.866568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:38.867003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:38.987397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b5adef4f-0114-4c4c-86f9-bf474e0a7ff3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:38.988027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b5adef4f-0114-4c4c-86f9-bf474e0a7ff3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:38.995490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5adef4f-0114-4c4c-86f9-bf474e0a7ff3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:38.995938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5adef4f-0114-4c4c-86f9-bf474e0a7ff3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:38.996745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5adef4f-0114-4c4c-86f9-bf474e0a7ff3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:38.997174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5adef4f-0114-4c4c-86f9-bf474e0a7ff3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:39.001681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:39.010434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:39.011951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:39.013183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c1bcae64-7485-4d23-9156-4d10f821fcd8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.159714 Jul 28 20:00:39.013746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 166/319] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:38 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:39.128510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b5adef4f-0114-4c4c-86f9-bf474e0a7ff3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:39.132300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:39.137230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b5adef4f-0114-4c4c-86f9-bf474e0a7ff3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.153781 Jul 28 20:00:39.137800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 154/320] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:39.252897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ecaf4a42-4379-48af-a8ac-b8adb9ce9cce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:39.253504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ecaf4a42-4379-48af-a8ac-b8adb9ce9cce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:39.259579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ecaf4a42-4379-48af-a8ac-b8adb9ce9cce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:39.260024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ecaf4a42-4379-48af-a8ac-b8adb9ce9cce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:39.260812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ecaf4a42-4379-48af-a8ac-b8adb9ce9cce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:39.261247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ecaf4a42-4379-48af-a8ac-b8adb9ce9cce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:39.391814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ecaf4a42-4379-48af-a8ac-b8adb9ce9cce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:39.399700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ecaf4a42-4379-48af-a8ac-b8adb9ce9cce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.150738 Jul 28 20:00:39.400232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 167/321] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:39.855475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4a8afcaa-431e-425c-a433-aefa4c22e547 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:39.855935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4a8afcaa-431e-425c-a433-aefa4c22e547 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:39.862005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a8afcaa-431e-425c-a433-aefa4c22e547 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:39.862449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a8afcaa-431e-425c-a433-aefa4c22e547 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:39.863208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a8afcaa-431e-425c-a433-aefa4c22e547 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:39.863639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a8afcaa-431e-425c-a433-aefa4c22e547 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:39.993514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4a8afcaa-431e-425c-a433-aefa4c22e547 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:40.000897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4a8afcaa-431e-425c-a433-aefa4c22e547 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.149659 Jul 28 20:00:40.001450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 155/322] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:39 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:40.037403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:40.038015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:40.044387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:40.044869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:40.045617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:40.046043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:40.157350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3dfef63d-6945-4f84-987e-640038e718c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:40.158042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3dfef63d-6945-4f84-987e-640038e718c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:40.165304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3dfef63d-6945-4f84-987e-640038e718c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:40.165826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3dfef63d-6945-4f84-987e-640038e718c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:40.166749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3dfef63d-6945-4f84-987e-640038e718c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:40.167386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3dfef63d-6945-4f84-987e-640038e718c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:40.180401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:40.184520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:40.190260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:40.191770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:40.193006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b67bbced-5ebc-47fe-84f5-6bd06ade6c26 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.160309 Jul 28 20:00:40.193560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 168/323] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:40 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:40.300018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3dfef63d-6945-4f84-987e-640038e718c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:40.307524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3dfef63d-6945-4f84-987e-640038e718c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.154115 Jul 28 20:00:40.308112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 156/324] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:40.421683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-797e221a-bf83-49df-bdcf-d1ed35dcc7ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:40.422206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-797e221a-bf83-49df-bdcf-d1ed35dcc7ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:40.429385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-797e221a-bf83-49df-bdcf-d1ed35dcc7ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:40.429824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-797e221a-bf83-49df-bdcf-d1ed35dcc7ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:40.430571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-797e221a-bf83-49df-bdcf-d1ed35dcc7ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:40.431016 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-797e221a-bf83-49df-bdcf-d1ed35dcc7ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:40.557225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-797e221a-bf83-49df-bdcf-d1ed35dcc7ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:40.564567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-797e221a-bf83-49df-bdcf-d1ed35dcc7ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.147192 Jul 28 20:00:40.565126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 169/325] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:41.022649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-26b0a290-f10d-4aa2-baf2-60ef663ecc93 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:41.023205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-26b0a290-f10d-4aa2-baf2-60ef663ecc93 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:41.029209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26b0a290-f10d-4aa2-baf2-60ef663ecc93 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:41.029655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26b0a290-f10d-4aa2-baf2-60ef663ecc93 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:41.030406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26b0a290-f10d-4aa2-baf2-60ef663ecc93 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:41.030838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26b0a290-f10d-4aa2-baf2-60ef663ecc93 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:41.164754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-26b0a290-f10d-4aa2-baf2-60ef663ecc93 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:41.172505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-26b0a290-f10d-4aa2-baf2-60ef663ecc93 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.154417 Jul 28 20:00:41.173078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 157/326] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:41 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:41.215902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:41.216638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:41.223178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:41.223693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:41.225335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:41.225850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:41.328463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-131bf02d-051a-4e9a-a353-f64ee06f20bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:41.329111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-131bf02d-051a-4e9a-a353-f64ee06f20bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:41.335736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-131bf02d-051a-4e9a-a353-f64ee06f20bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:41.336182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-131bf02d-051a-4e9a-a353-f64ee06f20bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:41.337003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-131bf02d-051a-4e9a-a353-f64ee06f20bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:41.337421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-131bf02d-051a-4e9a-a353-f64ee06f20bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:41.365692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:41.375555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:41.377674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:41.379060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ac9c1b59-c67a-43e3-a0c6-85c28aa53d4c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.167189 Jul 28 20:00:41.380204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 170/327] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:41 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:41.495960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-131bf02d-051a-4e9a-a353-f64ee06f20bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:41.503438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-131bf02d-051a-4e9a-a353-f64ee06f20bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.178823 Jul 28 20:00:41.503991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 158/328] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:41 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:41.586781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-45ed4920-d783-4c15-9f6a-9a29de6cdd02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:41.587393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-45ed4920-d783-4c15-9f6a-9a29de6cdd02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:41.593341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45ed4920-d783-4c15-9f6a-9a29de6cdd02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:41.594329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45ed4920-d783-4c15-9f6a-9a29de6cdd02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:41.594519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45ed4920-d783-4c15-9f6a-9a29de6cdd02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:41.594998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45ed4920-d783-4c15-9f6a-9a29de6cdd02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:41.734712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-45ed4920-d783-4c15-9f6a-9a29de6cdd02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:41.743286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-45ed4920-d783-4c15-9f6a-9a29de6cdd02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1357 microversion: 2.1 time: 0.161487 Jul 28 20:00:41.743882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 171/329] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:42.194668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-495ba3cd-8657-4d1e-897b-1074f9fe160b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:42.195378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-495ba3cd-8657-4d1e-897b-1074f9fe160b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:42.202094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-495ba3cd-8657-4d1e-897b-1074f9fe160b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:42.202535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-495ba3cd-8657-4d1e-897b-1074f9fe160b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:42.203304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-495ba3cd-8657-4d1e-897b-1074f9fe160b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:42.203733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-495ba3cd-8657-4d1e-897b-1074f9fe160b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:42.399375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-495ba3cd-8657-4d1e-897b-1074f9fe160b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:42.406319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:42.408311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:42.410650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-495ba3cd-8657-4d1e-897b-1074f9fe160b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.220603 Jul 28 20:00:42.411367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 159/330] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:42 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:42.424877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:42.425573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:42.426985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:42.427965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:42.524439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-33cba49b-8d06-451f-b863-e244497cd806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:42.524945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-33cba49b-8d06-451f-b863-e244497cd806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:42.531285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33cba49b-8d06-451f-b863-e244497cd806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:42.532236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33cba49b-8d06-451f-b863-e244497cd806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:42.533320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33cba49b-8d06-451f-b863-e244497cd806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:42.533897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33cba49b-8d06-451f-b863-e244497cd806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:42.623905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:42.639961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:42.645747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:42.647578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2173c8ce-0dc6-4d6a-b97a-76fb222dd84b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.247511 Jul 28 20:00:42.666426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 172/331] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:42 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:42.719906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-33cba49b-8d06-451f-b863-e244497cd806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:42.730086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-33cba49b-8d06-451f-b863-e244497cd806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.209712 Jul 28 20:00:42.730662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 160/332] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:42 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:42.826865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ec8f41d1-bc16-424e-b696-ba15adfacb70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:42.827950 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ec8f41d1-bc16-424e-b696-ba15adfacb70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:42.834882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec8f41d1-bc16-424e-b696-ba15adfacb70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:42.835393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec8f41d1-bc16-424e-b696-ba15adfacb70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:42.836180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec8f41d1-bc16-424e-b696-ba15adfacb70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:42.836984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec8f41d1-bc16-424e-b696-ba15adfacb70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.005261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ec8f41d1-bc16-424e-b696-ba15adfacb70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:43.015594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ec8f41d1-bc16-424e-b696-ba15adfacb70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1546 microversion: 2.1 time: 0.192645 Jul 28 20:00:43.016244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 173/333] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1546 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:43.042593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-161de973-2f58-4758-a7db-63e7cc9619d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:43.043527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-161de973-2f58-4758-a7db-63e7cc9619d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:43.051450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-161de973-2f58-4758-a7db-63e7cc9619d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.051897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-161de973-2f58-4758-a7db-63e7cc9619d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.054733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-161de973-2f58-4758-a7db-63e7cc9619d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.055197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-161de973-2f58-4758-a7db-63e7cc9619d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.241311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-161de973-2f58-4758-a7db-63e7cc9619d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:43.252047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-161de973-2f58-4758-a7db-63e7cc9619d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1546 microversion: 2.1 time: 0.218004 Jul 28 20:00:43.252623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 161/334] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:43.273868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c9ef6442-9f3e-4c21-af2c-2ec19334ebbb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:43.279675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c9ef6442-9f3e-4c21-af2c-2ec19334ebbb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:43.280441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c9ef6442-9f3e-4c21-af2c-2ec19334ebbb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Searching by: {'deleted': False, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7'} {{(pid=117968) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 20:00:43.289443 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9ef6442-9f3e-4c21-af2c-2ec19334ebbb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.290189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9ef6442-9f3e-4c21-af2c-2ec19334ebbb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.292012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9ef6442-9f3e-4c21-af2c-2ec19334ebbb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.292642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9ef6442-9f3e-4c21-af2c-2ec19334ebbb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.433072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4640b33e-454e-47cc-93da-74ba4b886bd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:43.434256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4640b33e-454e-47cc-93da-74ba4b886bd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:43.441391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.multi_cell_list [None req-c9ef6442-9f3e-4c21-af2c-2ec19334ebbb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117968) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 20:00:43.445802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4640b33e-454e-47cc-93da-74ba4b886bd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.446247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4640b33e-454e-47cc-93da-74ba4b886bd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.447022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4640b33e-454e-47cc-93da-74ba4b886bd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.452463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4640b33e-454e-47cc-93da-74ba4b886bd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.586506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c9ef6442-9f3e-4c21-af2c-2ec19334ebbb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.317993 Jul 28 20:00:43.593472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 174/335] 10.222.0.67 () {58 vars in 1125 bytes} [Thu Jul 28 20:00:43 2022] GET /compute/v2.1/servers => generated 342 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:43.599147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-450fa3da-f651-4945-97f4-d1b5c741f665 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:43.600337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-450fa3da-f651-4945-97f4-d1b5c741f665 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:43.606896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-450fa3da-f651-4945-97f4-d1b5c741f665 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.607574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-450fa3da-f651-4945-97f4-d1b5c741f665 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.608518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-450fa3da-f651-4945-97f4-d1b5c741f665 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.609130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-450fa3da-f651-4945-97f4-d1b5c741f665 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.735051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4640b33e-454e-47cc-93da-74ba4b886bd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:43.744285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4640b33e-454e-47cc-93da-74ba4b886bd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.315028 Jul 28 20:00:43.749295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 162/336] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:43 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:43.753831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:43.754487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:43.772772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.773481 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.774399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.774987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.825686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-450fa3da-f651-4945-97f4-d1b5c741f665 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:43.837676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-450fa3da-f651-4945-97f4-d1b5c741f665 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1546 microversion: 2.1 time: 0.242493 Jul 28 20:00:43.838463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 175/337] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:43.857148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ed2a292c-550c-46bb-bda9-06b7d7f0e3e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:43.859715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ed2a292c-550c-46bb-bda9-06b7d7f0e3e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:43.875088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed2a292c-550c-46bb-bda9-06b7d7f0e3e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.876954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed2a292c-550c-46bb-bda9-06b7d7f0e3e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:43.877751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed2a292c-550c-46bb-bda9-06b7d7f0e3e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:43.878191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed2a292c-550c-46bb-bda9-06b7d7f0e3e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:44.074066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:44.096199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:44.103032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:44.107540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-13bbfced-7b9c-4e92-a402-972ef0b66a78 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.357204 Jul 28 20:00:44.111182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 163/338] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:43 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:44.148936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ed2a292c-550c-46bb-bda9-06b7d7f0e3e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:44.157743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ed2a292c-550c-46bb-bda9-06b7d7f0e3e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.310199 Jul 28 20:00:44.158773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 176/339] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:43 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:44.773309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-00c6a639-6088-477b-a1ed-e8b37c04c61d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:44.773939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-00c6a639-6088-477b-a1ed-e8b37c04c61d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:44.781120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00c6a639-6088-477b-a1ed-e8b37c04c61d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:44.781575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00c6a639-6088-477b-a1ed-e8b37c04c61d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:44.782387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00c6a639-6088-477b-a1ed-e8b37c04c61d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:44.782790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00c6a639-6088-477b-a1ed-e8b37c04c61d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:45.111774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-00c6a639-6088-477b-a1ed-e8b37c04c61d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:45.123863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-00c6a639-6088-477b-a1ed-e8b37c04c61d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.355428 Jul 28 20:00:45.124725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 164/340] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:44 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:45.136865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:45.138958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:45.148209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:45.148789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:45.149895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:45.150526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:45.184375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c7e53d0-2e90-4264-8644-caa6e2fde0ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:45.184920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1c7e53d0-2e90-4264-8644-caa6e2fde0ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:45.197014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c7e53d0-2e90-4264-8644-caa6e2fde0ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:45.198589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c7e53d0-2e90-4264-8644-caa6e2fde0ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:45.200010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c7e53d0-2e90-4264-8644-caa6e2fde0ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:45.203386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c7e53d0-2e90-4264-8644-caa6e2fde0ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:45.436015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:45.459905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:45.461805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:45.462987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7a88b954-bc4b-46c6-acf0-8a86b0d3e69a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1743 microversion: 2.20 time: 0.330981 Jul 28 20:00:45.463532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 177/341] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:45 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1743 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:00:45.524173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1c7e53d0-2e90-4264-8644-caa6e2fde0ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:45.561912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1c7e53d0-2e90-4264-8644-caa6e2fde0ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.382037 Jul 28 20:00:45.585703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 165/342] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:45.881517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2a4c364a-930e-4a81-acc5-7b2eb111a992 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:45.884387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2a4c364a-930e-4a81-acc5-7b2eb111a992 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:45.901907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a4c364a-930e-4a81-acc5-7b2eb111a992 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:45.902689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a4c364a-930e-4a81-acc5-7b2eb111a992 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:45.903651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a4c364a-930e-4a81-acc5-7b2eb111a992 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:45.904318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a4c364a-930e-4a81-acc5-7b2eb111a992 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:46.178149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6247b772-29be-4504-bfa1-f6ddae10dcf8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:46.188284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6247b772-29be-4504-bfa1-f6ddae10dcf8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:46.211109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6247b772-29be-4504-bfa1-f6ddae10dcf8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:46.211794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6247b772-29be-4504-bfa1-f6ddae10dcf8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:46.212632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6247b772-29be-4504-bfa1-f6ddae10dcf8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:46.213101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6247b772-29be-4504-bfa1-f6ddae10dcf8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:46.413430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2a4c364a-930e-4a81-acc5-7b2eb111a992 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536666 Jul 28 20:00:46.415541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 178/343] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:00:45 2022] POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:46.493884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6247b772-29be-4504-bfa1-f6ddae10dcf8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:46.496095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:46.497180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:46.508220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6247b772-29be-4504-bfa1-f6ddae10dcf8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.342567 Jul 28 20:00:46.508809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:46.512677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 166/344] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:46 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:46.514187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:46.515637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:46.517217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:46.517659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:46.626353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c7d1759b-dae8-41da-bc33-22780c0cef83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:46.627295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c7d1759b-dae8-41da-bc33-22780c0cef83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:46.650366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7d1759b-dae8-41da-bc33-22780c0cef83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:46.653141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7d1759b-dae8-41da-bc33-22780c0cef83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:46.656660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7d1759b-dae8-41da-bc33-22780c0cef83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:46.657315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7d1759b-dae8-41da-bc33-22780c0cef83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:46.734302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:46.744085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:46.760823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:46.762960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5477e30d-65a2-479b-a914-4f221f833501 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1743 microversion: 2.20 time: 0.273405 Jul 28 20:00:46.781742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 179/345] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:46 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1743 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:00:46.968645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c7d1759b-dae8-41da-bc33-22780c0cef83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:46.993010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c7d1759b-dae8-41da-bc33-22780c0cef83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.367681 Jul 28 20:00:46.993010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 167/346] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:47.538900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-51d04c87-89a2-44f5-be0c-5cdcb0ec2234 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:47.540575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-51d04c87-89a2-44f5-be0c-5cdcb0ec2234 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:47.554098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51d04c87-89a2-44f5-be0c-5cdcb0ec2234 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:47.555165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51d04c87-89a2-44f5-be0c-5cdcb0ec2234 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:47.560142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51d04c87-89a2-44f5-be0c-5cdcb0ec2234 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:47.560922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51d04c87-89a2-44f5-be0c-5cdcb0ec2234 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:47.796587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:47.801111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:47.808731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:47.809723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:47.810759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:47.811384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:47.948173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-51d04c87-89a2-44f5-be0c-5cdcb0ec2234 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:47.978914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-51d04c87-89a2-44f5-be0c-5cdcb0ec2234 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.451267 Jul 28 20:00:47.986226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 180/347] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:47 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:48.013288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f842a721-b176-4988-b8bc-e9dea8edb9d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:48.013870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f842a721-b176-4988-b8bc-e9dea8edb9d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:48.032125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f842a721-b176-4988-b8bc-e9dea8edb9d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:48.032610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f842a721-b176-4988-b8bc-e9dea8edb9d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:48.033391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f842a721-b176-4988-b8bc-e9dea8edb9d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:48.033842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f842a721-b176-4988-b8bc-e9dea8edb9d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:48.531686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:48.545061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f842a721-b176-4988-b8bc-e9dea8edb9d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:48.546363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:48.554309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:48.556525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-187ff7c5-3aca-441a-ba47-a0b09fdf193a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.770914 Jul 28 20:00:48.559340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 168/348] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:47 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:48.565529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f842a721-b176-4988-b8bc-e9dea8edb9d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.556171 Jul 28 20:00:48.566098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 181/349] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:48 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:49.012599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-40aaa94d-3ae5-4a26-8f9c-1b5ddbd1a613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:49.013245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-40aaa94d-3ae5-4a26-8f9c-1b5ddbd1a613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:49.020349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40aaa94d-3ae5-4a26-8f9c-1b5ddbd1a613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:49.021958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40aaa94d-3ae5-4a26-8f9c-1b5ddbd1a613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:49.023012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40aaa94d-3ae5-4a26-8f9c-1b5ddbd1a613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:49.023677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40aaa94d-3ae5-4a26-8f9c-1b5ddbd1a613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:49.300042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-40aaa94d-3ae5-4a26-8f9c-1b5ddbd1a613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:49.316959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-40aaa94d-3ae5-4a26-8f9c-1b5ddbd1a613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.309039 Jul 28 20:00:49.318996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 169/350] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:49 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:49.595180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:49.599718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0477db2e-4f4e-4337-87cf-bcc4d8829f9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:49.600475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:49.602598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0477db2e-4f4e-4337-87cf-bcc4d8829f9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:49.626810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:49.627406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0477db2e-4f4e-4337-87cf-bcc4d8829f9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:49.628145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0477db2e-4f4e-4337-87cf-bcc4d8829f9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:49.632096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0477db2e-4f4e-4337-87cf-bcc4d8829f9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:49.632404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:49.635288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0477db2e-4f4e-4337-87cf-bcc4d8829f9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:49.636054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:49.638489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:50.133423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0477db2e-4f4e-4337-87cf-bcc4d8829f9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:50.150452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0477db2e-4f4e-4337-87cf-bcc4d8829f9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.565418 Jul 28 20:00:50.151587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 170/351] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:49 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:50.161121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:50.180766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:50.184917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:50.193563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b853e18e-7af7-438f-ac23-07e5157625e5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.610862 Jul 28 20:00:50.200876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 182/352] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:49 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:50.340065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-29e33cea-322a-47da-b4a7-1bfe6c9f15e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:50.341044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-29e33cea-322a-47da-b4a7-1bfe6c9f15e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:50.344494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:50.357337 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29e33cea-322a-47da-b4a7-1bfe6c9f15e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:50.357849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29e33cea-322a-47da-b4a7-1bfe6c9f15e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:50.359054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29e33cea-322a-47da-b4a7-1bfe6c9f15e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:50.359648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29e33cea-322a-47da-b4a7-1bfe6c9f15e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:50.420916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:50.767778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-29e33cea-322a-47da-b4a7-1bfe6c9f15e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:50.777803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-29e33cea-322a-47da-b4a7-1bfe6c9f15e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.441717 Jul 28 20:00:50.778565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 171/353] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:50 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:51.188494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ec2890be-7d5b-4919-8d05-59a0219ef825 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:51.189147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ec2890be-7d5b-4919-8d05-59a0219ef825 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:51.197528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec2890be-7d5b-4919-8d05-59a0219ef825 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:51.197976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec2890be-7d5b-4919-8d05-59a0219ef825 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:51.198880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec2890be-7d5b-4919-8d05-59a0219ef825 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:51.199316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec2890be-7d5b-4919-8d05-59a0219ef825 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:51.228105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:51.229452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:51.236830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:51.244816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:51.245973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:51.246559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:52.073579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:52.087552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:52.089079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:52.090258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-73b993d5-4302-4c8a-a813-ae50e18ecb79 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.868098 Jul 28 20:00:52.094344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 172/354] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:51 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:52.102653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-70c1464c-9dc8-43ad-ad11-53c09a24c696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:52.110127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-70c1464c-9dc8-43ad-ad11-53c09a24c696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:52.128276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70c1464c-9dc8-43ad-ad11-53c09a24c696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:52.129046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70c1464c-9dc8-43ad-ad11-53c09a24c696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:52.130744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70c1464c-9dc8-43ad-ad11-53c09a24c696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:52.136037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70c1464c-9dc8-43ad-ad11-53c09a24c696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:52.241001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ec2890be-7d5b-4919-8d05-59a0219ef825 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:52.245264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:52.269699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ec2890be-7d5b-4919-8d05-59a0219ef825 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 1.087546 Jul 28 20:00:52.292655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 183/355] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:52.437316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-70c1464c-9dc8-43ad-ad11-53c09a24c696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:52.451418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-70c1464c-9dc8-43ad-ad11-53c09a24c696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.355633 Jul 28 20:00:52.452488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 173/356] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:52 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:52.480249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-d980cc9b-e148-4be3-9f40-15bed26749b3 req-04ec4f37-b9b4-4a6b-aa4b-cbb916704460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4889e06d-18cf-4e5e-9f68-8c168109c1d3", "name": "network-vif-plugged", "status": "completed", "tag": "e3b95cb5-58ef-47b5-a24c-57117b4da068"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:52.514726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-d980cc9b-e148-4be3-9f40-15bed26749b3 req-04ec4f37-b9b4-4a6b-aa4b-cbb916704460 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:52.515224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-d980cc9b-e148-4be3-9f40-15bed26749b3 req-04ec4f37-b9b4-4a6b-aa4b-cbb916704460 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:52.564484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-d980cc9b-e148-4be3-9f40-15bed26749b3 req-04ec4f37-b9b4-4a6b-aa4b-cbb916704460 service nova] Creating event network-vif-plugged:e3b95cb5-58ef-47b5-a24c-57117b4da068 for instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 on hv-cinder-85144 Jul 28 20:00:52.578273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-d980cc9b-e148-4be3-9f40-15bed26749b3 req-04ec4f37-b9b4-4a6b-aa4b-cbb916704460 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106972 Jul 28 20:00:52.587622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 184/357] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:00:53.121803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:53.122532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:53.130503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:53.131225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:53.132208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:53.132993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:53.309343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e2726d72-cb98-4f55-a012-d80d1886ee70 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:53.310190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e2726d72-cb98-4f55-a012-d80d1886ee70 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:53.341257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2726d72-cb98-4f55-a012-d80d1886ee70 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:53.341960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2726d72-cb98-4f55-a012-d80d1886ee70 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:53.345017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2726d72-cb98-4f55-a012-d80d1886ee70 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:53.345690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2726d72-cb98-4f55-a012-d80d1886ee70 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:53.350162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:00:53.429967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:53.441236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:53.446455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:53.448688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7758909d-dc56-4e75-895d-e20881a7d68c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.332443 Jul 28 20:00:53.449476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 174/358] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:53 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:53.484143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-003bb607-d5df-413f-86c8-82549071f6f9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:53.485223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-003bb607-d5df-413f-86c8-82549071f6f9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:53.537043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-003bb607-d5df-413f-86c8-82549071f6f9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:53.538305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-003bb607-d5df-413f-86c8-82549071f6f9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:53.539240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-003bb607-d5df-413f-86c8-82549071f6f9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:53.540351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-003bb607-d5df-413f-86c8-82549071f6f9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:53.865811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e2726d72-cb98-4f55-a012-d80d1886ee70 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:53.875474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e2726d72-cb98-4f55-a012-d80d1886ee70 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.571453 Jul 28 20:00:53.876845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 185/359] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:53.971476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-003bb607-d5df-413f-86c8-82549071f6f9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:53.996075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-003bb607-d5df-413f-86c8-82549071f6f9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.513556 Jul 28 20:00:53.997090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 175/360] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:53 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:54.483458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:54.484792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:54.501455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:54.504291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:54.505720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:54.507231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:54.615517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-abd41c6a-625d-4ddd-b303-1142d189da32 req-2bf51a6c-55e3-4ef1-a94c-cd37c269654d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cb56a8-6993-4767-9e30-5786f3b94743", "name": "network-vif-plugged", "status": "completed", "tag": "3420a2fe-6251-47ba-bc14-fdf7b2db8f58"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:54.642185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-abd41c6a-625d-4ddd-b303-1142d189da32 req-2bf51a6c-55e3-4ef1-a94c-cd37c269654d service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:54.642871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-abd41c6a-625d-4ddd-b303-1142d189da32 req-2bf51a6c-55e3-4ef1-a94c-cd37c269654d service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:54.661821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-abd41c6a-625d-4ddd-b303-1142d189da32 req-2bf51a6c-55e3-4ef1-a94c-cd37c269654d service nova] Creating event network-vif-plugged:3420a2fe-6251-47ba-bc14-fdf7b2db8f58 for instance c1cb56a8-6993-4767-9e30-5786f3b94743 on hv-cinder-85144 Jul 28 20:00:54.675665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-abd41c6a-625d-4ddd-b303-1142d189da32 req-2bf51a6c-55e3-4ef1-a94c-cd37c269654d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065026 Jul 28 20:00:54.678077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 176/361] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:00:54.845648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:54.857134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:54.870678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f5d551c2-ea11-4c57-b1be-15362ae9a068 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:54.871753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f5d551c2-ea11-4c57-b1be-15362ae9a068 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:54.878550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5d551c2-ea11-4c57-b1be-15362ae9a068 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:54.883553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:54.890201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-245f964f-c2ef-46de-b4b0-fe63496ad404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.410689 Jul 28 20:00:54.892978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5d551c2-ea11-4c57-b1be-15362ae9a068 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:54.893796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 186/362] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:54 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:54.894954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5d551c2-ea11-4c57-b1be-15362ae9a068 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:54.898119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5d551c2-ea11-4c57-b1be-15362ae9a068 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:54.928094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bbf1072a-20fe-4db4-b273-f74c4b1cfe5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:54.933392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bbf1072a-20fe-4db4-b273-f74c4b1cfe5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:54.976907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbf1072a-20fe-4db4-b273-f74c4b1cfe5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:54.977486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbf1072a-20fe-4db4-b273-f74c4b1cfe5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:54.978326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbf1072a-20fe-4db4-b273-f74c4b1cfe5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:54.978757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbf1072a-20fe-4db4-b273-f74c4b1cfe5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:55.691054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f5d551c2-ea11-4c57-b1be-15362ae9a068 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:55.703067 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f5d551c2-ea11-4c57-b1be-15362ae9a068 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1592 microversion: 2.1 time: 0.836679 Jul 28 20:00:55.725732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 177/363] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1592 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:55.731470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bbf1072a-20fe-4db4-b273-f74c4b1cfe5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:55.733906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fac09bf4-a8ad-48e8-9351-af5163d13600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:55.734667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fac09bf4-a8ad-48e8-9351-af5163d13600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:55.741598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fac09bf4-a8ad-48e8-9351-af5163d13600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:55.742287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fac09bf4-a8ad-48e8-9351-af5163d13600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:55.743205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fac09bf4-a8ad-48e8-9351-af5163d13600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:55.743849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fac09bf4-a8ad-48e8-9351-af5163d13600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:55.744386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bbf1072a-20fe-4db4-b273-f74c4b1cfe5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.834913 Jul 28 20:00:55.746712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 187/364] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:55.933953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:55.939258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:55.977623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:55.978522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:55.983271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:55.984235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:56.478512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fac09bf4-a8ad-48e8-9351-af5163d13600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:56.487653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fac09bf4-a8ad-48e8-9351-af5163d13600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.760775 Jul 28 20:00:56.491569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 178/365] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:55 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:56.591739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:56.604071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:56.608863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:56.610433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8d1732ab-a26a-47af-b71d-b1362d15c4a4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.693111 Jul 28 20:00:56.615682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 188/366] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:55 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:56.667284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1282265497", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "networks": [{"uuid": "d356d7f4-47c6-4d35-8584-ad706bd0c0af"}]}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:00:56.772443 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ced0f1e5-ec91-4d2b-a8a5-ea238bd4c8f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:56.773779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ced0f1e5-ec91-4d2b-a8a5-ea238bd4c8f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:56.787922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ced0f1e5-ec91-4d2b-a8a5-ea238bd4c8f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:56.793683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ced0f1e5-ec91-4d2b-a8a5-ea238bd4c8f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:56.805143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ced0f1e5-ec91-4d2b-a8a5-ea238bd4c8f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:56.805827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ced0f1e5-ec91-4d2b-a8a5-ea238bd4c8f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:57.367131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ced0f1e5-ec91-4d2b-a8a5-ea238bd4c8f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:57.383777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ced0f1e5-ec91-4d2b-a8a5-ea238bd4c8f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1368 microversion: 2.1 time: 0.614586 Jul 28 20:00:57.387725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 189/367] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1368 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:57.513136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b069079c-7064-43f1-9091-06185bbed863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:57.513136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b069079c-7064-43f1-9091-06185bbed863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:57.537235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b069079c-7064-43f1-9091-06185bbed863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:57.537835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b069079c-7064-43f1-9091-06185bbed863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:57.542206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b069079c-7064-43f1-9091-06185bbed863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:57.542823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b069079c-7064-43f1-9091-06185bbed863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:58.011436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] validate_networks() for [('d356d7f4-47c6-4d35-8584-ad706bd0c0af', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:00:58.079425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b069079c-7064-43f1-9091-06185bbed863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:58.091318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b069079c-7064-43f1-9091-06185bbed863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.583260 Jul 28 20:00:58.110066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 190/368] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:57 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:00:58.116419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:58.121818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:58.148787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:58.149517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:58.150465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:58.151053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:58.863436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:58.876080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:58.877662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:58.878859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-20dd9036-3356-4854-8490-eb2244172c62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.767463 Jul 28 20:00:58.909647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 191/369] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:00:58 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:00:58.936742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0aecb5bf-bae1-422b-9987-e6b17a01c113 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:58.938294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0aecb5bf-bae1-422b-9987-e6b17a01c113 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:58.965763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0aecb5bf-bae1-422b-9987-e6b17a01c113 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:58.966455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0aecb5bf-bae1-422b-9987-e6b17a01c113 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:58.985107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0aecb5bf-bae1-422b-9987-e6b17a01c113 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:58.985689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0aecb5bf-bae1-422b-9987-e6b17a01c113 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:59.532956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0aecb5bf-bae1-422b-9987-e6b17a01c113 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:00:59.544930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0aecb5bf-bae1-422b-9987-e6b17a01c113 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1558 microversion: 2.1 time: 0.633500 Jul 28 20:00:59.545872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 192/370] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1558 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:00:59.553820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dec3c0ff-4345-4a60-9d33-13eb6f45cc26 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:00:59.554422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dec3c0ff-4345-4a60-9d33-13eb6f45cc26 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:00:59.576907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dec3c0ff-4345-4a60-9d33-13eb6f45cc26 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:59.577628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dec3c0ff-4345-4a60-9d33-13eb6f45cc26 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:00:59.578573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dec3c0ff-4345-4a60-9d33-13eb6f45cc26 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:00:59.579153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dec3c0ff-4345-4a60-9d33-13eb6f45cc26 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:00.243430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:01:00.243929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:01:00.244315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:01:00.245088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:01:00.245511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:01:00.273784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:00.274240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:00.275045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:00.279188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:00.347506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Getting quotas for project cc82c1496470409ca70c8cc12023a91e. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:01:00.360380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Getting quotas for user 316033501d684cc680770c4ccda85d40 and project cc82c1496470409ca70c8cc12023a91e. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:01:00.380602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dec3c0ff-4345-4a60-9d33-13eb6f45cc26 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:00.393191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:01:00.397503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dec3c0ff-4345-4a60-9d33-13eb6f45cc26 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.847993 Jul 28 20:01:00.400660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:01:00.401509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 193/371] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:00:59 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:00.408086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a4a9b8c3-caef-4f29-b64e-c128274ce866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:00.413010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a4a9b8c3-caef-4f29-b64e-c128274ce866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:00.422835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a4a9b8c3-caef-4f29-b64e-c128274ce866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:00.427091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a4a9b8c3-caef-4f29-b64e-c128274ce866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:00.428242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a4a9b8c3-caef-4f29-b64e-c128274ce866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:00.438175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a4a9b8c3-caef-4f29-b64e-c128274ce866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:00.534584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-27b946c2-af68-4b53-bbc0-57f532814c91 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.871144 Jul 28 20:01:00.537029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 179/372] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:00:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:01:00.547825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-bc2a43b1-a785-416f-91b7-cc77a1c5a821 req-5c22e4c6-5e2b-4e0c-99b7-dcc6412bcb1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed7c90e0-e87c-42b9-b14d-6c06761c1eef", "tag": "65dd95c0-2195-45fd-8275-f4c90145660b"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:00.594308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-bc2a43b1-a785-416f-91b7-cc77a1c5a821 req-5c22e4c6-5e2b-4e0c-99b7-dcc6412bcb1b service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:00.605947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-bc2a43b1-a785-416f-91b7-cc77a1c5a821 req-5c22e4c6-5e2b-4e0c-99b7-dcc6412bcb1b service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:00.635012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-bc2a43b1-a785-416f-91b7-cc77a1c5a821 req-5c22e4c6-5e2b-4e0c-99b7-dcc6412bcb1b service nova] Creating event network-changed:65dd95c0-2195-45fd-8275-f4c90145660b for instance ed7c90e0-e87c-42b9-b14d-6c06761c1eef on hv-cinder-85144 Jul 28 20:01:00.647591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-bc2a43b1-a785-416f-91b7-cc77a1c5a821 req-5c22e4c6-5e2b-4e0c-99b7-dcc6412bcb1b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108965 Jul 28 20:01:00.650997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 180/373] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:00.659880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:00.660926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:00.683466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:00.684011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:00.685519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:00.685955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:00.745312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a4a9b8c3-caef-4f29-b64e-c128274ce866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.342349 Jul 28 20:01:00.746335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 194/374] 10.222.0.67 () {58 vars in 1275 bytes} [Thu Jul 28 20:01:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-interface => generated 284 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:00.752712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-16bf0555-4bc8-4aac-a371-da57c66fd3d4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:00.753777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-16bf0555-4bc8-4aac-a371-da57c66fd3d4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:01.239791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-16bf0555-4bc8-4aac-a371-da57c66fd3d4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:01.248890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-16bf0555-4bc8-4aac-a371-da57c66fd3d4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1219 microversion: 2.1 time: 0.501076 Jul 28 20:01:01.275398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 195/375] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:00 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1219 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:01.366833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:01.389865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:01.404165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:01.415304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e7e05fed-4cca-4934-b7d0-30f2245749e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.756211 Jul 28 20:01:01.427333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-86da0289-9f1c-45c5-a974-2d5c4d152043 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:01.429408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-86da0289-9f1c-45c5-a974-2d5c4d152043 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:01.436721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 181/376] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:00 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:01.443794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86da0289-9f1c-45c5-a974-2d5c4d152043 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:01.444385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86da0289-9f1c-45c5-a974-2d5c4d152043 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:01.445249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86da0289-9f1c-45c5-a974-2d5c4d152043 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:01.451693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86da0289-9f1c-45c5-a974-2d5c4d152043 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:02.260635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-86da0289-9f1c-45c5-a974-2d5c4d152043 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:02.271366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3a98272a-af4e-4a8c-9b8e-b4dc04de8e3a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:02.272225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3a98272a-af4e-4a8c-9b8e-b4dc04de8e3a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:02.282095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-86da0289-9f1c-45c5-a974-2d5c4d152043 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.858452 Jul 28 20:01:02.282773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 196/377] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:01 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:02.286859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a98272a-af4e-4a8c-9b8e-b4dc04de8e3a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:02.287392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a98272a-af4e-4a8c-9b8e-b4dc04de8e3a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:02.288179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a98272a-af4e-4a8c-9b8e-b4dc04de8e3a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:02.288650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a98272a-af4e-4a8c-9b8e-b4dc04de8e3a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:02.442301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:02.443147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:02.449517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:02.450003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:02.465778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:02.466331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:02.648186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3a98272a-af4e-4a8c-9b8e-b4dc04de8e3a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:02.663700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3a98272a-af4e-4a8c-9b8e-b4dc04de8e3a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1271 microversion: 2.1 time: 0.396126 Jul 28 20:01:02.664402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 182/378] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:02 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1271 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:02.813086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:02.827498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:02.829411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:02.830952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dd125259-6c0a-4956-aea4-966107ab12de tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.393469 Jul 28 20:01:02.832228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 197/379] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:02 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:03.309289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2d21b10d-ba71-40a8-946e-4c0a6d52988e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:03.310371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2d21b10d-ba71-40a8-946e-4c0a6d52988e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:03.323166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d21b10d-ba71-40a8-946e-4c0a6d52988e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:03.328968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d21b10d-ba71-40a8-946e-4c0a6d52988e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:03.331475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d21b10d-ba71-40a8-946e-4c0a6d52988e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:03.334029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d21b10d-ba71-40a8-946e-4c0a6d52988e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:03.704496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-09f0345a-0aa2-4984-90bc-823cd9c90aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:03.705160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-09f0345a-0aa2-4984-90bc-823cd9c90aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:03.745095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09f0345a-0aa2-4984-90bc-823cd9c90aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:03.745676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09f0345a-0aa2-4984-90bc-823cd9c90aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:03.746552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09f0345a-0aa2-4984-90bc-823cd9c90aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:03.746998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09f0345a-0aa2-4984-90bc-823cd9c90aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:03.859407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2d21b10d-ba71-40a8-946e-4c0a6d52988e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:03.868509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2d21b10d-ba71-40a8-946e-4c0a6d52988e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.563014 Jul 28 20:01:03.885015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 183/380] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:03 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:03.891975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:03.892957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:03.914770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:03.915441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:03.916434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:03.917138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:03.959138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-09f0345a-0aa2-4984-90bc-823cd9c90aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:03.998007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-09f0345a-0aa2-4984-90bc-823cd9c90aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1277 microversion: 2.1 time: 0.307343 Jul 28 20:01:03.998007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 198/381] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:03 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1277 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:04.230865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-0173da81-2e4f-4690-a927-7aa26a021b31 req-fb10496a-afef-4b73-8c79-877c4c3f0565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cb56a8-6993-4767-9e30-5786f3b94743", "tag": "3420a2fe-6251-47ba-bc14-fdf7b2db8f58"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:04.248006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-0173da81-2e4f-4690-a927-7aa26a021b31 req-fb10496a-afef-4b73-8c79-877c4c3f0565 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:04.248444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-0173da81-2e4f-4690-a927-7aa26a021b31 req-fb10496a-afef-4b73-8c79-877c4c3f0565 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:04.268962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-0173da81-2e4f-4690-a927-7aa26a021b31 req-fb10496a-afef-4b73-8c79-877c4c3f0565 service nova] Creating event network-changed:3420a2fe-6251-47ba-bc14-fdf7b2db8f58 for instance c1cb56a8-6993-4767-9e30-5786f3b94743 on hv-cinder-85144 Jul 28 20:01:04.291611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-0173da81-2e4f-4690-a927-7aa26a021b31 req-fb10496a-afef-4b73-8c79-877c4c3f0565 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065298 Jul 28 20:01:04.292255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 199/382] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:01:04.302021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-16214ee6-3deb-49f4-bb8a-fc133c6ed419 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1373572415"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:04.302647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-16214ee6-3deb-49f4-bb8a-fc133c6ed419 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:04.338008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16214ee6-3deb-49f4-bb8a-fc133c6ed419 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:04.339966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16214ee6-3deb-49f4-bb8a-fc133c6ed419 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:04.341090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16214ee6-3deb-49f4-bb8a-fc133c6ed419 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:04.341758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16214ee6-3deb-49f4-bb8a-fc133c6ed419 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:04.501459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:04.515671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:04.523087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:04.524306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d618883f-8a06-45d0-a76a-62f4b99b8daa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.637977 Jul 28 20:01:04.532574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 184/383] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:03 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:04.801983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.network.security_group_api [None req-16214ee6-3deb-49f4-bb8a-fc133c6ed419 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Adding security group 4b20e4aa-ef46-47b7-a721-cf509995fced to port 65dd95c0-2195-45fd-8275-f4c90145660b Jul 28 20:01:04.897874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-21e48e1c-e5eb-48b6-9128-949ca6c1fa2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:04.898620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-21e48e1c-e5eb-48b6-9128-949ca6c1fa2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:04.910522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21e48e1c-e5eb-48b6-9128-949ca6c1fa2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:04.911670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21e48e1c-e5eb-48b6-9128-949ca6c1fa2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:04.912777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21e48e1c-e5eb-48b6-9128-949ca6c1fa2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:04.913428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21e48e1c-e5eb-48b6-9128-949ca6c1fa2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:05.827721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-21e48e1c-e5eb-48b6-9128-949ca6c1fa2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:05.837547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-21e48e1c-e5eb-48b6-9128-949ca6c1fa2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.943946 Jul 28 20:01:05.861079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 185/384] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:04 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:05.867431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c5ec75f6-15b0-4f6f-a544-747431165c7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:05.868182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c5ec75f6-15b0-4f6f-a544-747431165c7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:05.875281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5ec75f6-15b0-4f6f-a544-747431165c7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:05.875869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5ec75f6-15b0-4f6f-a544-747431165c7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:05.876815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5ec75f6-15b0-4f6f-a544-747431165c7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:05.877700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5ec75f6-15b0-4f6f-a544-747431165c7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:06.341807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c5ec75f6-15b0-4f6f-a544-747431165c7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:06.353781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c5ec75f6-15b0-4f6f-a544-747431165c7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.491112 Jul 28 20:01:06.354596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 186/385] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:05 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:06.368658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:06.373598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:06.395042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:06.395824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:06.397034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:06.397473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:06.485209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-16214ee6-3deb-49f4-bb8a-fc133c6ed419 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/action" status: 202 len: 0 microversion: 2.1 time: 2.191614 Jul 28 20:01:06.490732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 200/386] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:01:04 2022] POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/action => generated 0 bytes in 2198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:01:06.496566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8526c50b-e702-4e8b-a206-86c69eb3f7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:06.497374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8526c50b-e702-4e8b-a206-86c69eb3f7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:06.516828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8526c50b-e702-4e8b-a206-86c69eb3f7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:06.517556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8526c50b-e702-4e8b-a206-86c69eb3f7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:06.518501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8526c50b-e702-4e8b-a206-86c69eb3f7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:06.520454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8526c50b-e702-4e8b-a206-86c69eb3f7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:07.057938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8526c50b-e702-4e8b-a206-86c69eb3f7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:07.064228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:07.088700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:07.092220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:07.093069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8526c50b-e702-4e8b-a206-86c69eb3f7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1756 microversion: 2.1 time: 0.593554 Jul 28 20:01:07.096835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-940a87bd-e2a8-44bb-ba4d-f616b1ff7a13 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.734140 Jul 28 20:01:07.110001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 201/387] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1756 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:07.113309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 187/388] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:06 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:07.124515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f5276103-0640-46df-b53d-cf762f6e5fdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:07.125153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f5276103-0640-46df-b53d-cf762f6e5fdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:07.144379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-cc2ecb8d-5992-44f6-b8c6-425d4d1e8f29 req-ad830171-bc4d-4191-a3f7-417beeffaa07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed7c90e0-e87c-42b9-b14d-6c06761c1eef", "tag": "65dd95c0-2195-45fd-8275-f4c90145660b"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:07.153516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5276103-0640-46df-b53d-cf762f6e5fdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:07.153970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5276103-0640-46df-b53d-cf762f6e5fdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:07.156080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5276103-0640-46df-b53d-cf762f6e5fdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:07.156637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-cc2ecb8d-5992-44f6-b8c6-425d4d1e8f29 req-ad830171-bc4d-4191-a3f7-417beeffaa07 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:07.157322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-cc2ecb8d-5992-44f6-b8c6-425d4d1e8f29 req-ad830171-bc4d-4191-a3f7-417beeffaa07 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:07.158951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5276103-0640-46df-b53d-cf762f6e5fdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:07.208965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-cc2ecb8d-5992-44f6-b8c6-425d4d1e8f29 req-ad830171-bc4d-4191-a3f7-417beeffaa07 service nova] Creating event network-changed:65dd95c0-2195-45fd-8275-f4c90145660b for instance ed7c90e0-e87c-42b9-b14d-6c06761c1eef on hv-cinder-85144 Jul 28 20:01:07.214617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-cc2ecb8d-5992-44f6-b8c6-425d4d1e8f29 req-ad830171-bc4d-4191-a3f7-417beeffaa07 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102949 Jul 28 20:01:07.215518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 202/389] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:07.382105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3e7f69b6-2dd8-4055-9f99-9559195a391a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:07.383053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3e7f69b6-2dd8-4055-9f99-9559195a391a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:07.397519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e7f69b6-2dd8-4055-9f99-9559195a391a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:07.398226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e7f69b6-2dd8-4055-9f99-9559195a391a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:07.406534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e7f69b6-2dd8-4055-9f99-9559195a391a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:07.408624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e7f69b6-2dd8-4055-9f99-9559195a391a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:07.411748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f5276103-0640-46df-b53d-cf762f6e5fdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:07.429915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f5276103-0640-46df-b53d-cf762f6e5fdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.312405 Jul 28 20:01:07.430512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 188/390] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:07 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:07.749264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3e7f69b6-2dd8-4055-9f99-9559195a391a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:07.770507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3e7f69b6-2dd8-4055-9f99-9559195a391a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.393782 Jul 28 20:01:07.772652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 203/391] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:07 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:08.146236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:08.146857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:08.154284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:08.154731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:08.155509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:08.155939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:08.449351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:08.451694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-27df5473-150f-4efd-bf2c-0854a1ceb086 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:08.452465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-27df5473-150f-4efd-bf2c-0854a1ceb086 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:08.464957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:08.468354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27df5473-150f-4efd-bf2c-0854a1ceb086 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:08.468558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:08.469622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b8298741-3d9d-4d96-8399-b756d0a469ee tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.327491 Jul 28 20:01:08.470192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27df5473-150f-4efd-bf2c-0854a1ceb086 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:08.474019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 189/392] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:08 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:08.492934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27df5473-150f-4efd-bf2c-0854a1ceb086 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:08.494022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27df5473-150f-4efd-bf2c-0854a1ceb086 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:08.574716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:08.862173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-27df5473-150f-4efd-bf2c-0854a1ceb086 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:08.876388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-27df5473-150f-4efd-bf2c-0854a1ceb086 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.428866 Jul 28 20:01:08.880626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 204/393] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:08 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:08.891977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-478901ab-2c94-456c-b107-e814968c58cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:08.899019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-478901ab-2c94-456c-b107-e814968c58cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:08.917547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-478901ab-2c94-456c-b107-e814968c58cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:08.919717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-478901ab-2c94-456c-b107-e814968c58cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:08.920577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-478901ab-2c94-456c-b107-e814968c58cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:08.921034 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-478901ab-2c94-456c-b107-e814968c58cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:09.016122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-84b59fc8-0983-49ef-82c8-90979ce01ca7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Action: 'create', calling method: .version_select at 0x7f50361f4940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1034975038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs4/EggDOiAqTA0QmqgOs9vv4RRwM5rQXcf34zGDQdhbaG1tkhHtjzLlQEBpF4MfvIvLkJ7dNZTkFJuhwigTysaQNJnDx3bNjBK4mVJvsYdjY9S4cstCyQFw4xfNZYDRw=="}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:09.042037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-84b59fc8-0983-49ef-82c8-90979ce01ca7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Getting quotas for project 25002b31f4fc4ec78222fc4919aa5fb2. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:01:09.046788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-84b59fc8-0983-49ef-82c8-90979ce01ca7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Getting quotas for user 5131b18108f64f11ac1e0f4866a9cb37 and project 25002b31f4fc4ec78222fc4919aa5fb2. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:01:09.087029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-84b59fc8-0983-49ef-82c8-90979ce01ca7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.477005 Jul 28 20:01:09.088132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 190/394] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:01:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:09.095687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-7e92b128-10ad-4bbb-bade-373389cc01ae req-379f03d7-c128-4496-a3f1-8ddad01eda3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0baea400-ce43-4ebf-839f-16ffa300fc75", "tag": "9f12bdbc-c381-4e57-824b-9c367b322bfe"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:09.111999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-7e92b128-10ad-4bbb-bade-373389cc01ae req-379f03d7-c128-4496-a3f1-8ddad01eda3e service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:09.112460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-7e92b128-10ad-4bbb-bade-373389cc01ae req-379f03d7-c128-4496-a3f1-8ddad01eda3e service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:09.118075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:09.127637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-7e92b128-10ad-4bbb-bade-373389cc01ae req-379f03d7-c128-4496-a3f1-8ddad01eda3e service nova] Creating event network-changed:9f12bdbc-c381-4e57-824b-9c367b322bfe for instance 0baea400-ce43-4ebf-839f-16ffa300fc75 on hv-cinder-85144 Jul 28 20:01:09.135425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-7e92b128-10ad-4bbb-bade-373389cc01ae req-379f03d7-c128-4496-a3f1-8ddad01eda3e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045489 Jul 28 20:01:09.146328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 191/395] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:09.246314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-478901ab-2c94-456c-b107-e814968c58cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:09.287854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-478901ab-2c94-456c-b107-e814968c58cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.395648 Jul 28 20:01:09.297199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 205/396] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:08 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:09.503747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:09.505037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:09.514206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:09.517105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:09.520091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:09.525933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:09.900775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e98466ac-45bb-483f-877f-17b49bc54447 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:09.901439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e98466ac-45bb-483f-877f-17b49bc54447 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:09.925212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e98466ac-45bb-483f-877f-17b49bc54447 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:09.928301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e98466ac-45bb-483f-877f-17b49bc54447 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:09.929507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e98466ac-45bb-483f-877f-17b49bc54447 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:09.930180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e98466ac-45bb-483f-877f-17b49bc54447 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:10.316155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:10.596503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e98466ac-45bb-483f-877f-17b49bc54447 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:10.607141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e98466ac-45bb-483f-877f-17b49bc54447 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.710391 Jul 28 20:01:10.612063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 206/397] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:09 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:10.635794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-edd33356-7901-4c33-87f6-d059c99b709d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:10.639112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-edd33356-7901-4c33-87f6-d059c99b709d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:10.669830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edd33356-7901-4c33-87f6-d059c99b709d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:10.670498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edd33356-7901-4c33-87f6-d059c99b709d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:10.674133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edd33356-7901-4c33-87f6-d059c99b709d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:10.675470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edd33356-7901-4c33-87f6-d059c99b709d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:10.725899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:10.752316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:10.755489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:10.758872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fb67760b-cd22-4efb-93d0-e9c55e032562 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 1.261110 Jul 28 20:01:10.762172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 192/398] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:09 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:10.980470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-edd33356-7901-4c33-87f6-d059c99b709d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:11.015098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-edd33356-7901-4c33-87f6-d059c99b709d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.399007 Jul 28 20:01:11.020644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 207/399] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:10 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:11.635942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-08132523-5c25-4c0e-bfc0-1c9a9c023a70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:11.636570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-08132523-5c25-4c0e-bfc0-1c9a9c023a70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:11.649456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08132523-5c25-4c0e-bfc0-1c9a9c023a70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:11.651543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08132523-5c25-4c0e-bfc0-1c9a9c023a70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:11.655345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08132523-5c25-4c0e-bfc0-1c9a9c023a70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:11.658428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08132523-5c25-4c0e-bfc0-1c9a9c023a70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:11.790947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:11.792448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:11.795784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:11.813305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:11.814543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:11.816018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:11.816796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:12.142153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:12.152846 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:12.161032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:12.163691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d71eee49-52f7-4cee-a5e6-18203c28cd7f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.377311 Jul 28 20:01:12.186762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 208/400] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:11 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:12.202951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5cc58701-4704-41ac-a55c-d2b134e74671 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:12.203819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5cc58701-4704-41ac-a55c-d2b134e74671 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:12.212155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cc58701-4704-41ac-a55c-d2b134e74671 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:12.212896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cc58701-4704-41ac-a55c-d2b134e74671 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:12.213825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cc58701-4704-41ac-a55c-d2b134e74671 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:12.217022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cc58701-4704-41ac-a55c-d2b134e74671 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:12.256763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-08132523-5c25-4c0e-bfc0-1c9a9c023a70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:12.274611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-08132523-5c25-4c0e-bfc0-1c9a9c023a70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.640198 Jul 28 20:01:12.275394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 193/401] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:11 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:12.495743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5cc58701-4704-41ac-a55c-d2b134e74671 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:12.503518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5cc58701-4704-41ac-a55c-d2b134e74671 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.315547 Jul 28 20:01:12.517821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 209/402] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:12 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:13.194937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:13.195606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:13.204357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.204818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.206793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.208497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.297062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2adc924a-67c8-4271-9600-edee51a17e12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:13.297756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2adc924a-67c8-4271-9600-edee51a17e12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:13.305707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2adc924a-67c8-4271-9600-edee51a17e12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.306161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2adc924a-67c8-4271-9600-edee51a17e12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.307153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2adc924a-67c8-4271-9600-edee51a17e12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.307507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2adc924a-67c8-4271-9600-edee51a17e12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.383955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:13.391803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:13.393353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:13.394485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-425c7d97-ebf6-4a00-8fdd-30ef13af7972 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.204401 Jul 28 20:01:13.395753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 194/403] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:13 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:13.448799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2adc924a-67c8-4271-9600-edee51a17e12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:13.456148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2adc924a-67c8-4271-9600-edee51a17e12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1503 microversion: 2.1 time: 0.162914 Jul 28 20:01:13.456729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 210/404] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:13 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:13.476955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14451d62-7f1c-4190-bf39-15f8366fcc33"}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:13.479310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:13.485471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.485905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.486648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.487069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.510539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Cannot 'attach_volume' instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d while it is in vm_state rescued Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: POST /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d/os-volume_attachments HTTP/1.1 Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 74 Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:01:13.512182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {"volumeAttachment": {"volumeId": "14451d62-7f1c-4190-bf39-15f8366fcc33"}} Jul 28 20:01:13.513773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Cannot 'attach_volume' instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d while it is in vm_state rescued Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': 'ea28ea30-1675-4f86-9a3d-8be8cf2b882d', 'body': {'volumeAttachment': {'volumeId': '14451d62-7f1c-4190-bf39-15f8366fcc33'}}} Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:01:13.514730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d while it is in vm_state rescued Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:01:13.516150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:01:13.517944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:01:13.517944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:01:13.517944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d while it is in vm_state rescued Jul 28 20:01:13.517944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:01:13.517944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 409 to user: Cannot 'attach_volume' instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d while it is in vm_state rescued {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:01:13.517944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-32943fa3-57cf-4a75-a5af-2a9054347412 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040824 Jul 28 20:01:13.517944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 195/405] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:01:13 2022] POST /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 20:01:13.523570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2c96dbc3-0358-454e-9f5a-327a1cab3f62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:13.524101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2c96dbc3-0358-454e-9f5a-327a1cab3f62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:13.524454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0d68aacc-a7a5-4f17-89c3-684652553074 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:13.525092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0d68aacc-a7a5-4f17-89c3-684652553074 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:13.530102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c96dbc3-0358-454e-9f5a-327a1cab3f62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.530547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c96dbc3-0358-454e-9f5a-327a1cab3f62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.530917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d68aacc-a7a5-4f17-89c3-684652553074 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.531318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c96dbc3-0358-454e-9f5a-327a1cab3f62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.531433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d68aacc-a7a5-4f17-89c3-684652553074 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.531750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c96dbc3-0358-454e-9f5a-327a1cab3f62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.532121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d68aacc-a7a5-4f17-89c3-684652553074 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.532565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d68aacc-a7a5-4f17-89c3-684652553074 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.598579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2c96dbc3-0358-454e-9f5a-327a1cab3f62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d/action" status: 202 len: 0 microversion: 2.1 time: 0.079479 Jul 28 20:01:13.602085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 211/406] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:01:13 2022] POST /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 20:01:13.607400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f510eb80-0e2a-41cd-a821-6f8da9dbc206 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:13.608094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f510eb80-0e2a-41cd-a821-6f8da9dbc206 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:13.615066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f510eb80-0e2a-41cd-a821-6f8da9dbc206 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.615518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f510eb80-0e2a-41cd-a821-6f8da9dbc206 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.616280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f510eb80-0e2a-41cd-a821-6f8da9dbc206 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:13.616757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f510eb80-0e2a-41cd-a821-6f8da9dbc206 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:13.675207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0d68aacc-a7a5-4f17-89c3-684652553074 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:13.685510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0d68aacc-a7a5-4f17-89c3-684652553074 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.164718 Jul 28 20:01:13.686093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 196/407] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:13 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:13.771541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f510eb80-0e2a-41cd-a821-6f8da9dbc206 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:13.779229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f510eb80-0e2a-41cd-a821-6f8da9dbc206 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1511 microversion: 2.1 time: 0.175760 Jul 28 20:01:13.779781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 212/408] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:13 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:14.418482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:14.419506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:14.426561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:14.427055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:14.427724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:14.428151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:14.560897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:14.568967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:14.570451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:14.571581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8e7fd74d-7c50-4500-b576-8ce284cba7d7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.157183 Jul 28 20:01:14.572117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 197/409] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:14 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:14.706824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-51c73cb2-67a0-4bc6-a7be-f14ae9978749 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:14.707967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-51c73cb2-67a0-4bc6-a7be-f14ae9978749 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:14.714513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51c73cb2-67a0-4bc6-a7be-f14ae9978749 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:14.714963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51c73cb2-67a0-4bc6-a7be-f14ae9978749 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:14.715724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51c73cb2-67a0-4bc6-a7be-f14ae9978749 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:14.716162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51c73cb2-67a0-4bc6-a7be-f14ae9978749 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:14.800898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9e46aeec-6eca-41c5-bacb-b7494bfeeb6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:14.801500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9e46aeec-6eca-41c5-bacb-b7494bfeeb6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:14.807522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9e46aeec-6eca-41c5-bacb-b7494bfeeb6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:14.807965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9e46aeec-6eca-41c5-bacb-b7494bfeeb6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:14.808752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9e46aeec-6eca-41c5-bacb-b7494bfeeb6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:14.809187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9e46aeec-6eca-41c5-bacb-b7494bfeeb6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:14.844259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-51c73cb2-67a0-4bc6-a7be-f14ae9978749 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:14.852045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-51c73cb2-67a0-4bc6-a7be-f14ae9978749 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.149068 Jul 28 20:01:14.852624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 213/410] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:14 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:14.938826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9e46aeec-6eca-41c5-bacb-b7494bfeeb6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:14.947165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9e46aeec-6eca-41c5-bacb-b7494bfeeb6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1511 microversion: 2.1 time: 0.150015 Jul 28 20:01:14.947711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 198/411] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:14 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:15.595787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:15.596393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:15.603156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:15.603602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:15.604359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:15.604826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:15.737972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:15.748109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:15.751097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:15.753305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-411673df-4897-4438-9937-0a452ae6aa07 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1738 microversion: 2.20 time: 0.161073 Jul 28 20:01:15.754321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 214/412] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:15 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:15.873216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4b302e34-4092-4fbc-9f18-3a0f699658d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:15.873789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4b302e34-4092-4fbc-9f18-3a0f699658d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:15.880241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b302e34-4092-4fbc-9f18-3a0f699658d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:15.880717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b302e34-4092-4fbc-9f18-3a0f699658d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:15.881533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b302e34-4092-4fbc-9f18-3a0f699658d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:15.881968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b302e34-4092-4fbc-9f18-3a0f699658d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:15.968842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3c367fd5-9feb-4e20-8c8d-04212b2501a3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:15.969946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3c367fd5-9feb-4e20-8c8d-04212b2501a3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:15.980034 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c367fd5-9feb-4e20-8c8d-04212b2501a3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:15.980552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c367fd5-9feb-4e20-8c8d-04212b2501a3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:15.981327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c367fd5-9feb-4e20-8c8d-04212b2501a3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:15.981760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c367fd5-9feb-4e20-8c8d-04212b2501a3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:16.035352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4b302e34-4092-4fbc-9f18-3a0f699658d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:16.043551 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4b302e34-4092-4fbc-9f18-3a0f699658d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.174511 Jul 28 20:01:16.044229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 199/413] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:15 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:16.124620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3c367fd5-9feb-4e20-8c8d-04212b2501a3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:16.133612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3c367fd5-9feb-4e20-8c8d-04212b2501a3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1511 microversion: 2.1 time: 0.168602 Jul 28 20:01:16.134297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 215/414] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:15 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:16.781343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:16.781936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:16.788741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:16.789175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:16.789915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:16.790333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:16.920179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:16.929597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:16.931307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:16.932532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-93c5f0e9-4a9b-4b56-8ad5-0477f2f7cb00 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1720 microversion: 2.20 time: 0.155136 Jul 28 20:01:16.933111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 200/415] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:16 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:17.064472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c49bc0e8-2fad-4071-94b7-16f2589718ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:17.065117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c49bc0e8-2fad-4071-94b7-16f2589718ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:17.068274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=76 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:17.073786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c49bc0e8-2fad-4071-94b7-16f2589718ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:17.074234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c49bc0e8-2fad-4071-94b7-16f2589718ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:17.074999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c49bc0e8-2fad-4071-94b7-16f2589718ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:17.075429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c49bc0e8-2fad-4071-94b7-16f2589718ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:17.155274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ea23a33c-6a92-4191-bc1d-453ca1c17863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:17.156666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ea23a33c-6a92-4191-bc1d-453ca1c17863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:17.163863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea23a33c-6a92-4191-bc1d-453ca1c17863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:17.164596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea23a33c-6a92-4191-bc1d-453ca1c17863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:17.168771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea23a33c-6a92-4191-bc1d-453ca1c17863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:17.169459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea23a33c-6a92-4191-bc1d-453ca1c17863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:17.227747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c49bc0e8-2fad-4071-94b7-16f2589718ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:17.236187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c49bc0e8-2fad-4071-94b7-16f2589718ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.175453 Jul 28 20:01:17.237273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 216/416] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:17 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:17.337982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ea23a33c-6a92-4191-bc1d-453ca1c17863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:17.349263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ea23a33c-6a92-4191-bc1d-453ca1c17863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1511 microversion: 2.1 time: 0.197736 Jul 28 20:01:17.349842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 201/417] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:17 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:17.956046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:17.956691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:17.963230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:17.963671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:17.964424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:17.964879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:18.095912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:18.103824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:18.105363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:18.106557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3bd0dc31-a40f-4fda-9a68-c218bca0c071 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1720 microversion: 2.20 time: 0.154442 Jul 28 20:01:18.107063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 217/418] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:17 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:18.258024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7249800c-b2bc-47ee-b4fe-3054d680d725 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:18.258591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7249800c-b2bc-47ee-b4fe-3054d680d725 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:18.264499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7249800c-b2bc-47ee-b4fe-3054d680d725 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:18.264966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7249800c-b2bc-47ee-b4fe-3054d680d725 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:18.265699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7249800c-b2bc-47ee-b4fe-3054d680d725 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:18.266121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7249800c-b2bc-47ee-b4fe-3054d680d725 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:18.370604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6c391ade-a7c5-475d-8c9d-619470a1f2ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:18.371205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6c391ade-a7c5-475d-8c9d-619470a1f2ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:18.377103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c391ade-a7c5-475d-8c9d-619470a1f2ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:18.377544 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c391ade-a7c5-475d-8c9d-619470a1f2ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:18.378286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c391ade-a7c5-475d-8c9d-619470a1f2ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:18.378750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c391ade-a7c5-475d-8c9d-619470a1f2ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:18.400212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7249800c-b2bc-47ee-b4fe-3054d680d725 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:18.407835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7249800c-b2bc-47ee-b4fe-3054d680d725 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.154251 Jul 28 20:01:18.408675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 202/419] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:18 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:18.518885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6c391ade-a7c5-475d-8c9d-619470a1f2ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:18.526875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6c391ade-a7c5-475d-8c9d-619470a1f2ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1511 microversion: 2.1 time: 0.160156 Jul 28 20:01:18.527428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 218/420] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:18 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:19.131671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:19.132408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:19.134583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=10 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:19.140397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:19.140669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:19.141437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:19.141903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:19.282531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:19.291317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:19.292927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:19.294075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-50980577-8b75-4079-a1d0-21a82417e5ac tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1720 microversion: 2.20 time: 0.167914 Jul 28 20:01:19.294958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 203/421] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:19 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:19.430018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-153eec06-0a5c-40c6-8e46-544d237ce9a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:19.430621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-153eec06-0a5c-40c6-8e46-544d237ce9a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:19.437065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-153eec06-0a5c-40c6-8e46-544d237ce9a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:19.437506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-153eec06-0a5c-40c6-8e46-544d237ce9a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:19.438256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-153eec06-0a5c-40c6-8e46-544d237ce9a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:19.438683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-153eec06-0a5c-40c6-8e46-544d237ce9a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:19.549647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7035e025-ccb5-4db1-b312-374d074e96f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:19.550473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7035e025-ccb5-4db1-b312-374d074e96f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:19.569353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7035e025-ccb5-4db1-b312-374d074e96f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:19.569807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7035e025-ccb5-4db1-b312-374d074e96f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:19.570835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7035e025-ccb5-4db1-b312-374d074e96f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:19.571338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7035e025-ccb5-4db1-b312-374d074e96f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:19.571891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-153eec06-0a5c-40c6-8e46-544d237ce9a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:19.575275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:19.579835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-153eec06-0a5c-40c6-8e46-544d237ce9a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.154623 Jul 28 20:01:19.580397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 219/422] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:19 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:19.708941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7035e025-ccb5-4db1-b312-374d074e96f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:19.716395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7035e025-ccb5-4db1-b312-374d074e96f7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1511 microversion: 2.1 time: 0.170899 Jul 28 20:01:19.716978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 204/423] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:19 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:20.319753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:20.320391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:20.327074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:20.327518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:20.328271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:20.328733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:20.468126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:20.476195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:20.477722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:20.478862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c99da382-e4d6-4a21-aec1-c5fa8e519c05 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1720 microversion: 2.20 time: 0.164539 Jul 28 20:01:20.479403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 220/424] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:20 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:20.601334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6a7a339c-ddac-41f6-99cd-3eee1ed440cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:20.601939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6a7a339c-ddac-41f6-99cd-3eee1ed440cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:20.604861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:20.608752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a7a339c-ddac-41f6-99cd-3eee1ed440cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:20.609196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a7a339c-ddac-41f6-99cd-3eee1ed440cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:20.609951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a7a339c-ddac-41f6-99cd-3eee1ed440cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:20.610384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a7a339c-ddac-41f6-99cd-3eee1ed440cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:20.738486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4a5d3513-0524-4572-b4ec-dcc281294b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:20.739845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4a5d3513-0524-4572-b4ec-dcc281294b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:20.746159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a5d3513-0524-4572-b4ec-dcc281294b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:20.746607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a5d3513-0524-4572-b4ec-dcc281294b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:20.747365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a5d3513-0524-4572-b4ec-dcc281294b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:20.747955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a5d3513-0524-4572-b4ec-dcc281294b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:20.758565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6a7a339c-ddac-41f6-99cd-3eee1ed440cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:20.768376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6a7a339c-ddac-41f6-99cd-3eee1ed440cb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.170516 Jul 28 20:01:20.768986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 205/425] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:20 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:20.890772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4a5d3513-0524-4572-b4ec-dcc281294b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:20.898841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4a5d3513-0524-4572-b4ec-dcc281294b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1511 microversion: 2.1 time: 0.163987 Jul 28 20:01:20.899415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 221/426] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:20 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:21.374101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-5a113b3e-3935-4b1b-9b38-cc15c7b89710 req-7e929a17-8c5b-41b7-a6da-7062ed77ac4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baea400-ce43-4ebf-839f-16ffa300fc75", "name": "network-vif-plugged", "status": "completed", "tag": "9f12bdbc-c381-4e57-824b-9c367b322bfe"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:21.389395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-5a113b3e-3935-4b1b-9b38-cc15c7b89710 req-7e929a17-8c5b-41b7-a6da-7062ed77ac4f service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:21.389916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-5a113b3e-3935-4b1b-9b38-cc15c7b89710 req-7e929a17-8c5b-41b7-a6da-7062ed77ac4f service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:21.404899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-5a113b3e-3935-4b1b-9b38-cc15c7b89710 req-7e929a17-8c5b-41b7-a6da-7062ed77ac4f service nova] Creating event network-vif-plugged:9f12bdbc-c381-4e57-824b-9c367b322bfe for instance 0baea400-ce43-4ebf-839f-16ffa300fc75 on hv-cinder-85144 Jul 28 20:01:21.410574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-5a113b3e-3935-4b1b-9b38-cc15c7b89710 req-7e929a17-8c5b-41b7-a6da-7062ed77ac4f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040996 Jul 28 20:01:21.411580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 206/427] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:21.502590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:21.503835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:21.511329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:21.511896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:21.512841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:21.513469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:21.703361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:21.712284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:21.713846 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:21.714994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-08648ccf-933e-4d91-8aaf-ce8454915746 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1720 microversion: 2.20 time: 0.216416 Jul 28 20:01:21.715552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 222/428] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:21 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:21.791094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-47c3f59a-220c-4e4c-92b9-6cd40c23eec7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:21.792624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-47c3f59a-220c-4e4c-92b9-6cd40c23eec7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:21.801747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47c3f59a-220c-4e4c-92b9-6cd40c23eec7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:21.802569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47c3f59a-220c-4e4c-92b9-6cd40c23eec7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:21.803407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47c3f59a-220c-4e4c-92b9-6cd40c23eec7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:21.803864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47c3f59a-220c-4e4c-92b9-6cd40c23eec7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:21.922357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5077d2d1-d5d0-4b15-a0ab-057e748726f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:21.923593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5077d2d1-d5d0-4b15-a0ab-057e748726f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:21.942140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5077d2d1-d5d0-4b15-a0ab-057e748726f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:21.943254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5077d2d1-d5d0-4b15-a0ab-057e748726f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:21.945098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5077d2d1-d5d0-4b15-a0ab-057e748726f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:21.946992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5077d2d1-d5d0-4b15-a0ab-057e748726f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:21.959670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-47c3f59a-220c-4e4c-92b9-6cd40c23eec7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:21.968856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-47c3f59a-220c-4e4c-92b9-6cd40c23eec7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.183232 Jul 28 20:01:21.969624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 207/429] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:21 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:22.108709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5077d2d1-d5d0-4b15-a0ab-057e748726f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:22.116767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5077d2d1-d5d0-4b15-a0ab-057e748726f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1517 microversion: 2.1 time: 0.198401 Jul 28 20:01:22.117640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 223/430] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:21 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1517 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:22.738029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:22.738626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:22.746071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:22.746507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:22.747255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:22.747675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:22.881300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:22.888986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:22.890631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:22.891810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d29c0b71-77c2-47ac-8ba5-1da60b1fe5e9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1663 microversion: 2.20 time: 0.157639 Jul 28 20:01:22.892352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 208/431] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:22 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:22.914883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-945f20b5-ded8-4b41-a40d-a5e77089fc21 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8178062c-23f8-434b-a7fe-c00c03ab56e0"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:22.918180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-945f20b5-ded8-4b41-a40d-a5e77089fc21 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:22.924093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-945f20b5-ded8-4b41-a40d-a5e77089fc21 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:22.924673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-945f20b5-ded8-4b41-a40d-a5e77089fc21 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:22.925642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-945f20b5-ded8-4b41-a40d-a5e77089fc21 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:22.926146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-945f20b5-ded8-4b41-a40d-a5e77089fc21 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:22.990391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a0fb3c94-6602-43ae-91d9-adf5c9641104 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:22.991246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a0fb3c94-6602-43ae-91d9-adf5c9641104 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:22.998106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0fb3c94-6602-43ae-91d9-adf5c9641104 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:22.998948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0fb3c94-6602-43ae-91d9-adf5c9641104 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:23.000177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0fb3c94-6602-43ae-91d9-adf5c9641104 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:23.000809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0fb3c94-6602-43ae-91d9-adf5c9641104 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:23.024398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:23.181816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a0fb3c94-6602-43ae-91d9-adf5c9641104 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:23.191270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a0fb3c94-6602-43ae-91d9-adf5c9641104 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1319 microversion: 2.1 time: 0.204694 Jul 28 20:01:23.192711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 209/432] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:22 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:23.269562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-945f20b5-ded8-4b41-a40d-a5e77089fc21 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "POST /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.358711 Jul 28 20:01:23.270225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 224/433] 10.222.0.67 () {62 vars in 1364 bytes} [Thu Jul 28 20:01:22 2022] POST /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 188 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:01:23.391951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0bc4096f-15ae-4f99-b1fe-84e9bb7a9c85 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:23.392566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0bc4096f-15ae-4f99-b1fe-84e9bb7a9c85 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:23.398508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0bc4096f-15ae-4f99-b1fe-84e9bb7a9c85 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:23.398955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0bc4096f-15ae-4f99-b1fe-84e9bb7a9c85 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:23.400978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0bc4096f-15ae-4f99-b1fe-84e9bb7a9c85 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:23.401421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0bc4096f-15ae-4f99-b1fe-84e9bb7a9c85 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:23.433974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-d594d705-ad21-42e1-9a6b-c68a2fccb9e6 req-ddca1644-cbb5-45ba-bf13-509667ca396d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4889e06d-18cf-4e5e-9f68-8c168109c1d3", "name": "network-vif-unplugged", "status": "completed", "tag": "e3b95cb5-58ef-47b5-a24c-57117b4da068"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:23.444709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-d594d705-ad21-42e1-9a6b-c68a2fccb9e6 req-ddca1644-cbb5-45ba-bf13-509667ca396d service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:23.445236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-d594d705-ad21-42e1-9a6b-c68a2fccb9e6 req-ddca1644-cbb5-45ba-bf13-509667ca396d service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:23.449625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0bc4096f-15ae-4f99-b1fe-84e9bb7a9c85 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117969) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 20:01:23.458460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.compute.server_external_events [req-d594d705-ad21-42e1-9a6b-c68a2fccb9e6 req-ddca1644-cbb5-45ba-bf13-509667ca396d service nova] Unable to find a host for instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3. Dropping event network-vif-unplugged {{(pid=117968) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 20:01:23.459816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-d594d705-ad21-42e1-9a6b-c68a2fccb9e6 req-ddca1644-cbb5-45ba-bf13-509667ca396d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029645 Jul 28 20:01:23.460567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 225/434] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 20:01:23.526978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0bc4096f-15ae-4f99-b1fe-84e9bb7a9c85 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "POST /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/action" status: 202 len: 0 microversion: 2.20 time: 0.138828 Jul 28 20:01:23.527748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 210/435] 10.222.0.67 () {62 vars in 1319 bytes} [Thu Jul 28 20:01:23 2022] POST /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:01:23.537696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:23.538419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:23.545082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:23.545627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:23.546670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:23.547304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:23.563984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6df2c221-5a9b-4c90-8a92-74a40c539443 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'create', calling method: .version_select at 0x7f5036271c10>, body: {"keypair": {"name": "tempest-keypair-933113843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+6zTl9yGLBKzw20yjfoYa0BRUXZW756MbbmnSI37GQbMi1Xgu2v6BgGJYNM9F6QJxVETtCVnzmdr9IH1kZab66LhB7YtiguSpbEdsmONyHibaR+4K9ufvzQZtJSxA59w=="}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:23.584649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-6df2c221-5a9b-4c90-8a92-74a40c539443 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Getting quotas for project 4cc8b359904d4304a7b25954a46ae97b. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:01:23.589423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-6df2c221-5a9b-4c90-8a92-74a40c539443 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Getting quotas for user 5be80ca35c954fdb963d6dc278fd62d3 and project 4cc8b359904d4304a7b25954a46ae97b. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:01:23.621445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6df2c221-5a9b-4c90-8a92-74a40c539443 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063418 Jul 28 20:01:23.622198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 211/436] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:01:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:23.711885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:23.727755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:23.729411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:23.730686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bcf6f429-a088-4348-83f2-65a5f1857f75 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1749 microversion: 2.20 time: 0.198925 Jul 28 20:01:23.731724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 226/437] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:23 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1749 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:24.216686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-317ec5c4-26e3-4b08-9418-e190841b53d5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:24.217305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-317ec5c4-26e3-4b08-9418-e190841b53d5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:24.229900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-317ec5c4-26e3-4b08-9418-e190841b53d5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:24.230463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-317ec5c4-26e3-4b08-9418-e190841b53d5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:24.231348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-317ec5c4-26e3-4b08-9418-e190841b53d5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:24.231898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-317ec5c4-26e3-4b08-9418-e190841b53d5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:24.417618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-317ec5c4-26e3-4b08-9418-e190841b53d5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:24.428195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-317ec5c4-26e3-4b08-9418-e190841b53d5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1508 microversion: 2.1 time: 0.216918 Jul 28 20:01:24.432121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 212/438] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:24 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:24.768264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:24.770556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:24.781687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:24.782315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:24.784254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:24.785185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:25.007502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:25.016904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:25.018448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:25.019681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0f0d7e88-fb59-411f-954b-72135d173ee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1749 microversion: 2.20 time: 0.261073 Jul 28 20:01:25.021494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 227/439] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:24 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1749 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:25.606464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-736331023", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "345252fa-83ab-4000-840a-bbb735e163c1"}], "security_groups": [{"name": "tempest-securitygroup--1176462877"}], "key_name": "tempest-keypair-933113843", "user_data": "}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:25.721680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] validate_networks() for [('345252fa-83ab-4000-840a-bbb735e163c1', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:01:26.045385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:26.046719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:26.064406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:26.064887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:26.065662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:26.075091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:26.332407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:26.343058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:26.344566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:26.345731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6429fa11-fb46-42d0-8214-f794430cd1fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1751 microversion: 2.20 time: 0.304784 Jul 28 20:01:26.346289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 228/440] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:26 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1751 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:26.381935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:01:26.382528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:01:26.383002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:01:26.383405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:01:26.383812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:01:26.393769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:26.394412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:26.396446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:26.397241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:26.418730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Getting quotas for project 4cc8b359904d4304a7b25954a46ae97b. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:01:26.423867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Getting quotas for user 5be80ca35c954fdb963d6dc278fd62d3 and project 4cc8b359904d4304a7b25954a46ae97b. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:01:26.436693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:01:26.439391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:01:26.486893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a2dc0727-606c-4e5e-959a-9e1566fdbeae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.884795 Jul 28 20:01:26.487556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 213/441] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:01:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:01:26.499409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-093dff2f-ccd5-4c4e-b623-b5f04d300bc6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:26.500270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-093dff2f-ccd5-4c4e-b623-b5f04d300bc6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:26.564811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-093dff2f-ccd5-4c4e-b623-b5f04d300bc6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:26.576641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-093dff2f-ccd5-4c4e-b623-b5f04d300bc6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1244 microversion: 2.1 time: 0.081346 Jul 28 20:01:26.577226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 229/442] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:27.371683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:27.372999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:27.384483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:27.385236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:27.386197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:27.386813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:27.549803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:27.558835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:27.560340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:27.561524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-15cd163b-7672-4496-85c4-937824de034d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.194767 Jul 28 20:01:27.562065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 214/443] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:27 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:27.602079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0cb01872-bb2a-4684-bbec-a976df8572f5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:27.602767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0cb01872-bb2a-4684-bbec-a976df8572f5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:27.609628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0cb01872-bb2a-4684-bbec-a976df8572f5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:27.610075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0cb01872-bb2a-4684-bbec-a976df8572f5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:27.610836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0cb01872-bb2a-4684-bbec-a976df8572f5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:27.611260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0cb01872-bb2a-4684-bbec-a976df8572f5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:27.675151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0cb01872-bb2a-4684-bbec-a976df8572f5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:27.683130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0cb01872-bb2a-4684-bbec-a976df8572f5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1296 microversion: 2.1 time: 0.085737 Jul 28 20:01:27.683678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 230/444] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:28.586170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:28.587132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:28.595251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:28.602891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:28.603941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:28.604508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:28.715945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7aca6513-fc98-4942-9910-d8fb7f6f1ded tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:28.717632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7aca6513-fc98-4942-9910-d8fb7f6f1ded tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:28.729116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7aca6513-fc98-4942-9910-d8fb7f6f1ded tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:28.729847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7aca6513-fc98-4942-9910-d8fb7f6f1ded tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:28.731038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7aca6513-fc98-4942-9910-d8fb7f6f1ded tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:28.731794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7aca6513-fc98-4942-9910-d8fb7f6f1ded tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:28.779671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:28.790456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:28.791960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:28.793325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f7a065af-d156-400d-b5ff-d5befa3fdc2c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.211605 Jul 28 20:01:28.794333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 215/445] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:28 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:28.815525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7aca6513-fc98-4942-9910-d8fb7f6f1ded tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:28.827917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7aca6513-fc98-4942-9910-d8fb7f6f1ded tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1302 microversion: 2.1 time: 0.125320 Jul 28 20:01:28.828914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 231/446] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1302 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:29.586101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-d552423a-556f-4979-ae6c-90e1ab62722f req-3ed72cd5-f851-4088-a611-363a0f46d2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0038fe10-b9ea-4fe0-a220-9c2ab37f67ed", "tag": "6dbb0ebe-84c3-436a-9f54-19cbea4b1db1"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:29.610197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-d552423a-556f-4979-ae6c-90e1ab62722f req-3ed72cd5-f851-4088-a611-363a0f46d2d8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:29.611506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-d552423a-556f-4979-ae6c-90e1ab62722f req-3ed72cd5-f851-4088-a611-363a0f46d2d8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:29.648329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-d552423a-556f-4979-ae6c-90e1ab62722f req-3ed72cd5-f851-4088-a611-363a0f46d2d8 service nova] Creating event network-changed:6dbb0ebe-84c3-436a-9f54-19cbea4b1db1 for instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed on hv-cinder-85144 Jul 28 20:01:29.653793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-d552423a-556f-4979-ae6c-90e1ab62722f req-3ed72cd5-f851-4088-a611-363a0f46d2d8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071857 Jul 28 20:01:29.657585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 216/447] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:29.818973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:29.819692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:29.833260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:29.836589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:29.836589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:29.836589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:29.852085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-582acf16-b543-4b82-962b-7424f6e155d7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:29.853845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-582acf16-b543-4b82-962b-7424f6e155d7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:29.872329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-582acf16-b543-4b82-962b-7424f6e155d7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:29.873089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-582acf16-b543-4b82-962b-7424f6e155d7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:29.873868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-582acf16-b543-4b82-962b-7424f6e155d7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:29.874299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-582acf16-b543-4b82-962b-7424f6e155d7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:30.094600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:30.098743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-582acf16-b543-4b82-962b-7424f6e155d7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:30.106523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:30.108951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:30.111151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-746ed62f-c1ff-43af-8961-a0c379ee9d98 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.296104 Jul 28 20:01:30.111590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-582acf16-b543-4b82-962b-7424f6e155d7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.264134 Jul 28 20:01:30.112468 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 217/448] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:29 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:30.127496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 232/449] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:29 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:31.132754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-94d637ef-737e-4340-b34f-34b4c142ad9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:31.133359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-94d637ef-737e-4340-b34f-34b4c142ad9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:31.139288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94d637ef-737e-4340-b34f-34b4c142ad9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:31.139722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94d637ef-737e-4340-b34f-34b4c142ad9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:31.140493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94d637ef-737e-4340-b34f-34b4c142ad9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:31.140981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94d637ef-737e-4340-b34f-34b4c142ad9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:31.143499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:31.144418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:31.150651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:31.151089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:31.152515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:31.152949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:31.367310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-94d637ef-737e-4340-b34f-34b4c142ad9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:31.374388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:31.382411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-94d637ef-737e-4340-b34f-34b4c142ad9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.253087 Jul 28 20:01:31.383657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 218/450] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:31.386597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:31.391046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:31.392688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f752c9b6-37a2-4bef-8f74-2a77a20f573e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.253290 Jul 28 20:01:31.393224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 233/451] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:31 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:32.406378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9de380e7-f100-4a19-9f1b-0c727f6f1cdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:32.406991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9de380e7-f100-4a19-9f1b-0c727f6f1cdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:32.414634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9de380e7-f100-4a19-9f1b-0c727f6f1cdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:32.415347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9de380e7-f100-4a19-9f1b-0c727f6f1cdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:32.416488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9de380e7-f100-4a19-9f1b-0c727f6f1cdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:32.417219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9de380e7-f100-4a19-9f1b-0c727f6f1cdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:32.419097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:32.419718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:32.431336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:32.432315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:32.438700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:32.444338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:32.625250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9de380e7-f100-4a19-9f1b-0c727f6f1cdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:32.633307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9de380e7-f100-4a19-9f1b-0c727f6f1cdf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.230727 Jul 28 20:01:32.633937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 219/452] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:32.683124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:32.691704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:32.693875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:32.695297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-21c5bc77-4c0b-4665-867a-ef5b28a51417 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.280105 Jul 28 20:01:32.695985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 234/453] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:32 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:33.654240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b8975004-c5d2-46f5-b67c-523797ee9d4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:33.654736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b8975004-c5d2-46f5-b67c-523797ee9d4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:33.662460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8975004-c5d2-46f5-b67c-523797ee9d4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:33.662921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8975004-c5d2-46f5-b67c-523797ee9d4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:33.663694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8975004-c5d2-46f5-b67c-523797ee9d4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:33.664126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8975004-c5d2-46f5-b67c-523797ee9d4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:33.720656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:33.721360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:33.748043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:33.748838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:33.749646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:33.750427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:33.809243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:34.019011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8975004-c5d2-46f5-b67c-523797ee9d4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:34.027980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b8975004-c5d2-46f5-b67c-523797ee9d4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.377733 Jul 28 20:01:34.028723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 220/454] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:34.065407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:34.074928 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:34.076706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:34.078228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a483fd1f-0cf3-4524-8497-c18054f5a419 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.362742 Jul 28 20:01:34.079025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 235/455] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:33 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:35.050082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9bc3ab7a-a35f-4120-b0b1-2759cfdf6638 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:35.050766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9bc3ab7a-a35f-4120-b0b1-2759cfdf6638 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:35.059567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bc3ab7a-a35f-4120-b0b1-2759cfdf6638 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:35.060011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bc3ab7a-a35f-4120-b0b1-2759cfdf6638 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:35.060811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bc3ab7a-a35f-4120-b0b1-2759cfdf6638 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:35.061240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bc3ab7a-a35f-4120-b0b1-2759cfdf6638 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:35.103449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:35.104173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:35.111024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:35.111553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:35.112482 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:35.113047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:35.268763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9bc3ab7a-a35f-4120-b0b1-2759cfdf6638 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:35.277533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9bc3ab7a-a35f-4120-b0b1-2759cfdf6638 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.231507 Jul 28 20:01:35.278404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 221/456] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:35.301796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:35.313212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:35.316248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:35.318059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-41e8e751-5bc9-40ed-92ec-7a4f224c94cd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.218990 Jul 28 20:01:35.318653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 236/457] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:35 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:36.299413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4a5f5f29-69bb-4e7b-9226-dea03a1c7e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:36.300038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4a5f5f29-69bb-4e7b-9226-dea03a1c7e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:36.307681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a5f5f29-69bb-4e7b-9226-dea03a1c7e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:36.308130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a5f5f29-69bb-4e7b-9226-dea03a1c7e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:36.308927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a5f5f29-69bb-4e7b-9226-dea03a1c7e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:36.309360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a5f5f29-69bb-4e7b-9226-dea03a1c7e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:36.341849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:36.343432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:36.353053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:36.353655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:36.354861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:36.355300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:36.408532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:36.431627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=10 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:36.550009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4a5f5f29-69bb-4e7b-9226-dea03a1c7e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:36.555041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:36.559909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4a5f5f29-69bb-4e7b-9226-dea03a1c7e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.264278 Jul 28 20:01:36.561203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 222/458] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:36.565143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:36.567047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:36.569091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-be1ac325-754d-4f62-9d20-24b51f11f6eb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.230583 Jul 28 20:01:36.570042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 237/459] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:36 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:37.503115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-fb85daee-e18f-463e-9cb0-ef9c79ad46c2 req-9efb0b35-b047-4929-b688-0946626077f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0038fe10-b9ea-4fe0-a220-9c2ab37f67ed", "name": "network-vif-plugged", "status": "completed", "tag": "6dbb0ebe-84c3-436a-9f54-19cbea4b1db1"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:37.514459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-fb85daee-e18f-463e-9cb0-ef9c79ad46c2 req-9efb0b35-b047-4929-b688-0946626077f8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:37.514902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-fb85daee-e18f-463e-9cb0-ef9c79ad46c2 req-9efb0b35-b047-4929-b688-0946626077f8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:37.527822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-fb85daee-e18f-463e-9cb0-ef9c79ad46c2 req-9efb0b35-b047-4929-b688-0946626077f8 service nova] Creating event network-vif-plugged:6dbb0ebe-84c3-436a-9f54-19cbea4b1db1 for instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed on hv-cinder-85144 Jul 28 20:01:37.533788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-fb85daee-e18f-463e-9cb0-ef9c79ad46c2 req-9efb0b35-b047-4929-b688-0946626077f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035725 Jul 28 20:01:37.534872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 223/460] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:37.581757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b2cd6eec-df76-4e51-80f8-7576c410be17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:37.582403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b2cd6eec-df76-4e51-80f8-7576c410be17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:37.585377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:37.592314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2cd6eec-df76-4e51-80f8-7576c410be17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:37.592314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2cd6eec-df76-4e51-80f8-7576c410be17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:37.592673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2cd6eec-df76-4e51-80f8-7576c410be17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:37.593098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2cd6eec-df76-4e51-80f8-7576c410be17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:37.600477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:37.601565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:37.609654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:37.610394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:37.611325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:37.611905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:37.810684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b2cd6eec-df76-4e51-80f8-7576c410be17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:37.817713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b2cd6eec-df76-4e51-80f8-7576c410be17 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.239613 Jul 28 20:01:37.830277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 238/461] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:37.833712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:37.845717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:37.852430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:37.853660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-49bcadea-a876-45c3-a2dc-b79269423658 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.259120 Jul 28 20:01:37.864895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 224/462] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:37 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:38.852037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-74508188-f256-487f-8457-35d66918b5a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:38.852684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-74508188-f256-487f-8457-35d66918b5a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:38.860110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74508188-f256-487f-8457-35d66918b5a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:38.860568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74508188-f256-487f-8457-35d66918b5a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:38.861421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74508188-f256-487f-8457-35d66918b5a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:38.861883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74508188-f256-487f-8457-35d66918b5a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:38.877503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:38.878873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:38.890299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:38.891125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:38.892457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:38.893140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:39.071927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-74508188-f256-487f-8457-35d66918b5a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:39.083938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-74508188-f256-487f-8457-35d66918b5a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.235707 Jul 28 20:01:39.085208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 239/463] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:39.106136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:39.114531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:39.116703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:39.117858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8e39f1f8-9467-4f42-8025-5501942b9ecf tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.244942 Jul 28 20:01:39.118403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 225/464] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:38 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:39.403916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-91c8e02e-7a09-4154-bdbc-a9eb7c618f2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:39.406239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-91c8e02e-7a09-4154-bdbc-a9eb7c618f2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:39.413525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91c8e02e-7a09-4154-bdbc-a9eb7c618f2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:39.413970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91c8e02e-7a09-4154-bdbc-a9eb7c618f2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:39.414731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91c8e02e-7a09-4154-bdbc-a9eb7c618f2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:39.415167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91c8e02e-7a09-4154-bdbc-a9eb7c618f2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:39.539162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-91c8e02e-7a09-4154-bdbc-a9eb7c618f2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/action" status: 202 len: 0 microversion: 2.1 time: 0.138916 Jul 28 20:01:39.539857 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 240/465] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:01:39 2022] POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:01:39.549956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ea5d94db-98bd-4e1b-b2e8-4a219c319353 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:39.549956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ea5d94db-98bd-4e1b-b2e8-4a219c319353 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:39.555285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea5d94db-98bd-4e1b-b2e8-4a219c319353 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:39.555800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea5d94db-98bd-4e1b-b2e8-4a219c319353 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:39.556653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea5d94db-98bd-4e1b-b2e8-4a219c319353 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:39.557145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea5d94db-98bd-4e1b-b2e8-4a219c319353 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:39.712412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ea5d94db-98bd-4e1b-b2e8-4a219c319353 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:39.721054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ea5d94db-98bd-4e1b-b2e8-4a219c319353 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1748 microversion: 2.1 time: 0.176901 Jul 28 20:01:39.723178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 226/466] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1748 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:40.107452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b402acde-b22f-4a09-9eb5-576a2f863f1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:40.109069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b402acde-b22f-4a09-9eb5-576a2f863f1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:40.116845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b402acde-b22f-4a09-9eb5-576a2f863f1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:40.117320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b402acde-b22f-4a09-9eb5-576a2f863f1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:40.118090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b402acde-b22f-4a09-9eb5-576a2f863f1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:40.118550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b402acde-b22f-4a09-9eb5-576a2f863f1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:40.141238 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:40.141840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:40.148462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:40.148928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:40.149671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:40.150093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:40.356382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b402acde-b22f-4a09-9eb5-576a2f863f1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:40.360822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:40.365283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b402acde-b22f-4a09-9eb5-576a2f863f1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.263234 Jul 28 20:01:40.366607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 241/467] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:40.371963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:40.373482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:40.374852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-51c6e117-5538-452f-9da4-b9824d86f536 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.237440 Jul 28 20:01:40.375393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 227/468] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:40 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:40.743786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-83e681bb-224a-404b-b1cf-f76c6f9ea9a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:40.744427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-83e681bb-224a-404b-b1cf-f76c6f9ea9a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:40.750632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-83e681bb-224a-404b-b1cf-f76c6f9ea9a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:40.751041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-83e681bb-224a-404b-b1cf-f76c6f9ea9a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:40.751814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-83e681bb-224a-404b-b1cf-f76c6f9ea9a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:40.752243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-83e681bb-224a-404b-b1cf-f76c6f9ea9a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:40.915518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-83e681bb-224a-404b-b1cf-f76c6f9ea9a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:40.923471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-83e681bb-224a-404b-b1cf-f76c6f9ea9a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1748 microversion: 2.1 time: 0.184132 Jul 28 20:01:40.924016 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 242/469] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1748 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:41.387155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3f5118f9-30f0-44c0-948f-a50b6e9cc49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:41.387859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3f5118f9-30f0-44c0-948f-a50b6e9cc49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:41.394262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f5118f9-30f0-44c0-948f-a50b6e9cc49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:41.394750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f5118f9-30f0-44c0-948f-a50b6e9cc49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:41.395506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f5118f9-30f0-44c0-948f-a50b6e9cc49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:41.395933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f5118f9-30f0-44c0-948f-a50b6e9cc49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:41.402468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:41.403075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:41.410610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:41.411351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:41.412370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:41.412998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:41.433734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:41.802408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:41.807166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f5118f9-30f0-44c0-948f-a50b6e9cc49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:41.812069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:41.813815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:41.815224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d7b612e7-cf3e-4c37-a3bc-954f74c04727 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.417287 Jul 28 20:01:41.815772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 243/470] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:41 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:41.828433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3f5118f9-30f0-44c0-948f-a50b6e9cc49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.445081 Jul 28 20:01:41.829308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 228/471] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:41.948413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0242cfc4-d772-4d06-a965-206a97590afa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:41.949441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0242cfc4-d772-4d06-a965-206a97590afa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:41.957286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0242cfc4-d772-4d06-a965-206a97590afa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:41.957730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0242cfc4-d772-4d06-a965-206a97590afa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:41.958492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0242cfc4-d772-4d06-a965-206a97590afa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:41.958917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0242cfc4-d772-4d06-a965-206a97590afa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:42.125649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0242cfc4-d772-4d06-a965-206a97590afa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:42.160608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0242cfc4-d772-4d06-a965-206a97590afa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1748 microversion: 2.1 time: 0.216905 Jul 28 20:01:42.161458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 244/472] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1748 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:42.842492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:42.843150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:42.849274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:42.849713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:42.850459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f4a7cea4-cf07-485d-858b-a79e17ae74bf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:42.851140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:42.851332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f4a7cea4-cf07-485d-858b-a79e17ae74bf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:42.851565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:42.857765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4a7cea4-cf07-485d-858b-a79e17ae74bf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:42.858210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4a7cea4-cf07-485d-858b-a79e17ae74bf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:42.858967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4a7cea4-cf07-485d-858b-a79e17ae74bf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:42.859397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4a7cea4-cf07-485d-858b-a79e17ae74bf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:43.074113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:43.077083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f4a7cea4-cf07-485d-858b-a79e17ae74bf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:43.085585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f4a7cea4-cf07-485d-858b-a79e17ae74bf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.239458 Jul 28 20:01:43.085906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:43.086774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 245/473] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:43.087440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:43.088772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ae68c18e-1d6e-4412-a6f8-e8994f4fc07e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.250094 Jul 28 20:01:43.089279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 229/474] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:42 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:43.187030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2da2a24e-050d-485e-b78a-4ab12f055c31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:43.187921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2da2a24e-050d-485e-b78a-4ab12f055c31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:43.196118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2da2a24e-050d-485e-b78a-4ab12f055c31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:43.197011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2da2a24e-050d-485e-b78a-4ab12f055c31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:43.198197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2da2a24e-050d-485e-b78a-4ab12f055c31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:43.198779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2da2a24e-050d-485e-b78a-4ab12f055c31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:43.370355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2da2a24e-050d-485e-b78a-4ab12f055c31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:43.378344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2da2a24e-050d-485e-b78a-4ab12f055c31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1748 microversion: 2.1 time: 0.195097 Jul 28 20:01:43.378895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 246/475] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1748 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:44.106414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-74ed3294-adde-45c1-b5af-2b473dee978c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:44.107045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-74ed3294-adde-45c1-b5af-2b473dee978c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:44.113520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74ed3294-adde-45c1-b5af-2b473dee978c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:44.113971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74ed3294-adde-45c1-b5af-2b473dee978c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:44.114350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:44.114852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74ed3294-adde-45c1-b5af-2b473dee978c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:44.114953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:44.115161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74ed3294-adde-45c1-b5af-2b473dee978c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:44.123213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:44.123667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:44.124459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:44.124943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:44.357251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-74ed3294-adde-45c1-b5af-2b473dee978c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:44.361743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:44.366684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-74ed3294-adde-45c1-b5af-2b473dee978c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.263587 Jul 28 20:01:44.367638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 230/476] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:44.372260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:44.373787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:44.374949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6d3e73bf-dd74-4bcc-8dfb-2cba22758096 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.265585 Jul 28 20:01:44.375483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 247/477] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:44 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:44.401718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4055f79d-9c97-4da8-a635-286936c29c7a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:44.402523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4055f79d-9c97-4da8-a635-286936c29c7a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:44.410192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4055f79d-9c97-4da8-a635-286936c29c7a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:44.410635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4055f79d-9c97-4da8-a635-286936c29c7a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:44.411391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4055f79d-9c97-4da8-a635-286936c29c7a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:44.411821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4055f79d-9c97-4da8-a635-286936c29c7a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:44.616925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4055f79d-9c97-4da8-a635-286936c29c7a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:44.626649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4055f79d-9c97-4da8-a635-286936c29c7a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1748 microversion: 2.1 time: 0.229527 Jul 28 20:01:44.626955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 231/478] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1748 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:45.388908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-75b120b1-8423-4982-90d8-77ae01d814ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:45.389503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-75b120b1-8423-4982-90d8-77ae01d814ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:45.396878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75b120b1-8423-4982-90d8-77ae01d814ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:45.397646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:45.398157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75b120b1-8423-4982-90d8-77ae01d814ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:45.398948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:45.399160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75b120b1-8423-4982-90d8-77ae01d814ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:45.399674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75b120b1-8423-4982-90d8-77ae01d814ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:45.405754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:45.406476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:45.407428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:45.408009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:45.605568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-75b120b1-8423-4982-90d8-77ae01d814ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:45.612362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:45.613311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-75b120b1-8423-4982-90d8-77ae01d814ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.228469 Jul 28 20:01:45.613861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 248/479] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:45.621147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:45.622647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:45.623793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-04eb6919-0cad-42da-b029-21633687d0f1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.230091 Jul 28 20:01:45.624334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 232/480] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:45 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:45.649178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-76ae34d6-774e-4c3d-8b31-fd299009e26d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:45.649793 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-76ae34d6-774e-4c3d-8b31-fd299009e26d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:45.655965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-76ae34d6-774e-4c3d-8b31-fd299009e26d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:45.656392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-76ae34d6-774e-4c3d-8b31-fd299009e26d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:45.657180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-76ae34d6-774e-4c3d-8b31-fd299009e26d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:45.657604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-76ae34d6-774e-4c3d-8b31-fd299009e26d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:45.803221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-76ae34d6-774e-4c3d-8b31-fd299009e26d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:45.811261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-76ae34d6-774e-4c3d-8b31-fd299009e26d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1748 microversion: 2.1 time: 0.166427 Jul 28 20:01:45.811827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 249/481] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1748 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:46.634292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e1b50a4b-787f-4d72-a8a4-84a8a3b071c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:46.634925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e1b50a4b-787f-4d72-a8a4-84a8a3b071c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:46.640750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1b50a4b-787f-4d72-a8a4-84a8a3b071c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:46.641191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1b50a4b-787f-4d72-a8a4-84a8a3b071c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:46.642063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1b50a4b-787f-4d72-a8a4-84a8a3b071c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:46.642492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1b50a4b-787f-4d72-a8a4-84a8a3b071c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:46.648246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:46.648878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:46.655710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:46.656412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:46.657441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:46.658198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:46.832147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e1b50a4b-787f-4d72-a8a4-84a8a3b071c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:46.839928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e1b50a4b-787f-4d72-a8a4-84a8a3b071c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1370 microversion: 2.1 time: 0.209896 Jul 28 20:01:46.840475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 233/482] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:46.845108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e7d5772f-4bcf-47cb-a5f3-4c3dda10dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:46.845733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e7d5772f-4bcf-47cb-a5f3-4c3dda10dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:46.852231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7d5772f-4bcf-47cb-a5f3-4c3dda10dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:46.852702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7d5772f-4bcf-47cb-a5f3-4c3dda10dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:46.853457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7d5772f-4bcf-47cb-a5f3-4c3dda10dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:46.853884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7d5772f-4bcf-47cb-a5f3-4c3dda10dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:46.869894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:46.878566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:46.880052 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:46.881288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7a12a162-c461-4387-82da-d39d38ce1af3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.237593 Jul 28 20:01:46.881834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 250/483] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:46 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:47.007883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e7d5772f-4bcf-47cb-a5f3-4c3dda10dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:47.016168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e7d5772f-4bcf-47cb-a5f3-4c3dda10dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.174633 Jul 28 20:01:47.016910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 234/484] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:47.862409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6bf113fe-0b58-4549-bc67-81f048a72be9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:47.863018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6bf113fe-0b58-4549-bc67-81f048a72be9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:47.865542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=72 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:47.870964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bf113fe-0b58-4549-bc67-81f048a72be9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:47.871406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bf113fe-0b58-4549-bc67-81f048a72be9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:47.872154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bf113fe-0b58-4549-bc67-81f048a72be9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:47.872601 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bf113fe-0b58-4549-bc67-81f048a72be9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:47.876664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:47.904372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:47.905003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:47.913004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:47.913451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:47.914212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:47.914691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:48.058958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6bf113fe-0b58-4549-bc67-81f048a72be9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:48.066427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6bf113fe-0b58-4549-bc67-81f048a72be9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1564 microversion: 2.1 time: 0.208100 Jul 28 20:01:48.067067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 251/485] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:48.072320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f1f6384e-526a-4702-b0c9-400e159f34b3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:48.073091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f1f6384e-526a-4702-b0c9-400e159f34b3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:48.079035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1f6384e-526a-4702-b0c9-400e159f34b3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:48.079476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1f6384e-526a-4702-b0c9-400e159f34b3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:48.080231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1f6384e-526a-4702-b0c9-400e159f34b3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:48.080683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1f6384e-526a-4702-b0c9-400e159f34b3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:48.085959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:48.094857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:48.096330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:48.097507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ba212f2e-d3c1-4df9-8758-c2c88336b8fb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.197150 Jul 28 20:01:48.098362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 235/486] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:47 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:48.103802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f75c8aa7-72a1-44a0-b452-de2a372f41cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:48.104286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f75c8aa7-72a1-44a0-b452-de2a372f41cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:48.110582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f75c8aa7-72a1-44a0-b452-de2a372f41cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:48.111229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f75c8aa7-72a1-44a0-b452-de2a372f41cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:48.111979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f75c8aa7-72a1-44a0-b452-de2a372f41cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:48.112687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f75c8aa7-72a1-44a0-b452-de2a372f41cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:48.228333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f75c8aa7-72a1-44a0-b452-de2a372f41cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128896 Jul 28 20:01:48.228961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 236/487] 10.222.0.67 () {58 vars in 1275 bytes} [Thu Jul 28 20:01:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:48.408656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f1f6384e-526a-4702-b0c9-400e159f34b3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:48.417298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f1f6384e-526a-4702-b0c9-400e159f34b3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.349168 Jul 28 20:01:48.417848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 252/488] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:48.496083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-272135273", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1034975038", "security_groups": [{"name": "tempest-secgroup-smoke-1012880163"}], "networks": [{"uuid": "d02ca0e4-25b2-4278-bbf2-5532f864ece3"}], "block_device_mapping_v2": [{"uuid": "8a78e75a-0ec8-412c-b0be-768b27e4f35c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:48.754794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a7bf37b2-a749-4371-92aa-984df2575bd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abf2f156-ca39-41be-8714-24e4311b34ec", "device": "/dev/sdb"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:48.758739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a7bf37b2-a749-4371-92aa-984df2575bd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:48.764879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a7bf37b2-a749-4371-92aa-984df2575bd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:48.765334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a7bf37b2-a749-4371-92aa-984df2575bd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:48.766108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a7bf37b2-a749-4371-92aa-984df2575bd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:48.766543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a7bf37b2-a749-4371-92aa-984df2575bd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:48.775701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] validate_networks() for [('d02ca0e4-25b2-4278-bbf2-5532f864ece3', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:01:49.044169 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a7bf37b2-a749-4371-92aa-984df2575bd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "POST /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293214 Jul 28 20:01:49.050349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 253/489] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:01:48 2022] POST /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:01:49.123254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:49.124406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:49.132692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:49.133373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:49.134151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:49.134576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:49.561674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:49.570353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:49.571926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:49.573192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2701bd90-3ab6-4364-9905-8773473643d8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.454712 Jul 28 20:01:49.573817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 254/490] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:49 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:49.588684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-312f1b51-48f9-47ee-b129-f25eb8cd477d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:49.588684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-312f1b51-48f9-47ee-b129-f25eb8cd477d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:49.588684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-312f1b51-48f9-47ee-b129-f25eb8cd477d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:49.588684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-312f1b51-48f9-47ee-b129-f25eb8cd477d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:49.589092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-312f1b51-48f9-47ee-b129-f25eb8cd477d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:49.589092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-312f1b51-48f9-47ee-b129-f25eb8cd477d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:49.901659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:01:49.902176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:01:49.902949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:01:49.903432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:01:49.904650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:01:49.907958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:49.916559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:49.917013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:49.917534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-312f1b51-48f9-47ee-b129-f25eb8cd477d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:49.917823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:49.918260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:49.927366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-312f1b51-48f9-47ee-b129-f25eb8cd477d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.352442 Jul 28 20:01:49.929296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 255/491] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:49.950307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Getting quotas for project 25002b31f4fc4ec78222fc4919aa5fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:01:49.954417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Getting quotas for user 5131b18108f64f11ac1e0f4866a9cb37 and project 25002b31f4fc4ec78222fc4919aa5fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:01:50.015790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:01:50.017889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a78e75a-0ec8-412c-b0be-768b27e4f35c',volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:01:50.100347 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-afcdcb93-4d9b-48e0-9768-7f43bcfc7d7d req-5522fcfb-b7b6-4564-b754-6fc3d51d5ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0038fe10-b9ea-4fe0-a220-9c2ab37f67ed", "tag": "6dbb0ebe-84c3-436a-9f54-19cbea4b1db1"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:50.111526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-afcdcb93-4d9b-48e0-9768-7f43bcfc7d7d req-5522fcfb-b7b6-4564-b754-6fc3d51d5ee3 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:50.111968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-afcdcb93-4d9b-48e0-9768-7f43bcfc7d7d req-5522fcfb-b7b6-4564-b754-6fc3d51d5ee3 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:50.125261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-afcdcb93-4d9b-48e0-9768-7f43bcfc7d7d req-5522fcfb-b7b6-4564-b754-6fc3d51d5ee3 service nova] Creating event network-changed:6dbb0ebe-84c3-436a-9f54-19cbea4b1db1 for instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed on hv-cinder-85144 Jul 28 20:01:50.133040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-afcdcb93-4d9b-48e0-9768-7f43bcfc7d7d req-5522fcfb-b7b6-4564-b754-6fc3d51d5ee3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037766 Jul 28 20:01:50.135204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 256/492] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:50.171960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-87284773-e059-41c4-9713-1863821b98ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.679877 Jul 28 20:01:50.172965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 237/493] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:01:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:01:50.191558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-43eedafc-4634-47d5-ba40-e159819e3f30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:50.192258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-43eedafc-4634-47d5-ba40-e159819e3f30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:50.269746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-43eedafc-4634-47d5-ba40-e159819e3f30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:50.278177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-43eedafc-4634-47d5-ba40-e159819e3f30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1088 microversion: 2.1 time: 0.090614 Jul 28 20:01:50.289139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 257/494] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1088 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:50.599340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:50.600831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:50.607985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:50.608511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:50.609367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:50.609873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:50.738992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:50.748435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:50.749974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:50.751169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e5e64772-5e41-484a-a280-6a97d51749ce tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.156398 Jul 28 20:01:50.751724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 238/495] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:50 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:50.950131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eb85c575-545c-4809-a144-bf299992e76c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:50.951199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eb85c575-545c-4809-a144-bf299992e76c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:50.957496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb85c575-545c-4809-a144-bf299992e76c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:50.957949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb85c575-545c-4809-a144-bf299992e76c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:50.959209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb85c575-545c-4809-a144-bf299992e76c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:50.959705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb85c575-545c-4809-a144-bf299992e76c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:51.114275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-eb85c575-545c-4809-a144-bf299992e76c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:51.122572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eb85c575-545c-4809-a144-bf299992e76c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.176353 Jul 28 20:01:51.123208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 258/496] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:51.301049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bb4d12ee-f28d-48eb-920b-bc18337076aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:51.301660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bb4d12ee-f28d-48eb-920b-bc18337076aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:51.307787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb4d12ee-f28d-48eb-920b-bc18337076aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:51.308235 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb4d12ee-f28d-48eb-920b-bc18337076aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:51.309033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb4d12ee-f28d-48eb-920b-bc18337076aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:51.309483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb4d12ee-f28d-48eb-920b-bc18337076aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:51.369708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bb4d12ee-f28d-48eb-920b-bc18337076aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:51.377205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bb4d12ee-f28d-48eb-920b-bc18337076aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1138 microversion: 2.1 time: 0.079941 Jul 28 20:01:51.377754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 239/497] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:51 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1138 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:51.775185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:51.776184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:51.783497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:51.784061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:51.785585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:51.786410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:51.936872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:51.949551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:51.953359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:51.954801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-640fe5e9-7427-4a1a-802b-8272fed3418b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.184163 Jul 28 20:01:51.964592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 259/498] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:51 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:52.145577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-42de171b-60fe-4ce4-98a1-c06fc2e1a037 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:52.147354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-42de171b-60fe-4ce4-98a1-c06fc2e1a037 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:52.154461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42de171b-60fe-4ce4-98a1-c06fc2e1a037 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:52.154903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42de171b-60fe-4ce4-98a1-c06fc2e1a037 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:52.155875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42de171b-60fe-4ce4-98a1-c06fc2e1a037 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:52.156500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42de171b-60fe-4ce4-98a1-c06fc2e1a037 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:52.319728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-42de171b-60fe-4ce4-98a1-c06fc2e1a037 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:52.328116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-42de171b-60fe-4ce4-98a1-c06fc2e1a037 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.187251 Jul 28 20:01:52.328688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 240/499] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:52.398184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eed3de86-3bee-4032-8687-a442cde6de78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:52.399006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eed3de86-3bee-4032-8687-a442cde6de78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:52.405481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eed3de86-3bee-4032-8687-a442cde6de78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:52.405923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eed3de86-3bee-4032-8687-a442cde6de78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:52.406673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eed3de86-3bee-4032-8687-a442cde6de78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:52.407101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eed3de86-3bee-4032-8687-a442cde6de78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:52.468274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-eed3de86-3bee-4032-8687-a442cde6de78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:52.475795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eed3de86-3bee-4032-8687-a442cde6de78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1186 microversion: 2.1 time: 0.081585 Jul 28 20:01:52.476361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 260/500] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:52 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:52.980972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:52.981702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:52.987953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:52.988393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:52.989202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:52.990853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:53.124143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:53.132717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:53.134203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:53.135350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-07b9a210-4bdf-4b24-9719-ca2056309f6f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.159116 Jul 28 20:01:53.135893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 241/501] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:52 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:53.349066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-592476d2-9e9a-4986-a1f0-ffe8dfa007d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:53.350558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-592476d2-9e9a-4986-a1f0-ffe8dfa007d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:53.356708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-592476d2-9e9a-4986-a1f0-ffe8dfa007d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:53.357150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-592476d2-9e9a-4986-a1f0-ffe8dfa007d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:53.357903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-592476d2-9e9a-4986-a1f0-ffe8dfa007d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:53.358508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-592476d2-9e9a-4986-a1f0-ffe8dfa007d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:53.496442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9f45050e-eede-4240-966a-057712736f9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:53.497643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9f45050e-eede-4240-966a-057712736f9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:53.503857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f45050e-eede-4240-966a-057712736f9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:53.504533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f45050e-eede-4240-966a-057712736f9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:53.505480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f45050e-eede-4240-966a-057712736f9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:53.506826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f45050e-eede-4240-966a-057712736f9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:53.529553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-592476d2-9e9a-4986-a1f0-ffe8dfa007d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:53.551014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-592476d2-9e9a-4986-a1f0-ffe8dfa007d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.205155 Jul 28 20:01:53.567478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 261/502] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:53.580926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9f45050e-eede-4240-966a-057712736f9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:53.589941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9f45050e-eede-4240-966a-057712736f9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1204 microversion: 2.1 time: 0.097170 Jul 28 20:01:53.590826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 242/503] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:53 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:54.159148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:54.160774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:54.168149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:54.169805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:54.170857 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:54.171360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:54.330500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:54.339826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:54.342757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:54.343980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-26bc3b62-f2bd-4e12-a567-fc57e01ed078 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.188771 Jul 28 20:01:54.344559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 262/504] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:54 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:54.461377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-d386e8e0-90ac-42f0-8145-0de6fb92a804 req-e5050edd-2432-49ce-8903-151bb44fff7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86779ed-0aff-43b5-a713-44e5384deb0d", "tag": "0ef4ac93-7c07-48a3-8303-7e752c056864"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:54.478248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-d386e8e0-90ac-42f0-8145-0de6fb92a804 req-e5050edd-2432-49ce-8903-151bb44fff7b service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:54.478583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-d386e8e0-90ac-42f0-8145-0de6fb92a804 req-e5050edd-2432-49ce-8903-151bb44fff7b service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:54.497504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-d386e8e0-90ac-42f0-8145-0de6fb92a804 req-e5050edd-2432-49ce-8903-151bb44fff7b service nova] Creating event network-changed:0ef4ac93-7c07-48a3-8303-7e752c056864 for instance f86779ed-0aff-43b5-a713-44e5384deb0d on hv-cinder-85144 Jul 28 20:01:54.502124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-d386e8e0-90ac-42f0-8145-0de6fb92a804 req-e5050edd-2432-49ce-8903-151bb44fff7b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045905 Jul 28 20:01:54.502715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 243/505] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:54.574256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d9fe76ff-d5c2-478b-b802-48daacb930b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:54.575104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d9fe76ff-d5c2-478b-b802-48daacb930b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:54.582306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9fe76ff-d5c2-478b-b802-48daacb930b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:54.582894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9fe76ff-d5c2-478b-b802-48daacb930b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:54.584469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9fe76ff-d5c2-478b-b802-48daacb930b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:54.585253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9fe76ff-d5c2-478b-b802-48daacb930b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:54.613223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cbfe15b8-8f44-4aa1-a2d0-f5b6c78df771 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:54.614008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cbfe15b8-8f44-4aa1-a2d0-f5b6c78df771 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:54.626094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbfe15b8-8f44-4aa1-a2d0-f5b6c78df771 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:54.627802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbfe15b8-8f44-4aa1-a2d0-f5b6c78df771 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:54.628774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbfe15b8-8f44-4aa1-a2d0-f5b6c78df771 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:54.629513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbfe15b8-8f44-4aa1-a2d0-f5b6c78df771 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:54.802939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d9fe76ff-d5c2-478b-b802-48daacb930b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:54.813687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d9fe76ff-d5c2-478b-b802-48daacb930b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.243319 Jul 28 20:01:54.814363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 263/506] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:54.820348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cbfe15b8-8f44-4aa1-a2d0-f5b6c78df771 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:54.829646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cbfe15b8-8f44-4aa1-a2d0-f5b6c78df771 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1272 microversion: 2.1 time: 0.220573 Jul 28 20:01:54.830127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 244/507] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:55.368006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:55.368630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:55.374784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:55.375227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:55.375989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:55.376412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:55.513864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:55.523000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:55.524494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:55.525681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-07e6fa97-8f02-4e6e-ba18-3198d86f0621 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.161548 Jul 28 20:01:55.526886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 264/508] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:55 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:55.549293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-d74e2cfe-9069-4e5d-80fd-5709207c3ef8 req-6070ce62-eb10-48f1-8a02-12c930816168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4889e06d-18cf-4e5e-9f68-8c168109c1d3", "name": "network-vif-plugged", "status": "completed", "tag": "e3b95cb5-58ef-47b5-a24c-57117b4da068"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:01:55.560417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-d74e2cfe-9069-4e5d-80fd-5709207c3ef8 req-6070ce62-eb10-48f1-8a02-12c930816168 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:55.560417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-d74e2cfe-9069-4e5d-80fd-5709207c3ef8 req-6070ce62-eb10-48f1-8a02-12c930816168 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:55.572018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-d74e2cfe-9069-4e5d-80fd-5709207c3ef8 req-6070ce62-eb10-48f1-8a02-12c930816168 service nova] Creating event network-vif-plugged:e3b95cb5-58ef-47b5-a24c-57117b4da068 for instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 on hv-cinder-85144 Jul 28 20:01:55.576765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-d74e2cfe-9069-4e5d-80fd-5709207c3ef8 req-6070ce62-eb10-48f1-8a02-12c930816168 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031091 Jul 28 20:01:55.577343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 245/509] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:55.835278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b02d02d-4029-4f6f-9f7c-0cfdcc0db25f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:55.835884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b02d02d-4029-4f6f-9f7c-0cfdcc0db25f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:55.842327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b02d02d-4029-4f6f-9f7c-0cfdcc0db25f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:55.842770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b02d02d-4029-4f6f-9f7c-0cfdcc0db25f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:55.843516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b02d02d-4029-4f6f-9f7c-0cfdcc0db25f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:55.843947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b02d02d-4029-4f6f-9f7c-0cfdcc0db25f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:55.851219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-30f2f1b0-ac43-4b3e-8bea-978c9945dadb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:55.851908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-30f2f1b0-ac43-4b3e-8bea-978c9945dadb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:55.858272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-30f2f1b0-ac43-4b3e-8bea-978c9945dadb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:55.858711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-30f2f1b0-ac43-4b3e-8bea-978c9945dadb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:55.859465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-30f2f1b0-ac43-4b3e-8bea-978c9945dadb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:55.859886 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-30f2f1b0-ac43-4b3e-8bea-978c9945dadb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:56.057040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-30f2f1b0-ac43-4b3e-8bea-978c9945dadb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:56.062869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b02d02d-4029-4f6f-9f7c-0cfdcc0db25f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:56.064513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-30f2f1b0-ac43-4b3e-8bea-978c9945dadb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1272 microversion: 2.1 time: 0.218099 Jul 28 20:01:56.065156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 246/510] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:56.070761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b02d02d-4029-4f6f-9f7c-0cfdcc0db25f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.239416 Jul 28 20:01:56.071303 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 265/511] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:56.555207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:56.556973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:56.566184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:56.567510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:56.568459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:56.569793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:56.575715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:56.730980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:56.742815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:56.745592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:56.747844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e0a8bbb2-32c7-410b-99e8-27bfc1f2d9cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.199857 Jul 28 20:01:56.748515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 247/512] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:56 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:57.085351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bbe1fe0e-222f-4df7-99a4-4c9416cbc9ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:57.085961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bbe1fe0e-222f-4df7-99a4-4c9416cbc9ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:57.092567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8e066c27-dfe5-4ca3-ae4a-b46ebbd57eec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:57.092950 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbe1fe0e-222f-4df7-99a4-4c9416cbc9ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:57.093196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8e066c27-dfe5-4ca3-ae4a-b46ebbd57eec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:57.093399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbe1fe0e-222f-4df7-99a4-4c9416cbc9ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:57.094186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbe1fe0e-222f-4df7-99a4-4c9416cbc9ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:57.094617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbe1fe0e-222f-4df7-99a4-4c9416cbc9ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:57.099055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e066c27-dfe5-4ca3-ae4a-b46ebbd57eec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:57.099526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e066c27-dfe5-4ca3-ae4a-b46ebbd57eec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:57.101591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e066c27-dfe5-4ca3-ae4a-b46ebbd57eec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:57.102023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e066c27-dfe5-4ca3-ae4a-b46ebbd57eec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:57.303308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bbe1fe0e-222f-4df7-99a4-4c9416cbc9ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:57.309236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e066c27-dfe5-4ca3-ae4a-b46ebbd57eec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:57.311282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bbe1fe0e-222f-4df7-99a4-4c9416cbc9ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1272 microversion: 2.1 time: 0.230143 Jul 28 20:01:57.312138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 266/513] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:57.317497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8e066c27-dfe5-4ca3-ae4a-b46ebbd57eec tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.228723 Jul 28 20:01:57.318128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 248/514] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:57.772209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:57.772977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:57.779024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:57.779540 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:57.780370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:57.780892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:57.942509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:57.951581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:57.953186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:57.954346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aae8956e-abfc-49aa-9ace-0c898ffe224f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.186408 Jul 28 20:01:57.954912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 267/515] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:57 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:01:58.333319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cbbefb48-e792-4957-b285-d7f65fe2a18b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:58.333976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cbbefb48-e792-4957-b285-d7f65fe2a18b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:58.339302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d572f6de-be73-4083-adde-f2b07750ffc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:58.339940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d572f6de-be73-4083-adde-f2b07750ffc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:58.340161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbbefb48-e792-4957-b285-d7f65fe2a18b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:58.340635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbbefb48-e792-4957-b285-d7f65fe2a18b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:58.341399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbbefb48-e792-4957-b285-d7f65fe2a18b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:58.341834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbbefb48-e792-4957-b285-d7f65fe2a18b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:58.346327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d572f6de-be73-4083-adde-f2b07750ffc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:58.346784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d572f6de-be73-4083-adde-f2b07750ffc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:58.347539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d572f6de-be73-4083-adde-f2b07750ffc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:58.347973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d572f6de-be73-4083-adde-f2b07750ffc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:58.352299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:01:58.541050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cbbefb48-e792-4957-b285-d7f65fe2a18b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:58.548460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cbbefb48-e792-4957-b285-d7f65fe2a18b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.218967 Jul 28 20:01:58.549059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 249/516] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:58 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:58.557594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d572f6de-be73-4083-adde-f2b07750ffc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:58.565529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d572f6de-be73-4083-adde-f2b07750ffc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.230063 Jul 28 20:01:58.566080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 268/517] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:01:58.802267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a9e4ead3-47b5-4f78-98e5-ca42ceb1f2a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:58.803506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a9e4ead3-47b5-4f78-98e5-ca42ceb1f2a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:58.809512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9e4ead3-47b5-4f78-98e5-ca42ceb1f2a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:58.809951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9e4ead3-47b5-4f78-98e5-ca42ceb1f2a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:58.810701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9e4ead3-47b5-4f78-98e5-ca42ceb1f2a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:58.811131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9e4ead3-47b5-4f78-98e5-ca42ceb1f2a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:58.833637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a9e4ead3-47b5-4f78-98e5-ca42ceb1f2a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/ips" status: 200 len: 149 microversion: 2.1 time: 0.035284 Jul 28 20:01:58.837091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 250/518] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 20:01:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:01:58.978632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:58.979436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:58.986148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:58.986606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:58.987430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:58.987868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:59.141242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:59.155883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:59.157644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:59.158894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-18d33243-68b1-4124-b516-9a591fb4839c tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.185186 Jul 28 20:01:59.159763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 269/519] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:01:58 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:01:59.570633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e26a4e6c-b2ba-446e-9c83-b795c15bff15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:59.571239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e26a4e6c-b2ba-446e-9c83-b795c15bff15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:59.577165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e26a4e6c-b2ba-446e-9c83-b795c15bff15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:59.577606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e26a4e6c-b2ba-446e-9c83-b795c15bff15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:59.578348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e26a4e6c-b2ba-446e-9c83-b795c15bff15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:59.578771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e26a4e6c-b2ba-446e-9c83-b795c15bff15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:59.588055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0e65cc0d-6c9c-4c99-ba54-0cbdd6c269b5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:01:59.588779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0e65cc0d-6c9c-4c99-ba54-0cbdd6c269b5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:01:59.595189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e65cc0d-6c9c-4c99-ba54-0cbdd6c269b5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:59.595634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e65cc0d-6c9c-4c99-ba54-0cbdd6c269b5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:59.596399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e65cc0d-6c9c-4c99-ba54-0cbdd6c269b5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:01:59.596863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e65cc0d-6c9c-4c99-ba54-0cbdd6c269b5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:01:59.763852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e26a4e6c-b2ba-446e-9c83-b795c15bff15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:59.775963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e26a4e6c-b2ba-446e-9c83-b795c15bff15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.209828 Jul 28 20:01:59.776531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 251/520] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:59 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:01:59.802111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0e65cc0d-6c9c-4c99-ba54-0cbdd6c269b5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:01:59.810555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0e65cc0d-6c9c-4c99-ba54-0cbdd6c269b5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.227000 Jul 28 20:01:59.811110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 270/521] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:01:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:02:00.186736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:00.187345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:00.189208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:00.189858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=6 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:00.197157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:00.197611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:00.198381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:00.198814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:00.329038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:00.337939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:00.339424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:00.340588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7dd6b1d0-c69c-4b90-b2f5-36059b77a427 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.157728 Jul 28 20:02:00.341127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 252/522] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:02:00 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:02:00.796649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2180a3ab-85a4-4b69-a5b0-a35a55788c56 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:00.797268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2180a3ab-85a4-4b69-a5b0-a35a55788c56 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:00.799126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:00.805609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2180a3ab-85a4-4b69-a5b0-a35a55788c56 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:00.806057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2180a3ab-85a4-4b69-a5b0-a35a55788c56 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:00.806815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2180a3ab-85a4-4b69-a5b0-a35a55788c56 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:00.807246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2180a3ab-85a4-4b69-a5b0-a35a55788c56 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:00.832859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1b8c50f0-26af-4f01-b49b-e953d819bcb0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:00.833497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1b8c50f0-26af-4f01-b49b-e953d819bcb0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:00.840032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b8c50f0-26af-4f01-b49b-e953d819bcb0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:00.840475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b8c50f0-26af-4f01-b49b-e953d819bcb0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:00.841262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b8c50f0-26af-4f01-b49b-e953d819bcb0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:00.841689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b8c50f0-26af-4f01-b49b-e953d819bcb0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:00.990388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2180a3ab-85a4-4b69-a5b0-a35a55788c56 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:00.998477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2180a3ab-85a4-4b69-a5b0-a35a55788c56 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.205667 Jul 28 20:02:00.999128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 271/523] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:00 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:01.030940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1b8c50f0-26af-4f01-b49b-e953d819bcb0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:01.040008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1b8c50f0-26af-4f01-b49b-e953d819bcb0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.210952 Jul 28 20:02:01.040598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 253/524] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:02:01.363330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:01.363862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:01.370438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:01.370885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:01.371632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:01.372061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:01.509354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:01.517622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:01.519119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:01.520283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b179a8cb-b406-4a00-9f3c-db0e9f60bddd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.161005 Jul 28 20:02:01.520859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 272/525] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:02:01 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:02:02.018636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1e61b4c2-8cb6-4965-8a5d-85299d7b62f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:02.019242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1e61b4c2-8cb6-4965-8a5d-85299d7b62f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:02.026651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e61b4c2-8cb6-4965-8a5d-85299d7b62f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:02.027132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e61b4c2-8cb6-4965-8a5d-85299d7b62f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:02.028151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e61b4c2-8cb6-4965-8a5d-85299d7b62f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:02.028505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e61b4c2-8cb6-4965-8a5d-85299d7b62f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:02.062162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cf230336-69c5-49a3-a78f-b5e834aa1418 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:02.062925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cf230336-69c5-49a3-a78f-b5e834aa1418 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:02.071730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf230336-69c5-49a3-a78f-b5e834aa1418 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:02.072303 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf230336-69c5-49a3-a78f-b5e834aa1418 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:02.073201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf230336-69c5-49a3-a78f-b5e834aa1418 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:02.073737 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf230336-69c5-49a3-a78f-b5e834aa1418 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:02.216185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1e61b4c2-8cb6-4965-8a5d-85299d7b62f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:02.229932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1e61b4c2-8cb6-4965-8a5d-85299d7b62f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.214922 Jul 28 20:02:02.232372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 254/526] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:02.293322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cf230336-69c5-49a3-a78f-b5e834aa1418 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:02.302526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cf230336-69c5-49a3-a78f-b5e834aa1418 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.244900 Jul 28 20:02:02.316567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 273/527] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:02 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:02.355608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-be905e57-5bfb-4aa1-939f-ca6397335e48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f"}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:02.358508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-be905e57-5bfb-4aa1-939f-ca6397335e48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:02.364564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be905e57-5bfb-4aa1-939f-ca6397335e48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:02.365085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be905e57-5bfb-4aa1-939f-ca6397335e48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:02.365869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be905e57-5bfb-4aa1-939f-ca6397335e48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:02.367013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be905e57-5bfb-4aa1-939f-ca6397335e48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:02.543820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:02.544425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:02.550713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:02.551159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:02.551952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:02.552385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:02.684422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:02.692895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:02.694570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:02.695743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b3f8884-e1df-4df2-88ba-95c9a5bc7404 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1807 microversion: 2.20 time: 0.155845 Jul 28 20:02:02.696303 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 274/528] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:02:02 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:02:03.253509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-14521f9f-928f-4fd9-8dea-bced053cb313 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:03.254144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-14521f9f-928f-4fd9-8dea-bced053cb313 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:03.260825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14521f9f-928f-4fd9-8dea-bced053cb313 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:03.261266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14521f9f-928f-4fd9-8dea-bced053cb313 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:03.262018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14521f9f-928f-4fd9-8dea-bced053cb313 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:03.262446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14521f9f-928f-4fd9-8dea-bced053cb313 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:03.395476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-14521f9f-928f-4fd9-8dea-bced053cb313 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:03.403105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-14521f9f-928f-4fd9-8dea-bced053cb313 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.153439 Jul 28 20:02:03.403656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 275/529] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:03 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:02:03.407996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e34f0683-d7fb-44f2-b5a8-401aa5389b0b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:03.408623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e34f0683-d7fb-44f2-b5a8-401aa5389b0b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:03.414992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34f0683-d7fb-44f2-b5a8-401aa5389b0b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:03.415430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34f0683-d7fb-44f2-b5a8-401aa5389b0b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:03.416176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34f0683-d7fb-44f2-b5a8-401aa5389b0b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:03.416626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34f0683-d7fb-44f2-b5a8-401aa5389b0b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:03.558118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e34f0683-d7fb-44f2-b5a8-401aa5389b0b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:03.566166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e34f0683-d7fb-44f2-b5a8-401aa5389b0b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.161545 Jul 28 20:02:03.566732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 276/530] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:03 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:03.719395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:03.720001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:03.726491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:03.726929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:03.727679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:03.728097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:03.854100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:03.862590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:03.864090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:03.865264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-14f15b22-e982-4f54-94c7-bc0d758b9dae tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1794 microversion: 2.20 time: 0.149992 Jul 28 20:02:03.865826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 277/531] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:02:03 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1794 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:02:04.424253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7731f480-5453-4b0e-8add-634f0cba8212 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:04.424880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7731f480-5453-4b0e-8add-634f0cba8212 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:04.431744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7731f480-5453-4b0e-8add-634f0cba8212 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:04.432177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7731f480-5453-4b0e-8add-634f0cba8212 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:04.432959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7731f480-5453-4b0e-8add-634f0cba8212 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:04.433382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7731f480-5453-4b0e-8add-634f0cba8212 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:04.566682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7731f480-5453-4b0e-8add-634f0cba8212 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:04.574704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7731f480-5453-4b0e-8add-634f0cba8212 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.154291 Jul 28 20:02:04.575269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 278/532] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:04 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:02:04.587840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9df6b0c5-8ed9-4fbe-aeff-a4e6c5445cd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:04.588444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9df6b0c5-8ed9-4fbe-aeff-a4e6c5445cd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:04.594240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9df6b0c5-8ed9-4fbe-aeff-a4e6c5445cd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:04.594688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9df6b0c5-8ed9-4fbe-aeff-a4e6c5445cd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:04.595442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9df6b0c5-8ed9-4fbe-aeff-a4e6c5445cd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:04.595907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9df6b0c5-8ed9-4fbe-aeff-a4e6c5445cd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:04.734560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9df6b0c5-8ed9-4fbe-aeff-a4e6c5445cd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:04.743533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9df6b0c5-8ed9-4fbe-aeff-a4e6c5445cd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.159525 Jul 28 20:02:04.744100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 279/533] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:02:05.594554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fd0fa104-b48b-494a-a64e-b977f12150af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:05.595221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fd0fa104-b48b-494a-a64e-b977f12150af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:05.601789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd0fa104-b48b-494a-a64e-b977f12150af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:05.602225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd0fa104-b48b-494a-a64e-b977f12150af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:05.602971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd0fa104-b48b-494a-a64e-b977f12150af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:05.603395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd0fa104-b48b-494a-a64e-b977f12150af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:05.734545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fd0fa104-b48b-494a-a64e-b977f12150af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:05.742755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fd0fa104-b48b-494a-a64e-b977f12150af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.152034 Jul 28 20:02:05.743350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 280/534] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:05 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:02:05.764772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d2fa3d9f-78f1-46f7-8451-6fd37bb9abf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:05.765382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d2fa3d9f-78f1-46f7-8451-6fd37bb9abf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:05.771645 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2fa3d9f-78f1-46f7-8451-6fd37bb9abf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:05.772148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2fa3d9f-78f1-46f7-8451-6fd37bb9abf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:05.772959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2fa3d9f-78f1-46f7-8451-6fd37bb9abf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:05.773387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2fa3d9f-78f1-46f7-8451-6fd37bb9abf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:05.914225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-be905e57-5bfb-4aa1-939f-ca6397335e48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.564797 Jul 28 20:02:05.915136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 255/535] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:02:02 2022] POST /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 194 bytes in 3567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:05.926653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d2fa3d9f-78f1-46f7-8451-6fd37bb9abf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:05.935401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d2fa3d9f-78f1-46f7-8451-6fd37bb9abf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1753 microversion: 2.1 time: 0.174403 Jul 28 20:02:05.936026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 281/536] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:05 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:02:06.765045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-51b9d2b0-620e-4064-8082-0e3ed70a9efe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:06.765647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-51b9d2b0-620e-4064-8082-0e3ed70a9efe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:06.771717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51b9d2b0-620e-4064-8082-0e3ed70a9efe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:06.772230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51b9d2b0-620e-4064-8082-0e3ed70a9efe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:06.773002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51b9d2b0-620e-4064-8082-0e3ed70a9efe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:06.773426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51b9d2b0-620e-4064-8082-0e3ed70a9efe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:06.918232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-51b9d2b0-620e-4064-8082-0e3ed70a9efe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:06.925676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-51b9d2b0-620e-4064-8082-0e3ed70a9efe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.165543 Jul 28 20:02:06.926225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 256/537] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:06 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:06.957290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b4cf7a4c-f83c-4df6-a480-2a20deaed6f9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:06.957926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b4cf7a4c-f83c-4df6-a480-2a20deaed6f9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:06.965212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b4cf7a4c-f83c-4df6-a480-2a20deaed6f9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:06.965687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b4cf7a4c-f83c-4df6-a480-2a20deaed6f9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:06.966452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b4cf7a4c-f83c-4df6-a480-2a20deaed6f9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:06.966897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b4cf7a4c-f83c-4df6-a480-2a20deaed6f9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:07.109190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b4cf7a4c-f83c-4df6-a480-2a20deaed6f9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:07.117886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b4cf7a4c-f83c-4df6-a480-2a20deaed6f9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1756 microversion: 2.1 time: 0.164405 Jul 28 20:02:07.118452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 282/538] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:07.945868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b8e4b304-04ca-4b06-8939-25d7233bd2f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:07.946414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b8e4b304-04ca-4b06-8939-25d7233bd2f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:07.952967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8e4b304-04ca-4b06-8939-25d7233bd2f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:07.953410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8e4b304-04ca-4b06-8939-25d7233bd2f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:07.954164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8e4b304-04ca-4b06-8939-25d7233bd2f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:07.954592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8e4b304-04ca-4b06-8939-25d7233bd2f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:08.084511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8e4b304-04ca-4b06-8939-25d7233bd2f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:08.092173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b8e4b304-04ca-4b06-8939-25d7233bd2f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.150129 Jul 28 20:02:08.092744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 257/539] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:07 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:09.112708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0eb0fcd4-0464-4a43-8bf3-2f2ba5a44ce5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:09.113387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0eb0fcd4-0464-4a43-8bf3-2f2ba5a44ce5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:09.121062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eb0fcd4-0464-4a43-8bf3-2f2ba5a44ce5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:09.121504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eb0fcd4-0464-4a43-8bf3-2f2ba5a44ce5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:09.122253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eb0fcd4-0464-4a43-8bf3-2f2ba5a44ce5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:09.122685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eb0fcd4-0464-4a43-8bf3-2f2ba5a44ce5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:09.254173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0eb0fcd4-0464-4a43-8bf3-2f2ba5a44ce5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:09.261908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0eb0fcd4-0464-4a43-8bf3-2f2ba5a44ce5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.153250 Jul 28 20:02:09.262485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 283/540] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:09 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:10.283017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-778c7455-1780-4b3c-9215-3daf001e05ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:10.283622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-778c7455-1780-4b3c-9215-3daf001e05ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:10.290560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-778c7455-1780-4b3c-9215-3daf001e05ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:10.291002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-778c7455-1780-4b3c-9215-3daf001e05ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:10.291774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-778c7455-1780-4b3c-9215-3daf001e05ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:10.292192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-778c7455-1780-4b3c-9215-3daf001e05ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:10.638757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-778c7455-1780-4b3c-9215-3daf001e05ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:10.646257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-778c7455-1780-4b3c-9215-3daf001e05ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.367202 Jul 28 20:02:10.647521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 258/541] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:10 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:11.668710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c4017a96-cf82-4fbe-a5ef-c0f7dea42d36 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:11.668710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c4017a96-cf82-4fbe-a5ef-c0f7dea42d36 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:11.675169 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4017a96-cf82-4fbe-a5ef-c0f7dea42d36 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:11.675606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4017a96-cf82-4fbe-a5ef-c0f7dea42d36 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:11.676351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4017a96-cf82-4fbe-a5ef-c0f7dea42d36 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:11.676869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4017a96-cf82-4fbe-a5ef-c0f7dea42d36 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:11.805707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c4017a96-cf82-4fbe-a5ef-c0f7dea42d36 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:11.809070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:11.813901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c4017a96-cf82-4fbe-a5ef-c0f7dea42d36 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.149786 Jul 28 20:02:11.814461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 284/542] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:11 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:12.025738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-0136415c-efbc-448a-82bd-5e5da452aec3 req-478c8ed7-5d3d-4e1a-93a5-3572ebea0fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86779ed-0aff-43b5-a713-44e5384deb0d", "name": "network-vif-plugged", "status": "completed", "tag": "0ef4ac93-7c07-48a3-8303-7e752c056864"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:12.038885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-0136415c-efbc-448a-82bd-5e5da452aec3 req-478c8ed7-5d3d-4e1a-93a5-3572ebea0fc6 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:12.039766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-0136415c-efbc-448a-82bd-5e5da452aec3 req-478c8ed7-5d3d-4e1a-93a5-3572ebea0fc6 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:12.052517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-0136415c-efbc-448a-82bd-5e5da452aec3 req-478c8ed7-5d3d-4e1a-93a5-3572ebea0fc6 service nova] Creating event network-vif-plugged:0ef4ac93-7c07-48a3-8303-7e752c056864 for instance f86779ed-0aff-43b5-a713-44e5384deb0d on hv-cinder-85144 Jul 28 20:02:12.059222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-0136415c-efbc-448a-82bd-5e5da452aec3 req-478c8ed7-5d3d-4e1a-93a5-3572ebea0fc6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037148 Jul 28 20:02:12.060074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 259/543] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:12.835235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0d9c34fd-4851-49bf-a797-1753688bb43c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:12.835835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0d9c34fd-4851-49bf-a797-1753688bb43c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:12.842234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d9c34fd-4851-49bf-a797-1753688bb43c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:12.842673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d9c34fd-4851-49bf-a797-1753688bb43c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:12.843423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d9c34fd-4851-49bf-a797-1753688bb43c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:12.843848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d9c34fd-4851-49bf-a797-1753688bb43c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:12.978392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0d9c34fd-4851-49bf-a797-1753688bb43c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:12.986193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0d9c34fd-4851-49bf-a797-1753688bb43c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1260 microversion: 2.1 time: 0.155685 Jul 28 20:02:12.986759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 285/544] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:12 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:14.010461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-739ed83b-02c6-4eda-b9da-a84bf2c5a567 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:14.011071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-739ed83b-02c6-4eda-b9da-a84bf2c5a567 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:14.017250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-739ed83b-02c6-4eda-b9da-a84bf2c5a567 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:14.017694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-739ed83b-02c6-4eda-b9da-a84bf2c5a567 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:14.018444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-739ed83b-02c6-4eda-b9da-a84bf2c5a567 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:14.018872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-739ed83b-02c6-4eda-b9da-a84bf2c5a567 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:14.047111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-32517da8-97e0-4966-8825-935f688ad13d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:14.047644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-32517da8-97e0-4966-8825-935f688ad13d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:14.054119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32517da8-97e0-4966-8825-935f688ad13d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:14.054570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32517da8-97e0-4966-8825-935f688ad13d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:14.055321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32517da8-97e0-4966-8825-935f688ad13d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:14.055748 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32517da8-97e0-4966-8825-935f688ad13d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:14.150863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-739ed83b-02c6-4eda-b9da-a84bf2c5a567 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:14.158755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-739ed83b-02c6-4eda-b9da-a84bf2c5a567 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1444 microversion: 2.1 time: 0.152977 Jul 28 20:02:14.159761 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 260/545] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:14.180261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e67dedeb-208a-4e49-bcb4-b9f307c3fedf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:14.181020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e67dedeb-208a-4e49-bcb4-b9f307c3fedf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:14.182805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-32517da8-97e0-4966-8825-935f688ad13d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lazy-loading 'services' on Instance uuid 0baea400-ce43-4ebf-839f-16ffa300fc75 {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:02:14.187086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e67dedeb-208a-4e49-bcb4-b9f307c3fedf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:14.187606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e67dedeb-208a-4e49-bcb4-b9f307c3fedf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:14.188440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e67dedeb-208a-4e49-bcb4-b9f307c3fedf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:14.188948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e67dedeb-208a-4e49-bcb4-b9f307c3fedf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:14.300522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-32517da8-97e0-4966-8825-935f688ad13d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75/os-volume_attachments/abf2f156-ca39-41be-8714-24e4311b34ec" status: 202 len: 0 microversion: 2.1 time: 0.257047 Jul 28 20:02:14.301326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 286/546] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:02:14 2022] DELETE /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75/os-volume_attachments/abf2f156-ca39-41be-8714-24e4311b34ec => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 20:02:14.326527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e67dedeb-208a-4e49-bcb4-b9f307c3fedf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:14.334015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e67dedeb-208a-4e49-bcb4-b9f307c3fedf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1444 microversion: 2.1 time: 0.157834 Jul 28 20:02:14.335069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 261/547] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:16.079494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-bcd226a2-4a83-4962-a308-5fd1ee65bd24 req-99acb316-61c1-4d6d-b8b1-69f2bee35004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86779ed-0aff-43b5-a713-44e5384deb0d", "tag": "0ef4ac93-7c07-48a3-8303-7e752c056864"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:16.090944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-bcd226a2-4a83-4962-a308-5fd1ee65bd24 req-99acb316-61c1-4d6d-b8b1-69f2bee35004 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:16.091384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-bcd226a2-4a83-4962-a308-5fd1ee65bd24 req-99acb316-61c1-4d6d-b8b1-69f2bee35004 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:16.102847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-bcd226a2-4a83-4962-a308-5fd1ee65bd24 req-99acb316-61c1-4d6d-b8b1-69f2bee35004 service nova] Creating event network-changed:0ef4ac93-7c07-48a3-8303-7e752c056864 for instance f86779ed-0aff-43b5-a713-44e5384deb0d on hv-cinder-85144 Jul 28 20:02:16.107915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-bcd226a2-4a83-4962-a308-5fd1ee65bd24 req-99acb316-61c1-4d6d-b8b1-69f2bee35004 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032624 Jul 28 20:02:16.108505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 287/548] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:02:18.765822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bc351fc2-9250-4cb5-90ce-c7f46d02b3b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: .version_select at 0x7f50361c3550>, body: {"keypair": {"name": "tempest-keypair-1632111047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzMxoSLu0w2q2eRuma4Jp1QmRteSLBdDjlJR3ashMtRG0VUSSAsthLIusXgdYC4Ft6egVYfpDuZFQUg4j5VcY2mby2uKSQj/WnJoNpoAEBRSQAv/LIlJBzXYg6G3Y3huA=="}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:18.781509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-bc351fc2-9250-4cb5-90ce-c7f46d02b3b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for project d6612a467ab54632a74cf113b4666eb1. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:02:18.785490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-bc351fc2-9250-4cb5-90ce-c7f46d02b3b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for user bd0b2bfa3d014222afd4e050ca8498f9 and project d6612a467ab54632a74cf113b4666eb1. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:02:18.808103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bc351fc2-9250-4cb5-90ce-c7f46d02b3b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046457 Jul 28 20:02:18.808652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 262/549] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:02:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:19.671433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-59c95c77-69a7-4bde-be79-300336da0d6e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:19.672030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-59c95c77-69a7-4bde-be79-300336da0d6e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:19.674608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=76 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:19.681389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59c95c77-69a7-4bde-be79-300336da0d6e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:19.681840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59c95c77-69a7-4bde-be79-300336da0d6e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:19.682613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59c95c77-69a7-4bde-be79-300336da0d6e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:19.683043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59c95c77-69a7-4bde-be79-300336da0d6e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:19.713706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-59c95c77-69a7-4bde-be79-300336da0d6e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:02:19.796241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-59c95c77-69a7-4bde-be79-300336da0d6e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 204 len: 0 microversion: 2.1 time: 0.128716 Jul 28 20:02:19.797039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 288/550] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:02:19 2022] DELETE /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:02:19.805710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-86f6c3a9-af4a-4c09-bdea-fc574a5a392d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:19.806364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-86f6c3a9-af4a-4c09-bdea-fc574a5a392d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:19.813056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86f6c3a9-af4a-4c09-bdea-fc574a5a392d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:19.813603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86f6c3a9-af4a-4c09-bdea-fc574a5a392d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:19.814431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86f6c3a9-af4a-4c09-bdea-fc574a5a392d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:19.814929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86f6c3a9-af4a-4c09-bdea-fc574a5a392d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:20.027092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-86f6c3a9-af4a-4c09-bdea-fc574a5a392d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:20.034854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-86f6c3a9-af4a-4c09-bdea-fc574a5a392d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1514 microversion: 2.1 time: 0.233570 Jul 28 20:02:20.035508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 263/551] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:19 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:20.183369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1511779238", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5173547b-0aef-47cd-835f-b2a192d02fb4"}], "security_groups": [{"name": "tempest-securitygroup--1833319936"}], "key_name": "tempest-keypair-1632111047", "user_data": "}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:20.297546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.network.neutron [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] validate_networks() for [('5173547b-0aef-47cd-835f-b2a192d02fb4', None, None, None, None, None)] {{(pid=117968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:02:20.666464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Flavor limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:02:20.666891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Image limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:02:20.667365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Flavor pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:02:20.667801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Image pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:02:20.668213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:02:20.677388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:20.678657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:20.679214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:20.679649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:20.696997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for project d6612a467ab54632a74cf113b4666eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:02:20.700933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for user bd0b2bfa3d014222afd4e050ca8498f9 and project d6612a467ab54632a74cf113b4666eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:02:20.711922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Going to run 1 instances... {{(pid=117968) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:02:20.714249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:02:20.762596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d21efba5-96ad-43a2-8be3-4b65c455a0c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.583828 Jul 28 20:02:20.763155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 289/552] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:02:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:02:20.774051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6adb4af-a14e-4f83-a574-086aff9818d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:20.774654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b6adb4af-a14e-4f83-a574-086aff9818d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:20.776726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:20.831321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b6adb4af-a14e-4f83-a574-086aff9818d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:20.839670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b6adb4af-a14e-4f83-a574-086aff9818d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1242 microversion: 2.1 time: 0.069610 Jul 28 20:02:20.840447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 264/553] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:20 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:21.057915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9491cd25-f24e-4929-8ad3-4bd58034626a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:21.058664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9491cd25-f24e-4929-8ad3-4bd58034626a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:21.065029 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9491cd25-f24e-4929-8ad3-4bd58034626a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:21.065553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9491cd25-f24e-4929-8ad3-4bd58034626a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:21.066392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9491cd25-f24e-4929-8ad3-4bd58034626a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:21.066825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9491cd25-f24e-4929-8ad3-4bd58034626a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:21.201870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9491cd25-f24e-4929-8ad3-4bd58034626a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:21.209903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9491cd25-f24e-4929-8ad3-4bd58034626a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1514 microversion: 2.1 time: 0.156055 Jul 28 20:02:21.210473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 290/554] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:21 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:21.861341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f97d55ff-ab5d-4a07-b401-cc242d85b7db tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:21.861941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f97d55ff-ab5d-4a07-b401-cc242d85b7db tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:21.869631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f97d55ff-ab5d-4a07-b401-cc242d85b7db tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:21.870085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f97d55ff-ab5d-4a07-b401-cc242d85b7db tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:21.870832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f97d55ff-ab5d-4a07-b401-cc242d85b7db tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:21.871254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f97d55ff-ab5d-4a07-b401-cc242d85b7db tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:21.889662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:21.945693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f97d55ff-ab5d-4a07-b401-cc242d85b7db tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:21.955290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f97d55ff-ab5d-4a07-b401-cc242d85b7db tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1246 microversion: 2.1 time: 0.097775 Jul 28 20:02:21.955853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 265/555] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:21 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:22.231011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7bd21554-72dc-42d0-b159-279a5efa5eb9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:22.231526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7bd21554-72dc-42d0-b159-279a5efa5eb9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:22.238344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bd21554-72dc-42d0-b159-279a5efa5eb9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:22.238791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bd21554-72dc-42d0-b159-279a5efa5eb9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:22.239553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bd21554-72dc-42d0-b159-279a5efa5eb9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:22.240498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bd21554-72dc-42d0-b159-279a5efa5eb9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:22.579345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7bd21554-72dc-42d0-b159-279a5efa5eb9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:22.586747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7bd21554-72dc-42d0-b159-279a5efa5eb9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1514 microversion: 2.1 time: 0.359658 Jul 28 20:02:22.587300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 291/556] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:22 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1514 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:22.978145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5cf5ade2-9956-42a2-9fe7-a689b009b8ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:22.978793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5cf5ade2-9956-42a2-9fe7-a689b009b8ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:22.985261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf5ade2-9956-42a2-9fe7-a689b009b8ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:22.985706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf5ade2-9956-42a2-9fe7-a689b009b8ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:22.986469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf5ade2-9956-42a2-9fe7-a689b009b8ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:22.986900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf5ade2-9956-42a2-9fe7-a689b009b8ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:23.050311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5cf5ade2-9956-42a2-9fe7-a689b009b8ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:23.059435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5cf5ade2-9956-42a2-9fe7-a689b009b8ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1300 microversion: 2.1 time: 0.085311 Jul 28 20:02:23.059566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 266/557] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:22 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:02:23.136873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-df743466-7ec0-4b1c-b245-a696b72741f1 req-c72b8b57-7f3f-4e4f-8137-8f0edc2a4ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baea400-ce43-4ebf-839f-16ffa300fc75", "name": "network-vif-deleted", "tag": "9f12bdbc-c381-4e57-824b-9c367b322bfe"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:23.149343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-df743466-7ec0-4b1c-b245-a696b72741f1 req-c72b8b57-7f3f-4e4f-8137-8f0edc2a4ad1 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:23.149779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-df743466-7ec0-4b1c-b245-a696b72741f1 req-c72b8b57-7f3f-4e4f-8137-8f0edc2a4ad1 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:23.174452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-df743466-7ec0-4b1c-b245-a696b72741f1 req-c72b8b57-7f3f-4e4f-8137-8f0edc2a4ad1 service nova] Creating event network-vif-deleted:9f12bdbc-c381-4e57-824b-9c367b322bfe for instance 0baea400-ce43-4ebf-839f-16ffa300fc75 on hv-cinder-85144 Jul 28 20:02:23.180877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-df743466-7ec0-4b1c-b245-a696b72741f1 req-c72b8b57-7f3f-4e4f-8137-8f0edc2a4ad1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047606 Jul 28 20:02:23.181950 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 292/558] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:23.608798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:23.609402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:23.616143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:23.616609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:23.617366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:23.617792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:23.648685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:23.649111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:23.649584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lazy-loading 'fault' on Instance uuid 0baea400-ce43-4ebf-839f-16ffa300fc75 {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:02:23.694548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:23.702715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c137ee70-d8b9-48e5-aea8-5a0154156b2e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 200 len: 1309 microversion: 2.1 time: 0.097793 Jul 28 20:02:23.703510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 267/559] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:23 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:24.081682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e19108e2-a52f-4102-9d0a-3c6724afa2b2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:24.082389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e19108e2-a52f-4102-9d0a-3c6724afa2b2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:24.089729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e19108e2-a52f-4102-9d0a-3c6724afa2b2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:24.090183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e19108e2-a52f-4102-9d0a-3c6724afa2b2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:24.090948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e19108e2-a52f-4102-9d0a-3c6724afa2b2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:24.091380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e19108e2-a52f-4102-9d0a-3c6724afa2b2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:24.260039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e19108e2-a52f-4102-9d0a-3c6724afa2b2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:24.269062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e19108e2-a52f-4102-9d0a-3c6724afa2b2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.191537 Jul 28 20:02:24.269980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 293/560] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:24 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:24.726592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:24.727267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 0baea400-ce43-4ebf-839f-16ffa300fc75] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:24.733999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:24.734444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:24.735215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:24.735646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:24.749527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] HTTP exception thrown: Instance 0baea400-ce43-4ebf-839f-16ffa300fc75 could not be found. Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Request method failure captured: Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 HTTP/1.1 Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4ur1zSHv01gg34TFkXuzNCv29zYUg46FPaXMA213_kls4uoFuV6FjYZ-w_RhmNOzbvZeiIoZpkG6_oVHrrctlCk1RLae13dKWMn0LqYdUwKkCqMtuH8JRTsd0V86XgCK-HTKodwItK7fVDMXhylAGaIHS88Rh7N1fuz2Wey9wz76HZU Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:02:24.751086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cc82c1496470409ca70c8cc12023a91e"}]}] Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 316033501d684cc680770c4ccda85d40 Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 0baea400-ce43-4ebf-839f-16ffa300fc75 could not be found. Jul 28 20:02:24.752366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '0baea400-ce43-4ebf-839f-16ffa300fc75'} Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baea400-ce43-4ebf-839f-16ffa300fc75 could not be found. Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:02:24.753330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baea400-ce43-4ebf-839f-16ffa300fc75 could not be found. Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baea400-ce43-4ebf-839f-16ffa300fc75 could not be found. Jul 28 20:02:24.754553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:02:24.757600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Returning 404 to user: Instance 0baea400-ce43-4ebf-839f-16ffa300fc75 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:02:24.757600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2466b6a8-f2de-4f7d-9b86-abf2139554d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75" status: 404 len: 111 microversion: 2.1 time: 0.031113 Jul 28 20:02:24.757600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 268/561] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:24 2022] GET /compute/v2.1/servers/0baea400-ce43-4ebf-839f-16ffa300fc75 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:02:25.197918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-182742a2-8d16-4ca6-b5df-ed295fcc15f5 req-012938c0-a223-436e-b4d2-29fea744a877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38734333-d64b-4885-a501-8d6d573d1457", "tag": "57fdf7c6-890a-4846-a012-38d6bc979e3b"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:25.207852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-182742a2-8d16-4ca6-b5df-ed295fcc15f5 req-012938c0-a223-436e-b4d2-29fea744a877 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:25.208287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-182742a2-8d16-4ca6-b5df-ed295fcc15f5 req-012938c0-a223-436e-b4d2-29fea744a877 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:25.219780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-182742a2-8d16-4ca6-b5df-ed295fcc15f5 req-012938c0-a223-436e-b4d2-29fea744a877 service nova] Creating event network-changed:57fdf7c6-890a-4846-a012-38d6bc979e3b for instance 38734333-d64b-4885-a501-8d6d573d1457 on hv-cinder-85144 Jul 28 20:02:25.225372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-182742a2-8d16-4ca6-b5df-ed295fcc15f5 req-012938c0-a223-436e-b4d2-29fea744a877 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030487 Jul 28 20:02:25.225945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 294/562] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:25.291515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b59ee2d6-57f3-4000-bc68-c9ba4ca61532 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:25.292126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b59ee2d6-57f3-4000-bc68-c9ba4ca61532 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:25.298055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b59ee2d6-57f3-4000-bc68-c9ba4ca61532 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:25.298497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b59ee2d6-57f3-4000-bc68-c9ba4ca61532 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:25.299258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b59ee2d6-57f3-4000-bc68-c9ba4ca61532 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:25.299689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b59ee2d6-57f3-4000-bc68-c9ba4ca61532 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:25.431875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b59ee2d6-57f3-4000-bc68-c9ba4ca61532 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:25.439284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b59ee2d6-57f3-4000-bc68-c9ba4ca61532 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.152889 Jul 28 20:02:25.439828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 269/563] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:25 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:26.461477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b69400ea-1df1-4ea9-bcd1-488125e2c49a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:26.462169 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b69400ea-1df1-4ea9-bcd1-488125e2c49a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:26.469304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b69400ea-1df1-4ea9-bcd1-488125e2c49a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:26.469747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b69400ea-1df1-4ea9-bcd1-488125e2c49a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:26.470503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b69400ea-1df1-4ea9-bcd1-488125e2c49a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:26.470931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b69400ea-1df1-4ea9-bcd1-488125e2c49a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:26.606469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b69400ea-1df1-4ea9-bcd1-488125e2c49a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:26.615872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b69400ea-1df1-4ea9-bcd1-488125e2c49a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.159071 Jul 28 20:02:26.616430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 295/564] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:26 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:27.636679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-27b9438e-8751-4941-b5db-c085f578f236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:27.637284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-27b9438e-8751-4941-b5db-c085f578f236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:27.643757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27b9438e-8751-4941-b5db-c085f578f236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:27.644194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27b9438e-8751-4941-b5db-c085f578f236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:27.644970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27b9438e-8751-4941-b5db-c085f578f236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:27.645393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27b9438e-8751-4941-b5db-c085f578f236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:27.772352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-27b9438e-8751-4941-b5db-c085f578f236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:27.779865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-27b9438e-8751-4941-b5db-c085f578f236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.147036 Jul 28 20:02:27.780418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 270/565] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:27 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:28.801652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cb21328f-d9ed-450f-82eb-f4e600f085fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:28.802716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cb21328f-d9ed-450f-82eb-f4e600f085fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:28.809173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb21328f-d9ed-450f-82eb-f4e600f085fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:28.809615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb21328f-d9ed-450f-82eb-f4e600f085fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:28.810390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb21328f-d9ed-450f-82eb-f4e600f085fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:28.810822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb21328f-d9ed-450f-82eb-f4e600f085fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:28.948551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cb21328f-d9ed-450f-82eb-f4e600f085fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:28.956091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cb21328f-d9ed-450f-82eb-f4e600f085fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.158227 Jul 28 20:02:28.956684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 296/566] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:28 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:29.977027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f42acb2-9cf5-4ba6-aed8-93d9b658fefb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:29.977708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f42acb2-9cf5-4ba6-aed8-93d9b658fefb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:29.984490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f42acb2-9cf5-4ba6-aed8-93d9b658fefb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:29.984966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f42acb2-9cf5-4ba6-aed8-93d9b658fefb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:29.985829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f42acb2-9cf5-4ba6-aed8-93d9b658fefb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:29.986292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f42acb2-9cf5-4ba6-aed8-93d9b658fefb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:30.117589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2f42acb2-9cf5-4ba6-aed8-93d9b658fefb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:30.125469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f42acb2-9cf5-4ba6-aed8-93d9b658fefb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.152914 Jul 28 20:02:30.126024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 271/567] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:29 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:31.148168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-407b2b5e-8904-4342-a67b-c8b1b46e77b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:31.148742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-407b2b5e-8904-4342-a67b-c8b1b46e77b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:31.150736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:31.151435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=6 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:31.157293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-407b2b5e-8904-4342-a67b-c8b1b46e77b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:31.157735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-407b2b5e-8904-4342-a67b-c8b1b46e77b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:31.158481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-407b2b5e-8904-4342-a67b-c8b1b46e77b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:31.159168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-407b2b5e-8904-4342-a67b-c8b1b46e77b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:31.289469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-407b2b5e-8904-4342-a67b-c8b1b46e77b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:31.296838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-407b2b5e-8904-4342-a67b-c8b1b46e77b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.153219 Jul 28 20:02:31.297393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 297/568] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:31 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:32.317489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d0584781-4663-4f7c-bf8a-2f970a16cee0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:32.318103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d0584781-4663-4f7c-bf8a-2f970a16cee0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:32.320525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=6 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:32.326401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0584781-4663-4f7c-bf8a-2f970a16cee0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:32.326843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0584781-4663-4f7c-bf8a-2f970a16cee0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:32.327599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0584781-4663-4f7c-bf8a-2f970a16cee0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:32.328025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0584781-4663-4f7c-bf8a-2f970a16cee0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:32.457394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d0584781-4663-4f7c-bf8a-2f970a16cee0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:32.465323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d0584781-4663-4f7c-bf8a-2f970a16cee0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.151711 Jul 28 20:02:32.465880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 272/569] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:32 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:33.486087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7bc05483-db6d-4fbc-8c5f-cc74dc51af38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:33.486721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7bc05483-db6d-4fbc-8c5f-cc74dc51af38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:33.493829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bc05483-db6d-4fbc-8c5f-cc74dc51af38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:33.494284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bc05483-db6d-4fbc-8c5f-cc74dc51af38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:33.495049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bc05483-db6d-4fbc-8c5f-cc74dc51af38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:33.495482 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bc05483-db6d-4fbc-8c5f-cc74dc51af38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:33.627190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7bc05483-db6d-4fbc-8c5f-cc74dc51af38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:33.635564 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7bc05483-db6d-4fbc-8c5f-cc74dc51af38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.153454 Jul 28 20:02:33.636214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 298/570] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:33 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:34.655734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f9af4b3a-7a4a-40ae-adaa-f6e0800bf24b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:34.656349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f9af4b3a-7a4a-40ae-adaa-f6e0800bf24b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:34.657655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1374721277", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "networks": [{"uuid": "d356d7f4-47c6-4d35-8584-ad706bd0c0af"}]}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:34.663020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9af4b3a-7a4a-40ae-adaa-f6e0800bf24b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:34.663465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9af4b3a-7a4a-40ae-adaa-f6e0800bf24b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:34.664231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9af4b3a-7a4a-40ae-adaa-f6e0800bf24b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:34.664734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9af4b3a-7a4a-40ae-adaa-f6e0800bf24b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:34.713670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.network.neutron [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] validate_networks() for [('d356d7f4-47c6-4d35-8584-ad706bd0c0af', None, None, None, None, None)] {{(pid=117968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:02:34.880746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f9af4b3a-7a4a-40ae-adaa-f6e0800bf24b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:34.888962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f9af4b3a-7a4a-40ae-adaa-f6e0800bf24b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.237003 Jul 28 20:02:34.889436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 273/571] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:34 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:35.121419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Flavor limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:02:35.121846 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Image limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:02:35.122321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Flavor pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:02:35.122731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Image pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:02:35.123173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:02:35.132571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:35.133019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:35.133812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:35.134244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:35.150765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Getting quotas for project cc82c1496470409ca70c8cc12023a91e. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:02:35.155067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Getting quotas for user 316033501d684cc680770c4ccda85d40 and project cc82c1496470409ca70c8cc12023a91e. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:02:35.167759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Going to run 1 instances... {{(pid=117968) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:02:35.170096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:02:35.216591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-869b004f-ad3e-408e-b05d-b0696c4e1ac1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562638 Jul 28 20:02:35.217171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 299/572] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:02:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 20:02:35.227785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0d476b16-42fc-4681-8384-82845d77d243 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:35.228399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0d476b16-42fc-4681-8384-82845d77d243 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:35.284606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0d476b16-42fc-4681-8384-82845d77d243 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:35.292351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0d476b16-42fc-4681-8384-82845d77d243 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1219 microversion: 2.1 time: 0.068270 Jul 28 20:02:35.306502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 274/573] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:35 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:35.331389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-d4b9ad87-487a-40b5-91a7-2f9d8ca8c0ca req-664c092b-5a00-4fab-b2e7-6e2877efb07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38734333-d64b-4885-a501-8d6d573d1457", "name": "network-vif-plugged", "status": "completed", "tag": "57fdf7c6-890a-4846-a012-38d6bc979e3b"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:35.345481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-d4b9ad87-487a-40b5-91a7-2f9d8ca8c0ca req-664c092b-5a00-4fab-b2e7-6e2877efb07e service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:35.346005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-d4b9ad87-487a-40b5-91a7-2f9d8ca8c0ca req-664c092b-5a00-4fab-b2e7-6e2877efb07e service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:35.361312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-d4b9ad87-487a-40b5-91a7-2f9d8ca8c0ca req-664c092b-5a00-4fab-b2e7-6e2877efb07e service nova] Creating event network-vif-plugged:57fdf7c6-890a-4846-a012-38d6bc979e3b for instance 38734333-d64b-4885-a501-8d6d573d1457 on hv-cinder-85144 Jul 28 20:02:35.370128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-d4b9ad87-487a-40b5-91a7-2f9d8ca8c0ca req-664c092b-5a00-4fab-b2e7-6e2877efb07e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043551 Jul 28 20:02:35.371176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 300/574] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:35.910600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-db7b806d-cea7-417d-8f79-f078a8669c42 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:35.911121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-db7b806d-cea7-417d-8f79-f078a8669c42 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:35.918844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db7b806d-cea7-417d-8f79-f078a8669c42 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:35.919288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db7b806d-cea7-417d-8f79-f078a8669c42 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:35.920042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db7b806d-cea7-417d-8f79-f078a8669c42 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:35.920471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db7b806d-cea7-417d-8f79-f078a8669c42 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:36.050308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-db7b806d-cea7-417d-8f79-f078a8669c42 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:36.058524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-db7b806d-cea7-417d-8f79-f078a8669c42 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.152110 Jul 28 20:02:36.059090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 275/575] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:35 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:36.314651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-579c3749-c34c-423d-a368-09f8c851b530 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:36.315345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-579c3749-c34c-423d-a368-09f8c851b530 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:36.322693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-579c3749-c34c-423d-a368-09f8c851b530 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:36.323138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-579c3749-c34c-423d-a368-09f8c851b530 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:36.323889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-579c3749-c34c-423d-a368-09f8c851b530 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:36.324317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-579c3749-c34c-423d-a368-09f8c851b530 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:36.398582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-579c3749-c34c-423d-a368-09f8c851b530 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:36.405902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-579c3749-c34c-423d-a368-09f8c851b530 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1271 microversion: 2.1 time: 0.095986 Jul 28 20:02:36.406454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 301/576] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:36 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:37.080150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-977a5773-045e-4ec3-b7c8-6eae8f8ccb21 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:37.080782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-977a5773-045e-4ec3-b7c8-6eae8f8ccb21 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:37.087784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-977a5773-045e-4ec3-b7c8-6eae8f8ccb21 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:37.088226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-977a5773-045e-4ec3-b7c8-6eae8f8ccb21 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:37.089008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-977a5773-045e-4ec3-b7c8-6eae8f8ccb21 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:37.089434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-977a5773-045e-4ec3-b7c8-6eae8f8ccb21 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:37.217800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-977a5773-045e-4ec3-b7c8-6eae8f8ccb21 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:37.225448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-977a5773-045e-4ec3-b7c8-6eae8f8ccb21 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1368 microversion: 2.1 time: 0.149466 Jul 28 20:02:37.226037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 276/577] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:37 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:37.427282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a281b3d1-6f59-4b1b-a56c-7d8314a0aac7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:37.427901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a281b3d1-6f59-4b1b-a56c-7d8314a0aac7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:37.435138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a281b3d1-6f59-4b1b-a56c-7d8314a0aac7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:37.435584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a281b3d1-6f59-4b1b-a56c-7d8314a0aac7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:37.436338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a281b3d1-6f59-4b1b-a56c-7d8314a0aac7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:37.436818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a281b3d1-6f59-4b1b-a56c-7d8314a0aac7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:37.500685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a281b3d1-6f59-4b1b-a56c-7d8314a0aac7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:37.508614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a281b3d1-6f59-4b1b-a56c-7d8314a0aac7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1279 microversion: 2.1 time: 0.085492 Jul 28 20:02:37.509173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 302/578] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:37 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:38.247176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1010278b-fd68-4e58-91c1-452cbf27d503 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:38.247757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1010278b-fd68-4e58-91c1-452cbf27d503 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:38.254076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1010278b-fd68-4e58-91c1-452cbf27d503 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:38.254510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1010278b-fd68-4e58-91c1-452cbf27d503 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:38.255258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1010278b-fd68-4e58-91c1-452cbf27d503 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:38.255687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1010278b-fd68-4e58-91c1-452cbf27d503 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:38.393093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1010278b-fd68-4e58-91c1-452cbf27d503 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:38.403894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1010278b-fd68-4e58-91c1-452cbf27d503 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1558 microversion: 2.1 time: 0.159417 Jul 28 20:02:38.404472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 277/579] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:38 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:38.426530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-94e58fc2-d47f-4135-840a-71331c5f7296 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:38.427641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-94e58fc2-d47f-4135-840a-71331c5f7296 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:38.435138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94e58fc2-d47f-4135-840a-71331c5f7296 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:38.435669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94e58fc2-d47f-4135-840a-71331c5f7296 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:38.436515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94e58fc2-d47f-4135-840a-71331c5f7296 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:38.437089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94e58fc2-d47f-4135-840a-71331c5f7296 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:38.441101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:38.518739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-94e58fc2-d47f-4135-840a-71331c5f7296 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096133 Jul 28 20:02:38.519326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 303/580] 10.222.0.67 () {58 vars in 1275 bytes} [Thu Jul 28 20:02:38 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:38.531688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0ccdd833-7c71-4daa-a361-ed97e55698f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:38.532522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0ccdd833-7c71-4daa-a361-ed97e55698f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:38.541595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ccdd833-7c71-4daa-a361-ed97e55698f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:38.542049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ccdd833-7c71-4daa-a361-ed97e55698f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:38.542819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ccdd833-7c71-4daa-a361-ed97e55698f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:38.543247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ccdd833-7c71-4daa-a361-ed97e55698f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:38.807895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0ccdd833-7c71-4daa-a361-ed97e55698f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:38.816257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0ccdd833-7c71-4daa-a361-ed97e55698f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1319 microversion: 2.1 time: 0.288480 Jul 28 20:02:38.816873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 278/581] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:38 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:39.322923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-8ffe1a79-f590-4c94-af43-e00e4a420b6c req-c511a955-742f-4b16-98d0-21b82ec54b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "768bb30f-60d9-4ad9-af77-64aadcfe531a", "tag": "712aebad-d9b8-43d5-8376-3174657222f7"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:39.335283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-8ffe1a79-f590-4c94-af43-e00e4a420b6c req-c511a955-742f-4b16-98d0-21b82ec54b0e service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:39.335883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-8ffe1a79-f590-4c94-af43-e00e4a420b6c req-c511a955-742f-4b16-98d0-21b82ec54b0e service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:39.353819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-8ffe1a79-f590-4c94-af43-e00e4a420b6c req-c511a955-742f-4b16-98d0-21b82ec54b0e service nova] Creating event network-changed:712aebad-d9b8-43d5-8376-3174657222f7 for instance 768bb30f-60d9-4ad9-af77-64aadcfe531a on hv-cinder-85144 Jul 28 20:02:39.358888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-8ffe1a79-f590-4c94-af43-e00e4a420b6c req-c511a955-742f-4b16-98d0-21b82ec54b0e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039877 Jul 28 20:02:39.359560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 304/582] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:02:39.563556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-13c27fd0-cd2b-4647-9d03-d8892ff8530a req-a361da53-731c-4b9e-ab06-60376c931afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38734333-d64b-4885-a501-8d6d573d1457", "tag": "57fdf7c6-890a-4846-a012-38d6bc979e3b"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:39.574583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-13c27fd0-cd2b-4647-9d03-d8892ff8530a req-a361da53-731c-4b9e-ab06-60376c931afd service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:39.575086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-13c27fd0-cd2b-4647-9d03-d8892ff8530a req-a361da53-731c-4b9e-ab06-60376c931afd service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:39.587441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-13c27fd0-cd2b-4647-9d03-d8892ff8530a req-a361da53-731c-4b9e-ab06-60376c931afd service nova] Creating event network-changed:57fdf7c6-890a-4846-a012-38d6bc979e3b for instance 38734333-d64b-4885-a501-8d6d573d1457 on hv-cinder-85144 Jul 28 20:02:39.592721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-13c27fd0-cd2b-4647-9d03-d8892ff8530a req-a361da53-731c-4b9e-ab06-60376c931afd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032832 Jul 28 20:02:39.593439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 279/583] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:39.839765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f9948242-36a8-416c-aec6-29071b7a5be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:39.841963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f9948242-36a8-416c-aec6-29071b7a5be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:39.848684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9948242-36a8-416c-aec6-29071b7a5be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:39.849215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9948242-36a8-416c-aec6-29071b7a5be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:39.850239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9948242-36a8-416c-aec6-29071b7a5be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:39.851301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9948242-36a8-416c-aec6-29071b7a5be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:40.010576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f9948242-36a8-416c-aec6-29071b7a5be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:40.019910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f9948242-36a8-416c-aec6-29071b7a5be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1319 microversion: 2.1 time: 0.185616 Jul 28 20:02:40.020712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 305/584] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:39 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:41.042552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fa9e9e05-83a7-44bc-a061-015255628812 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:41.043181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fa9e9e05-83a7-44bc-a061-015255628812 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:41.049875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fa9e9e05-83a7-44bc-a061-015255628812 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:41.050326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fa9e9e05-83a7-44bc-a061-015255628812 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:41.051077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fa9e9e05-83a7-44bc-a061-015255628812 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:41.051534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fa9e9e05-83a7-44bc-a061-015255628812 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:41.179138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fa9e9e05-83a7-44bc-a061-015255628812 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:41.186691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fa9e9e05-83a7-44bc-a061-015255628812 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1319 microversion: 2.1 time: 0.149204 Jul 28 20:02:41.187245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 280/585] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:41 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:42.207165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9c7608c9-8f49-40ec-8a21-2cc2a9f5371b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:42.207770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9c7608c9-8f49-40ec-8a21-2cc2a9f5371b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:42.215952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9c7608c9-8f49-40ec-8a21-2cc2a9f5371b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:42.216399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9c7608c9-8f49-40ec-8a21-2cc2a9f5371b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:42.217183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9c7608c9-8f49-40ec-8a21-2cc2a9f5371b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:42.217613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9c7608c9-8f49-40ec-8a21-2cc2a9f5371b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:42.347041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9c7608c9-8f49-40ec-8a21-2cc2a9f5371b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:42.355205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9c7608c9-8f49-40ec-8a21-2cc2a9f5371b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1319 microversion: 2.1 time: 0.151891 Jul 28 20:02:42.355759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 306/586] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:42 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:43.375786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-796055a3-9dfc-43a7-92d7-2cbcfac2c50b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:43.376427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-796055a3-9dfc-43a7-92d7-2cbcfac2c50b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:43.384291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-796055a3-9dfc-43a7-92d7-2cbcfac2c50b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:43.384775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-796055a3-9dfc-43a7-92d7-2cbcfac2c50b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:43.385578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-796055a3-9dfc-43a7-92d7-2cbcfac2c50b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:43.386010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-796055a3-9dfc-43a7-92d7-2cbcfac2c50b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:43.516971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-796055a3-9dfc-43a7-92d7-2cbcfac2c50b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:43.524875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-796055a3-9dfc-43a7-92d7-2cbcfac2c50b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1319 microversion: 2.1 time: 0.152837 Jul 28 20:02:43.525433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 281/587] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:43 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:44.545496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-10633cfc-f154-4950-90bb-b1a2fcabd5e0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:44.546084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-10633cfc-f154-4950-90bb-b1a2fcabd5e0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:44.553292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10633cfc-f154-4950-90bb-b1a2fcabd5e0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:44.553743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10633cfc-f154-4950-90bb-b1a2fcabd5e0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:44.554676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10633cfc-f154-4950-90bb-b1a2fcabd5e0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:44.555102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10633cfc-f154-4950-90bb-b1a2fcabd5e0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:44.689752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-10633cfc-f154-4950-90bb-b1a2fcabd5e0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:44.697681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-10633cfc-f154-4950-90bb-b1a2fcabd5e0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1319 microversion: 2.1 time: 0.156147 Jul 28 20:02:44.698234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 307/588] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:44 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:45.357846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-8cbf209c-2960-442b-8e67-2486da3a5abd req-c085989f-1a1b-47e9-bd8c-41836fba3662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768bb30f-60d9-4ad9-af77-64aadcfe531a", "name": "network-vif-plugged", "status": "completed", "tag": "712aebad-d9b8-43d5-8376-3174657222f7"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:45.363962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:45.371661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-8cbf209c-2960-442b-8e67-2486da3a5abd req-c085989f-1a1b-47e9-bd8c-41836fba3662 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:45.372108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-8cbf209c-2960-442b-8e67-2486da3a5abd req-c085989f-1a1b-47e9-bd8c-41836fba3662 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:45.383978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-8cbf209c-2960-442b-8e67-2486da3a5abd req-c085989f-1a1b-47e9-bd8c-41836fba3662 service nova] Creating event network-vif-plugged:712aebad-d9b8-43d5-8376-3174657222f7 for instance 768bb30f-60d9-4ad9-af77-64aadcfe531a on hv-cinder-85144 Jul 28 20:02:45.388942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-8cbf209c-2960-442b-8e67-2486da3a5abd req-c085989f-1a1b-47e9-bd8c-41836fba3662 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034664 Jul 28 20:02:45.389790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 282/589] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:02:45.718331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d0513ad8-11ab-4911-91be-f21365cc281a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:45.718936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d0513ad8-11ab-4911-91be-f21365cc281a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:45.720895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:45.721543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=6 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:45.728998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0513ad8-11ab-4911-91be-f21365cc281a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:45.729437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0513ad8-11ab-4911-91be-f21365cc281a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:45.730197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0513ad8-11ab-4911-91be-f21365cc281a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:45.730620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0513ad8-11ab-4911-91be-f21365cc281a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:45.862481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d0513ad8-11ab-4911-91be-f21365cc281a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:45.870216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d0513ad8-11ab-4911-91be-f21365cc281a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1319 microversion: 2.1 time: 0.155769 Jul 28 20:02:45.870781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 308/590] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:45 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:46.892252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b32c1cbf-01ee-49c2-94d9-5be343db50e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:46.892975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b32c1cbf-01ee-49c2-94d9-5be343db50e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:46.899767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b32c1cbf-01ee-49c2-94d9-5be343db50e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:46.900216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b32c1cbf-01ee-49c2-94d9-5be343db50e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:46.901006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b32c1cbf-01ee-49c2-94d9-5be343db50e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:46.901438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b32c1cbf-01ee-49c2-94d9-5be343db50e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:47.029410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b32c1cbf-01ee-49c2-94d9-5be343db50e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:47.037088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b32c1cbf-01ee-49c2-94d9-5be343db50e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1319 microversion: 2.1 time: 0.149606 Jul 28 20:02:47.037638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 283/591] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:46 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:48.058996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-694b84b6-2b0b-45ac-bd42-e7dda5afd2b3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:48.059528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-694b84b6-2b0b-45ac-bd42-e7dda5afd2b3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:48.065989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-694b84b6-2b0b-45ac-bd42-e7dda5afd2b3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:48.066439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-694b84b6-2b0b-45ac-bd42-e7dda5afd2b3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:48.067207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-694b84b6-2b0b-45ac-bd42-e7dda5afd2b3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:48.067640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-694b84b6-2b0b-45ac-bd42-e7dda5afd2b3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:48.200353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-694b84b6-2b0b-45ac-bd42-e7dda5afd2b3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:02:48.207700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-694b84b6-2b0b-45ac-bd42-e7dda5afd2b3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1508 microversion: 2.1 time: 0.152758 Jul 28 20:02:48.208255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 309/592] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:02:48 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:02:48.228815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cf3371f2-690a-46d3-8476-8d69cf8d3b3d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73be0a6e-c54a-4300-afc6-99e7e3423a2c", "device": "/dev/sdb"}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:48.231665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cf3371f2-690a-46d3-8476-8d69cf8d3b3d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:48.238051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf3371f2-690a-46d3-8476-8d69cf8d3b3d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:48.238500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf3371f2-690a-46d3-8476-8d69cf8d3b3d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:48.239258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf3371f2-690a-46d3-8476-8d69cf8d3b3d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:48.239691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf3371f2-690a-46d3-8476-8d69cf8d3b3d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:48.310450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:48.502936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cf3371f2-690a-46d3-8476-8d69cf8d3b3d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "POST /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278713 Jul 28 20:02:48.503540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 284/593] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:02:48 2022] POST /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:52.004707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6c85ca1f-1a19-4cb7-8e08-272a95f7c85a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:52.005243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6c85ca1f-1a19-4cb7-8e08-272a95f7c85a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:52.007957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:52.014168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c85ca1f-1a19-4cb7-8e08-272a95f7c85a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:52.014607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c85ca1f-1a19-4cb7-8e08-272a95f7c85a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:52.015354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c85ca1f-1a19-4cb7-8e08-272a95f7c85a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:52.015780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c85ca1f-1a19-4cb7-8e08-272a95f7c85a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:52.045762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6c85ca1f-1a19-4cb7-8e08-272a95f7c85a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments/8178062c-23f8-434b-a7fe-c00c03ab56e0" status: 200 len: 194 microversion: 2.20 time: 0.045107 Jul 28 20:02:52.046346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 310/594] 10.222.0.67 () {60 vars in 1454 bytes} [Thu Jul 28 20:02:51 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments/8178062c-23f8-434b-a7fe-c00c03ab56e0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:02:52.114426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ff4e1544-49b1-48f6-a065-26f003969c50 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:52.115006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ff4e1544-49b1-48f6-a065-26f003969c50 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:52.117472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=48 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:02:52.122825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff4e1544-49b1-48f6-a065-26f003969c50 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:52.123271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff4e1544-49b1-48f6-a065-26f003969c50 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:52.124023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff4e1544-49b1-48f6-a065-26f003969c50 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:52.124450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff4e1544-49b1-48f6-a065-26f003969c50 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:52.250594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-ff4e1544-49b1-48f6-a065-26f003969c50 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lazy-loading 'services' on Instance uuid 4889e06d-18cf-4e5e-9f68-8c168109c1d3 {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:02:52.367876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ff4e1544-49b1-48f6-a065-26f003969c50 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments/8178062c-23f8-434b-a7fe-c00c03ab56e0" status: 202 len: 0 microversion: 2.20 time: 0.257332 Jul 28 20:02:52.368799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 285/595] 10.222.0.67 () {60 vars in 1457 bytes} [Thu Jul 28 20:02:52 2022] DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments/8178062c-23f8-434b-a7fe-c00c03ab56e0 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:02:52.377322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fa39b7bc-685a-4cd2-9f76-c035debf9546 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:52.379551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fa39b7bc-685a-4cd2-9f76-c035debf9546 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:52.387651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa39b7bc-685a-4cd2-9f76-c035debf9546 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:52.388114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa39b7bc-685a-4cd2-9f76-c035debf9546 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:52.388920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa39b7bc-685a-4cd2-9f76-c035debf9546 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:52.389355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa39b7bc-685a-4cd2-9f76-c035debf9546 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:52.419712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fa39b7bc-685a-4cd2-9f76-c035debf9546 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046374 Jul 28 20:02:52.420276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 311/596] 10.222.0.67 () {60 vars in 1343 bytes} [Thu Jul 28 20:02:52 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:02:53.434308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fdff7831-b47f-47e2-9c56-f28e7f4bf044 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:53.436516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fdff7831-b47f-47e2-9c56-f28e7f4bf044 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:53.442788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdff7831-b47f-47e2-9c56-f28e7f4bf044 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:53.443233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdff7831-b47f-47e2-9c56-f28e7f4bf044 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:53.443976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdff7831-b47f-47e2-9c56-f28e7f4bf044 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:53.444400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdff7831-b47f-47e2-9c56-f28e7f4bf044 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:53.475343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fdff7831-b47f-47e2-9c56-f28e7f4bf044 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046579 Jul 28 20:02:53.475893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 286/597] 10.222.0.67 () {60 vars in 1343 bytes} [Thu Jul 28 20:02:53 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:02:54.488920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2f02201d-708f-43ba-bf8e-334797c7baf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:54.491004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2f02201d-708f-43ba-bf8e-334797c7baf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:54.497525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f02201d-708f-43ba-bf8e-334797c7baf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:54.497976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f02201d-708f-43ba-bf8e-334797c7baf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:54.498726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f02201d-708f-43ba-bf8e-334797c7baf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:54.499155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f02201d-708f-43ba-bf8e-334797c7baf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:54.527614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2f02201d-708f-43ba-bf8e-334797c7baf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042903 Jul 28 20:02:54.528157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 312/598] 10.222.0.67 () {60 vars in 1343 bytes} [Thu Jul 28 20:02:54 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:02:55.539880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-835d8a94-8d5f-45d6-885d-a2a5abd83579 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:55.541962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-835d8a94-8d5f-45d6-885d-a2a5abd83579 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:55.548388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-835d8a94-8d5f-45d6-885d-a2a5abd83579 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:55.548937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-835d8a94-8d5f-45d6-885d-a2a5abd83579 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:55.549675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-835d8a94-8d5f-45d6-885d-a2a5abd83579 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:55.550097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-835d8a94-8d5f-45d6-885d-a2a5abd83579 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:55.579336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-835d8a94-8d5f-45d6-885d-a2a5abd83579 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043645 Jul 28 20:02:55.579885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 287/599] 10.222.0.67 () {60 vars in 1343 bytes} [Thu Jul 28 20:02:55 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:02:56.591303 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fae14780-b795-445d-a767-e10a8970fd33 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:56.593528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fae14780-b795-445d-a767-e10a8970fd33 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:56.600014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fae14780-b795-445d-a767-e10a8970fd33 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:56.600454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fae14780-b795-445d-a767-e10a8970fd33 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:56.601732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fae14780-b795-445d-a767-e10a8970fd33 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:56.602274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fae14780-b795-445d-a767-e10a8970fd33 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:56.631820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fae14780-b795-445d-a767-e10a8970fd33 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044433 Jul 28 20:02:56.632495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 313/600] 10.222.0.67 () {60 vars in 1343 bytes} [Thu Jul 28 20:02:56 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:02:57.645192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e6d838ed-1ee0-4c0b-92c9-2cb93ff16b2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:57.647285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e6d838ed-1ee0-4c0b-92c9-2cb93ff16b2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:57.653773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6d838ed-1ee0-4c0b-92c9-2cb93ff16b2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:57.654212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6d838ed-1ee0-4c0b-92c9-2cb93ff16b2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:57.654961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6d838ed-1ee0-4c0b-92c9-2cb93ff16b2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:57.655414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6d838ed-1ee0-4c0b-92c9-2cb93ff16b2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:57.686171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e6d838ed-1ee0-4c0b-92c9-2cb93ff16b2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044991 Jul 28 20:02:57.686722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 288/601] 10.222.0.67 () {60 vars in 1343 bytes} [Thu Jul 28 20:02:57 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:02:58.043931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5a5fb308-3e10-44b2-942e-8e4b2831480a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ead09975-af7f-40eb-ae0c-70936b340da0"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:02:58.046138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5a5fb308-3e10-44b2-942e-8e4b2831480a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:58.052527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a5fb308-3e10-44b2-942e-8e4b2831480a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:58.052996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a5fb308-3e10-44b2-942e-8e4b2831480a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:58.053768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a5fb308-3e10-44b2-942e-8e4b2831480a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:58.054271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a5fb308-3e10-44b2-942e-8e4b2831480a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:58.699107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aceca3ed-3ed1-451c-a563-7d07c28e7b3a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:58.701269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aceca3ed-3ed1-451c-a563-7d07c28e7b3a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:58.707203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aceca3ed-3ed1-451c-a563-7d07c28e7b3a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:58.707650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aceca3ed-3ed1-451c-a563-7d07c28e7b3a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:58.708402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aceca3ed-3ed1-451c-a563-7d07c28e7b3a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:58.708865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aceca3ed-3ed1-451c-a563-7d07c28e7b3a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:58.740004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aceca3ed-3ed1-451c-a563-7d07c28e7b3a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045320 Jul 28 20:02:58.740567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 289/602] 10.222.0.67 () {60 vars in 1343 bytes} [Thu Jul 28 20:02:58 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 20:02:59.347668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5a5fb308-3e10-44b2-942e-8e4b2831480a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.307589 Jul 28 20:02:59.348432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 314/603] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:02:58 2022] POST /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 194 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:02:59.753139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-841c7377-8389-4350-8a14-2998a08633c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:02:59.755239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-841c7377-8389-4350-8a14-2998a08633c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:02:59.762710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-841c7377-8389-4350-8a14-2998a08633c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:59.763154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-841c7377-8389-4350-8a14-2998a08633c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:59.763914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-841c7377-8389-4350-8a14-2998a08633c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:02:59.764346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-841c7377-8389-4350-8a14-2998a08633c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:02:59.795181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-841c7377-8389-4350-8a14-2998a08633c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045913 Jul 28 20:02:59.795743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 290/604] 10.222.0.67 () {60 vars in 1343 bytes} [Thu Jul 28 20:02:59 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 20:03:00.809648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-629ee406-a4ce-4d73-981a-5fd72ff2b902 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:00.811941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-629ee406-a4ce-4d73-981a-5fd72ff2b902 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:00.818239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-629ee406-a4ce-4d73-981a-5fd72ff2b902 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:00.818680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-629ee406-a4ce-4d73-981a-5fd72ff2b902 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:00.819424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-629ee406-a4ce-4d73-981a-5fd72ff2b902 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:00.819901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-629ee406-a4ce-4d73-981a-5fd72ff2b902 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:00.848275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-629ee406-a4ce-4d73-981a-5fd72ff2b902 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044166 Jul 28 20:03:00.848858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 315/605] 10.222.0.67 () {60 vars in 1343 bytes} [Thu Jul 28 20:03:00 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:03:00.911758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9d079d0b-441f-4de9-b615-8d512c4707c0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:00.912268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9d079d0b-441f-4de9-b615-8d512c4707c0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:00.919278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9d079d0b-441f-4de9-b615-8d512c4707c0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:00.919747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9d079d0b-441f-4de9-b615-8d512c4707c0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:00.920531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9d079d0b-441f-4de9-b615-8d512c4707c0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:00.920982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9d079d0b-441f-4de9-b615-8d512c4707c0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:00.945729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9d079d0b-441f-4de9-b615-8d512c4707c0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Going to try to terminate instance {{(pid=117969) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:03:01.031519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9d079d0b-441f-4de9-b615-8d512c4707c0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 204 len: 0 microversion: 2.20 time: 0.123441 Jul 28 20:03:01.032208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 291/606] 10.222.0.67 () {60 vars in 1280 bytes} [Thu Jul 28 20:03:00 2022] DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 20:03:01.041468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:01.042074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:01.048446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:01.048974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:01.049730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:01.050164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:01.178503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:01.186503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:01.188004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:01.189178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d4eafb77-c514-429c-9040-bafb2ac94879 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.152330 Jul 28 20:03:01.189731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 316/607] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:01 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:02.213535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:02.214260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:02.220704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:02.221153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:02.221908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:02.222335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:02.349499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:02.358258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:02.359768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:02.360957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4677310d-00bf-454e-adf3-d085aee4af2e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.152117 Jul 28 20:03:02.361507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 292/608] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:02 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:03.385517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:03.386126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:03.392566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:03.393021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:03.393770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:03.394194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:03.537887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:03.546582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:03.548108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:03.549316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ccd6f42b-3b16-4ebc-a3be-26ca972ff80d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1722 microversion: 2.20 time: 0.168466 Jul 28 20:03:03.549879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 317/609] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:03 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:04.411915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-d6ce3cba-c7de-4ed9-82dc-525e608a28d5 req-c5854344-51ea-4fc5-88ba-bfb3db5bbebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4889e06d-18cf-4e5e-9f68-8c168109c1d3", "name": "network-vif-deleted", "tag": "e3b95cb5-58ef-47b5-a24c-57117b4da068"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:03:04.425023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-d6ce3cba-c7de-4ed9-82dc-525e608a28d5 req-c5854344-51ea-4fc5-88ba-bfb3db5bbebf service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:04.425463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-d6ce3cba-c7de-4ed9-82dc-525e608a28d5 req-c5854344-51ea-4fc5-88ba-bfb3db5bbebf service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:04.440599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-d6ce3cba-c7de-4ed9-82dc-525e608a28d5 req-c5854344-51ea-4fc5-88ba-bfb3db5bbebf service nova] Creating event network-vif-deleted:e3b95cb5-58ef-47b5-a24c-57117b4da068 for instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 on hv-cinder-85144 Jul 28 20:03:04.447498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-d6ce3cba-c7de-4ed9-82dc-525e608a28d5 req-c5854344-51ea-4fc5-88ba-bfb3db5bbebf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039638 Jul 28 20:03:04.449041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 293/610] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:04.573903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:04.574521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:04.581038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:04.581486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:04.582337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:04.582971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:04.615375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:04.615824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:04.616333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lazy-loading 'fault' on Instance uuid 4889e06d-18cf-4e5e-9f68-8c168109c1d3 {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:03:04.661236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:04.670858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:04.672825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:04.674069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a1621a30-4589-4acc-a946-2fca51197c63 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 200 len: 1371 microversion: 2.20 time: 0.104629 Jul 28 20:03:04.674791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 318/611] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:04 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:05.698916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:05.699520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:05.706505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:05.706974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:05.707725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:05.708152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:05.742359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] HTTP exception thrown: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Request method failure captured: Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 HTTP/1.1 Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upjl8cyhU1Y-w0-xb4Q0VeT6_hQY1Tv0LbmZX-xo3Dkz5AfzsYkSINiJAmdRwJGkFLNDTbXBxqHZbHCk9D2iaP0GLbmd9kw4moiYSBLcfjh22aCpFNERVOvLSrUi_nx2W0Y0UmNcKbFaCPafVRcE7IjtIBs8VezAHDf7jHyDrP2OYk Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:03:05.744039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70cb4fda232e46b6842f8aa7840e48a7"}]}] Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 4e0e1988c7f44d5198811aca33e1345e Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:03:05.745700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '4889e06d-18cf-4e5e-9f68-8c168109c1d3'} Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:03:05.750088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:03:05.751546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:03:05.752823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Returning 404 to user: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:03:05.752823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2e560dc3-733a-45ea-958d-f07288dc88ff tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 404 len: 111 microversion: 2.20 time: 0.050994 Jul 28 20:03:05.752823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 294/612] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:05 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:03:05.754114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-72621430-f0b5-4e3d-a6b7-a1dd76d8aba8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '.version_select at 0x7f5036fb5af0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:05.802002 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-72621430-f0b5-4e3d-a6b7-a1dd76d8aba8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-699652393" status: 204 len: 0 microversion: 2.20 time: 0.051439 Jul 28 20:03:05.802578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 319/613] 10.222.0.67 () {60 vars in 1259 bytes} [Thu Jul 28 20:03:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-699652393 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 20:03:06.437177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c14d41f1-f28b-4033-a5c6-ed8ee7717846 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Action: 'create', calling method: .version_select at 0x7f503604f430>, body: {"keypair": {"name": "tempest-keypair-448301370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbMy/B9pJsjLynL/+NYWKGg+mxJq41RnucbmtjoW7HP3inxicuU4eKrDy6nmBR79gVYMSChaYTWz33f0rUR6WctGK7pnIU+f+v8J9XSr8gz58RY/MWLKTBdoqOOh5paJA=="}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:03:06.453366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-c14d41f1-f28b-4033-a5c6-ed8ee7717846 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Getting quotas for project 70cb4fda232e46b6842f8aa7840e48a7. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:03:06.457870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-c14d41f1-f28b-4033-a5c6-ed8ee7717846 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Getting quotas for user 4e0e1988c7f44d5198811aca33e1345e and project 70cb4fda232e46b6842f8aa7840e48a7. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:03:06.479956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c14d41f1-f28b-4033-a5c6-ed8ee7717846 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046700 Jul 28 20:03:06.480565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 295/614] 10.222.0.67 () {62 vars in 1200 bytes} [Thu Jul 28 20:03:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 28 20:03:07.774337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1673816209", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84a9a07b-45bb-4ad4-8977-5e4500a589e4"}], "security_groups": [{"name": "tempest-securitygroup--1086542947"}], "key_name": "tempest-keypair-448301370", "user_data": "}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:03:07.876247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.network.neutron [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] validate_networks() for [('84a9a07b-45bb-4ad4-8977-5e4500a589e4', None, None, None, None, None)] {{(pid=117968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:03:08.445376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Flavor limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:03:08.445964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Image limits 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:03:08.446431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Flavor pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:03:08.446897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Image pref 0:0:0 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:03:08.447314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.virt.hardware [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:03:08.456497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:08.456991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:08.457798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:08.458238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:08.465828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:08.479159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Getting quotas for project 70cb4fda232e46b6842f8aa7840e48a7. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:03:08.483114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Getting quotas for user 4e0e1988c7f44d5198811aca33e1345e and project 70cb4fda232e46b6842f8aa7840e48a7. Resources: {'instances', 'cores', 'ram'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:03:08.494084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Going to run 1 instances... {{(pid=117968) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:03:08.496328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:03:08.542099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9b2bf4ab-9aec-40a2-8837-92a99f653092 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.773327 Jul 28 20:03:08.542745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 320/615] 10.222.0.67 () {62 vars in 1188 bytes} [Thu Jul 28 20:03:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 20:03:08.553435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0474c359-0553-4885-aa2c-9a7662d1a7f8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:08.554028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0474c359-0553-4885-aa2c-9a7662d1a7f8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:08.610233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0474c359-0553-4885-aa2c-9a7662d1a7f8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:08.618870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0474c359-0553-4885-aa2c-9a7662d1a7f8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:08.620687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0474c359-0553-4885-aa2c-9a7662d1a7f8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:08.622082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0474c359-0553-4885-aa2c-9a7662d1a7f8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1281 microversion: 2.20 time: 0.072209 Jul 28 20:03:08.636980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 296/616] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:08 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:09.645968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:09.646582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:09.654479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:09.654928 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:09.655688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:09.656118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:09.719840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:09.728625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:09.730138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:09.731237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-393171cf-8527-4ba9-bdc8-f4d9a7333b9e tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.089755 Jul 28 20:03:09.731793 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 321/617] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:09 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:10.547441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8bba2e27-29c5-4da5-a761-7ba1b3d538d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1373572415"}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:03:10.548036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8bba2e27-29c5-4da5-a761-7ba1b3d538d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:10.555145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8bba2e27-29c5-4da5-a761-7ba1b3d538d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:10.555586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8bba2e27-29c5-4da5-a761-7ba1b3d538d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:10.556345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8bba2e27-29c5-4da5-a761-7ba1b3d538d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:10.556804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8bba2e27-29c5-4da5-a761-7ba1b3d538d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:10.680160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.network.security_group_api [None req-8bba2e27-29c5-4da5-a761-7ba1b3d538d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Removing security group 4b20e4aa-ef46-47b7-a721-cf509995fced from port 65dd95c0-2195-45fd-8275-f4c90145660b Jul 28 20:03:10.754062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:10.754693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:10.761751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:10.762193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:10.762952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:10.763376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:10.844604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:10.852694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:10.854212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:10.855322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a23751e4-69ac-4f04-9a5b-0f0c8dbc83c9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.105342 Jul 28 20:03:10.856171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 322/618] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:10 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:03:11.061511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8bba2e27-29c5-4da5-a761-7ba1b3d538d5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/action" status: 202 len: 0 microversion: 2.1 time: 0.517891 Jul 28 20:03:11.062106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 297/619] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:03:10 2022] POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:03:11.077668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-081fbab2-f256-4286-a179-ebf83938b36c req-b63e77c9-8bed-489d-af8c-f3d443092e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed7c90e0-e87c-42b9-b14d-6c06761c1eef", "tag": "65dd95c0-2195-45fd-8275-f4c90145660b"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:03:11.096145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-081fbab2-f256-4286-a179-ebf83938b36c req-b63e77c9-8bed-489d-af8c-f3d443092e09 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:11.098760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-081fbab2-f256-4286-a179-ebf83938b36c req-b63e77c9-8bed-489d-af8c-f3d443092e09 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:11.120224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-081fbab2-f256-4286-a179-ebf83938b36c req-b63e77c9-8bed-489d-af8c-f3d443092e09 service nova] Creating event network-changed:65dd95c0-2195-45fd-8275-f4c90145660b for instance ed7c90e0-e87c-42b9-b14d-6c06761c1eef on hv-cinder-85144 Jul 28 20:03:11.130568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-081fbab2-f256-4286-a179-ebf83938b36c req-b63e77c9-8bed-489d-af8c-f3d443092e09 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064117 Jul 28 20:03:11.131922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 323/620] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:11.879575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:11.880198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:11.886555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:11.886997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:11.887756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:11.888186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:11.980420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:11.988205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:11.989829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:11.990916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-75e41985-e78d-4e55-9e60-286f4fcb70d0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.115773 Jul 28 20:03:11.991979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 298/621] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:11 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:12.191341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0eea1d7f-b1ab-4ee0-94c5-d9372585e5f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:12.192010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0eea1d7f-b1ab-4ee0-94c5-d9372585e5f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:12.200906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eea1d7f-b1ab-4ee0-94c5-d9372585e5f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:12.201442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eea1d7f-b1ab-4ee0-94c5-d9372585e5f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:12.202284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eea1d7f-b1ab-4ee0-94c5-d9372585e5f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:12.202806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eea1d7f-b1ab-4ee0-94c5-d9372585e5f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:12.282611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-0eea1d7f-b1ab-4ee0-94c5-d9372585e5f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lazy-loading 'services' on Instance uuid ed7c90e0-e87c-42b9-b14d-6c06761c1eef {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:03:12.358121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0eea1d7f-b1ab-4ee0-94c5-d9372585e5f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac" status: 202 len: 0 microversion: 2.1 time: 0.171384 Jul 28 20:03:12.358716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 324/622] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:03:12 2022] DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:03:12.367802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9de6e725-058f-425b-8503-11450efc48f5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:12.370059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9de6e725-058f-425b-8503-11450efc48f5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:12.376133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9de6e725-058f-425b-8503-11450efc48f5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:12.376616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9de6e725-058f-425b-8503-11450efc48f5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:12.377384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9de6e725-058f-425b-8503-11450efc48f5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:12.377814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9de6e725-058f-425b-8503-11450efc48f5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:12.407363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9de6e725-058f-425b-8503-11450efc48f5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Jul 28 20:03:12.408417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 299/623] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:13.015111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:13.015809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:13.023283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:13.025270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:13.026107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:13.026546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:13.088402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:13.096216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:13.097726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:13.098800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b5df9a71-f677-47ea-822b-6e3da017429d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.088130 Jul 28 20:03:13.099350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 325/624] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:13 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:13.145208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-557a15fc-1a6c-4838-8506-8d058aa50d0c req-33105203-ca8d-4a09-8f54-9447c8d05ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed7c90e0-e87c-42b9-b14d-6c06761c1eef", "tag": "65dd95c0-2195-45fd-8275-f4c90145660b"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:03:13.155188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-557a15fc-1a6c-4838-8506-8d058aa50d0c req-33105203-ca8d-4a09-8f54-9447c8d05ca1 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:13.155626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-557a15fc-1a6c-4838-8506-8d058aa50d0c req-33105203-ca8d-4a09-8f54-9447c8d05ca1 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:13.167613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-557a15fc-1a6c-4838-8506-8d058aa50d0c req-33105203-ca8d-4a09-8f54-9447c8d05ca1 service nova] Creating event network-changed:65dd95c0-2195-45fd-8275-f4c90145660b for instance ed7c90e0-e87c-42b9-b14d-6c06761c1eef on hv-cinder-85144 Jul 28 20:03:13.173267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-557a15fc-1a6c-4838-8506-8d058aa50d0c req-33105203-ca8d-4a09-8f54-9447c8d05ca1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031698 Jul 28 20:03:13.173839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 300/625] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:13.419993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c3e01667-4507-4c10-b23d-532c8f15a66d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:13.422200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c3e01667-4507-4c10-b23d-532c8f15a66d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:13.429164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c3e01667-4507-4c10-b23d-532c8f15a66d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:13.429655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c3e01667-4507-4c10-b23d-532c8f15a66d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:13.430350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c3e01667-4507-4c10-b23d-532c8f15a66d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:13.430774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c3e01667-4507-4c10-b23d-532c8f15a66d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:13.459627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c3e01667-4507-4c10-b23d-532c8f15a66d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Jul 28 20:03:13.460284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 326/626] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:13 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:14.122939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:14.123633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:14.129822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:14.130267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:14.131013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:14.131445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:14.192426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:14.201124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:14.202670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:14.203752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ae4e74e0-e106-42cb-a997-3730b35a3759 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.085094 Jul 28 20:03:14.204296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 301/627] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:14 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:14.471378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-84b83e88-820d-4206-abde-210469c2b157 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:14.473465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-84b83e88-820d-4206-abde-210469c2b157 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:14.480354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-84b83e88-820d-4206-abde-210469c2b157 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:14.480841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-84b83e88-820d-4206-abde-210469c2b157 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:14.481588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-84b83e88-820d-4206-abde-210469c2b157 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:14.482014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-84b83e88-820d-4206-abde-210469c2b157 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:14.511587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-84b83e88-820d-4206-abde-210469c2b157 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Jul 28 20:03:14.512390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 327/628] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:15.228390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:15.229046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:15.235478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:15.235927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:15.236715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:15.237149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:15.241126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:15.418720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:15.426635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:15.428130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:15.429746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e5bb49ee-8fde-4b45-97c6-34653c257fdc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.205573 Jul 28 20:03:15.430296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 302/629] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:15 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:15.524383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d369709e-0f83-4119-8768-24aa13b0168e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:15.526575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d369709e-0f83-4119-8768-24aa13b0168e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:15.532952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d369709e-0f83-4119-8768-24aa13b0168e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:15.533647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d369709e-0f83-4119-8768-24aa13b0168e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:15.534389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d369709e-0f83-4119-8768-24aa13b0168e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:15.534822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d369709e-0f83-4119-8768-24aa13b0168e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:15.563109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d369709e-0f83-4119-8768-24aa13b0168e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042658 Jul 28 20:03:15.563640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 328/630] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:16.452909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:16.453486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:16.460085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:16.460563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:16.461320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:16.461752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:16.521348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:16.529125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:16.530610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:16.531683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b6723fd3-fdfa-4216-a1dd-690f9b797d43 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.082800 Jul 28 20:03:16.532227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 303/631] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:16 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:16.575755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-39ab2f5f-2274-4360-bf60-aa9c42bf3c92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:16.577910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-39ab2f5f-2274-4360-bf60-aa9c42bf3c92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:16.584289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-39ab2f5f-2274-4360-bf60-aa9c42bf3c92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:16.585944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-39ab2f5f-2274-4360-bf60-aa9c42bf3c92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:16.586726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-39ab2f5f-2274-4360-bf60-aa9c42bf3c92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:16.587161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-39ab2f5f-2274-4360-bf60-aa9c42bf3c92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:16.617476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-39ab2f5f-2274-4360-bf60-aa9c42bf3c92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Jul 28 20:03:16.618028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 329/632] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:16 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:17.555623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:17.556221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:17.562620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:17.563057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:17.563799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:17.564226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:17.623286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:17.629669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ffd33942-1763-4c7c-b0f6-63a1f93c473e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:17.631154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:17.632368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ffd33942-1763-4c7c-b0f6-63a1f93c473e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:17.632688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:17.633938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8d703834-912d-4dfc-aefb-cd54df923f93 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.082809 Jul 28 20:03:17.634371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 304/633] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:17 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:17.638930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffd33942-1763-4c7c-b0f6-63a1f93c473e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:17.639373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffd33942-1763-4c7c-b0f6-63a1f93c473e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:17.640136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffd33942-1763-4c7c-b0f6-63a1f93c473e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:17.640587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffd33942-1763-4c7c-b0f6-63a1f93c473e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:17.670823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ffd33942-1763-4c7c-b0f6-63a1f93c473e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Jul 28 20:03:17.671296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 330/634] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:03:18.656516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:18.657131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:18.659619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=6 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:18.665044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:18.665504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:18.666323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:18.666752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:18.682731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6bfdce81-f445-41bc-9cd7-3cdae366a0a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:18.684886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6bfdce81-f445-41bc-9cd7-3cdae366a0a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:18.686835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:18.687492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=6 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:18.694085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bfdce81-f445-41bc-9cd7-3cdae366a0a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:18.695080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bfdce81-f445-41bc-9cd7-3cdae366a0a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:18.695913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bfdce81-f445-41bc-9cd7-3cdae366a0a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:18.696360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bfdce81-f445-41bc-9cd7-3cdae366a0a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:18.726236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6bfdce81-f445-41bc-9cd7-3cdae366a0a0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047260 Jul 28 20:03:18.726973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 331/635] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:18.730557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:18.738406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:18.739884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:18.741684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fd0f76d7-b6c0-45b1-950f-029036e30bfb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.088392 Jul 28 20:03:18.742288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 305/636] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:18 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:19.738583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ac641efe-2fca-4d69-8b5e-461c5ad8c63f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:19.740967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ac641efe-2fca-4d69-8b5e-461c5ad8c63f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:19.747385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac641efe-2fca-4d69-8b5e-461c5ad8c63f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:19.747831 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac641efe-2fca-4d69-8b5e-461c5ad8c63f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:19.748607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac641efe-2fca-4d69-8b5e-461c5ad8c63f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:19.749042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac641efe-2fca-4d69-8b5e-461c5ad8c63f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:19.763879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:19.764411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:19.771040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:19.771485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:19.772933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:19.773366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:19.778318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ac641efe-2fca-4d69-8b5e-461c5ad8c63f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043571 Jul 28 20:03:19.779048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 332/637] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:19.844587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:19.853513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:19.855005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:19.856092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d20fb77c-a541-4c53-994d-802be0b61da9 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.096192 Jul 28 20:03:19.856661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 306/638] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:19 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:03:20.792123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2b3eb551-9221-426c-8895-3574c345e35d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:20.794269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2b3eb551-9221-426c-8895-3574c345e35d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:20.800774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b3eb551-9221-426c-8895-3574c345e35d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:20.801226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b3eb551-9221-426c-8895-3574c345e35d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:20.801986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b3eb551-9221-426c-8895-3574c345e35d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:20.802420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b3eb551-9221-426c-8895-3574c345e35d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:20.831965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2b3eb551-9221-426c-8895-3574c345e35d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Jul 28 20:03:20.832509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 333/639] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:20 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:20.878355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:20.878960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:20.886006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:20.886457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:20.887207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:20.887639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:20.948466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:20.956373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:20.957899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:20.959022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8ebd62c2-d06e-4ad3-9fa4-c3bdca28f602 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.084501 Jul 28 20:03:20.960205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 307/640] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:20 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:21.844843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-266be62c-75e4-4298-b7a5-a17b873c9566 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:21.846961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-266be62c-75e4-4298-b7a5-a17b873c9566 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:21.854156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-266be62c-75e4-4298-b7a5-a17b873c9566 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:21.854608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-266be62c-75e4-4298-b7a5-a17b873c9566 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:21.855372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-266be62c-75e4-4298-b7a5-a17b873c9566 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:21.855809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-266be62c-75e4-4298-b7a5-a17b873c9566 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:21.884218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-266be62c-75e4-4298-b7a5-a17b873c9566 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043284 Jul 28 20:03:21.884823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 334/641] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:21.982592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:21.983257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:21.989853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:21.990479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:21.991050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:21.991488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:22.052640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:22.060662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:22.062170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:22.063263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7dff9b6d-6943-4192-b8b0-12cfb5bb10fc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.084611 Jul 28 20:03:22.063810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 308/642] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:21 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:03:22.896613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-34819b5c-13f2-49a6-8037-0095e76e8c07 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:22.898895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-34819b5c-13f2-49a6-8037-0095e76e8c07 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:22.901390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:22.906664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34819b5c-13f2-49a6-8037-0095e76e8c07 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:22.907105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34819b5c-13f2-49a6-8037-0095e76e8c07 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:22.907856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34819b5c-13f2-49a6-8037-0095e76e8c07 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:22.908556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34819b5c-13f2-49a6-8037-0095e76e8c07 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:22.939350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-34819b5c-13f2-49a6-8037-0095e76e8c07 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046525 Jul 28 20:03:22.939944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 335/643] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:22 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:23.086308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:23.086926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:23.089274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:23.095154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:23.095601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:23.096395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:23.096862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:23.156870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:23.165755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:23.167262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:23.168367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-33cce359-8769-4e7e-b0cf-abbd20606d5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.086151 Jul 28 20:03:23.169119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 309/644] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:23 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:23.951405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4bd7b479-a462-4511-8135-da6abac216ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:23.953552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4bd7b479-a462-4511-8135-da6abac216ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:23.960100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bd7b479-a462-4511-8135-da6abac216ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:23.960558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bd7b479-a462-4511-8135-da6abac216ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:23.961327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bd7b479-a462-4511-8135-da6abac216ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:23.961751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bd7b479-a462-4511-8135-da6abac216ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:23.990664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4bd7b479-a462-4511-8135-da6abac216ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042966 Jul 28 20:03:23.991864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 336/645] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:24.191133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:24.191744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:24.199310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:24.199759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:24.200521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:24.200977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:24.272675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:24.280628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:24.282135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:24.283536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-26336412-97d2-410f-8c60-312581b73059 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.096004 Jul 28 20:03:24.284084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 310/646] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:24 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:25.003500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8b58558d-d944-4434-b638-691dac0523f0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:25.005695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8b58558d-d944-4434-b638-691dac0523f0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:25.012767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b58558d-d944-4434-b638-691dac0523f0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:25.013217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b58558d-d944-4434-b638-691dac0523f0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:25.013978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b58558d-d944-4434-b638-691dac0523f0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:25.014418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b58558d-d944-4434-b638-691dac0523f0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:25.030803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:25.045297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8b58558d-d944-4434-b638-691dac0523f0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045649 Jul 28 20:03:25.045776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 337/647] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:25.309490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:25.310014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:25.316503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:25.316980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:25.317735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:25.318260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:25.380254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:25.389016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:25.390503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:25.391580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e0d6931a-1abd-4de4-b99a-417e9137a4a5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.086094 Jul 28 20:03:25.392122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 311/648] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:25 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:26.057855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e3b10bb1-68c3-424b-9f9d-131c1a9a35ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:26.059901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e3b10bb1-68c3-424b-9f9d-131c1a9a35ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:26.066445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3b10bb1-68c3-424b-9f9d-131c1a9a35ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.066881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3b10bb1-68c3-424b-9f9d-131c1a9a35ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.067642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3b10bb1-68c3-424b-9f9d-131c1a9a35ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.068068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3b10bb1-68c3-424b-9f9d-131c1a9a35ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.097179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e3b10bb1-68c3-424b-9f9d-131c1a9a35ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Jul 28 20:03:26.097729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 338/649] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:26.113945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4630b0bf-9599-4e20-9c5e-3266024e3111 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:26.114432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4630b0bf-9599-4e20-9c5e-3266024e3111 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:26.120822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4630b0bf-9599-4e20-9c5e-3266024e3111 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.121268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4630b0bf-9599-4e20-9c5e-3266024e3111 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.122023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4630b0bf-9599-4e20-9c5e-3266024e3111 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.122452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4630b0bf-9599-4e20-9c5e-3266024e3111 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.148732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4630b0bf-9599-4e20-9c5e-3266024e3111 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457/ips" status: 200 len: 149 microversion: 2.1 time: 0.038494 Jul 28 20:03:26.149297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 312/650] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 20:03:26 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:26.161569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:03:26.167940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:26.170201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.170636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.171400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.171835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.348167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Invalid volume: volume 47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f is already attached to instances: c1cb56a8-6993-4767-9e30-5786f3b94743 Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: POST /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457/os-volume_attachments HTTP/1.1 Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 74 Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:03:26.350795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {"volumeAttachment": {"volumeId": "47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f"}} Jul 28 20:03:26.352363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid volume: volume 47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f is already attached to instances: c1cb56a8-6993-4767-9e30-5786f3b94743 Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'server_id': '38734333-d64b-4885-a501-8d6d573d1457', 'body': {'volumeAttachment': {'volumeId': '47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f'}}} Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f is already attached to instances: c1cb56a8-6993-4767-9e30-5786f3b94743 Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:03:26.353262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f is already attached to instances: c1cb56a8-6993-4767-9e30-5786f3b94743 Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:03:26.354438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:03:26.355610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:03:26.355610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:03:26.355610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:03:26.355610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f is already attached to instances: c1cb56a8-6993-4767-9e30-5786f3b94743 Jul 28 20:03:26.355610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:03:26.355610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 400 to user: Invalid volume: volume 47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f is already attached to instances: c1cb56a8-6993-4767-9e30-5786f3b94743 {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:03:26.355610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1500766a-96d3-43e4-a8b4-707a09d81c03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.194988 Jul 28 20:03:26.355610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 339/651] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:03:26 2022] POST /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457/os-volume_attachments => generated 174 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:03:26.361055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b866fc71-860c-4dfd-809f-fb2a781e0e5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:26.361547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b866fc71-860c-4dfd-809f-fb2a781e0e5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:26.368427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b866fc71-860c-4dfd-809f-fb2a781e0e5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.368908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b866fc71-860c-4dfd-809f-fb2a781e0e5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.369654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b866fc71-860c-4dfd-809f-fb2a781e0e5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.370081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b866fc71-860c-4dfd-809f-fb2a781e0e5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.395664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b866fc71-860c-4dfd-809f-fb2a781e0e5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Going to try to terminate instance {{(pid=117969) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:03:26.415161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:26.415857 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:26.422293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.422742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.423525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.423959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.486766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b866fc71-860c-4dfd-809f-fb2a781e0e5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 204 len: 0 microversion: 2.1 time: 0.128896 Jul 28 20:03:26.487443 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:26.487762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 313/652] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:03:26 2022] DELETE /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:03:26.497872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-67f19f76-e701-4fc4-a864-2ba9890c62e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:26.498574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-67f19f76-e701-4fc4-a864-2ba9890c62e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:26.499165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:26.501550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:26.503206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dd8cdcd3-8b18-421f-8c9b-7b51be12f03d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.092315 Jul 28 20:03:26.504006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 340/653] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:26 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:03:26.504700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67f19f76-e701-4fc4-a864-2ba9890c62e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.505217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67f19f76-e701-4fc4-a864-2ba9890c62e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.505984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67f19f76-e701-4fc4-a864-2ba9890c62e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:26.507203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67f19f76-e701-4fc4-a864-2ba9890c62e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:26.640622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-67f19f76-e701-4fc4-a864-2ba9890c62e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:26.648382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-67f19f76-e701-4fc4-a864-2ba9890c62e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.154607 Jul 28 20:03:26.649039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 314/654] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:26 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:27.109672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-371b5ab2-4745-44ca-92a7-9a0bc35bade0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:27.111889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-371b5ab2-4745-44ca-92a7-9a0bc35bade0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:27.118795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-371b5ab2-4745-44ca-92a7-9a0bc35bade0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:27.119845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-371b5ab2-4745-44ca-92a7-9a0bc35bade0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:27.120632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-371b5ab2-4745-44ca-92a7-9a0bc35bade0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:27.121067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-371b5ab2-4745-44ca-92a7-9a0bc35bade0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:27.151901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-371b5ab2-4745-44ca-92a7-9a0bc35bade0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046133 Jul 28 20:03:27.152455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 341/655] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:27 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:27.587811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:27.588455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:27.594594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:27.595039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:27.595788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:27.596218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:27.656444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:27.664451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:27.665962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:27.667052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-92b3cd15-4a2c-425b-866b-c65956918ef0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.137435 Jul 28 20:03:27.667628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 315/656] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:27 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:27.671067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8fbfb94b-2cb9-419d-8cae-a848165100b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:27.671676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8fbfb94b-2cb9-419d-8cae-a848165100b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:27.677656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fbfb94b-2cb9-419d-8cae-a848165100b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:27.678237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fbfb94b-2cb9-419d-8cae-a848165100b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:27.679021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fbfb94b-2cb9-419d-8cae-a848165100b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:27.679456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fbfb94b-2cb9-419d-8cae-a848165100b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:27.808416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8fbfb94b-2cb9-419d-8cae-a848165100b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:27.815815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8fbfb94b-2cb9-419d-8cae-a848165100b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.148573 Jul 28 20:03:27.816361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 342/657] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:27 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:03:28.164483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0b8d91b5-8fc2-4a98-b963-db8e4a44b4fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:28.166762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0b8d91b5-8fc2-4a98-b963-db8e4a44b4fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:28.172872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b8d91b5-8fc2-4a98-b963-db8e4a44b4fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:28.173320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b8d91b5-8fc2-4a98-b963-db8e4a44b4fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:28.174084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b8d91b5-8fc2-4a98-b963-db8e4a44b4fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:28.174515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b8d91b5-8fc2-4a98-b963-db8e4a44b4fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:28.203275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0b8d91b5-8fc2-4a98-b963-db8e4a44b4fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042603 Jul 28 20:03:28.203826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 316/658] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:28.689423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:28.690031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:28.697623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:28.698064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:28.698815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:28.699247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:28.762044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:28.769784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:28.771288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:28.772958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-929b38b2-6a1a-4abf-b71a-aa1f1f06f007 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.087369 Jul 28 20:03:28.773511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 343/659] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:28 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:28.838277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-727e78fd-6dee-4397-b25f-8520848a9057 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:28.838881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-727e78fd-6dee-4397-b25f-8520848a9057 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:28.845396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-727e78fd-6dee-4397-b25f-8520848a9057 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:28.845833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-727e78fd-6dee-4397-b25f-8520848a9057 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:28.846578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-727e78fd-6dee-4397-b25f-8520848a9057 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:28.847000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-727e78fd-6dee-4397-b25f-8520848a9057 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:28.864506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:28.977553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-727e78fd-6dee-4397-b25f-8520848a9057 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:28.984788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-727e78fd-6dee-4397-b25f-8520848a9057 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.150904 Jul 28 20:03:28.985336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 317/660] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:28 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:29.215746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f6badac8-88dd-4380-92de-e166a157ba02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:29.218008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f6badac8-88dd-4380-92de-e166a157ba02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:29.223951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6badac8-88dd-4380-92de-e166a157ba02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:29.224457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6badac8-88dd-4380-92de-e166a157ba02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:29.226199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6badac8-88dd-4380-92de-e166a157ba02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:29.226635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6badac8-88dd-4380-92de-e166a157ba02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:29.255369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f6badac8-88dd-4380-92de-e166a157ba02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Jul 28 20:03:29.255957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 344/661] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:29.795928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:29.796529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:29.802439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:29.803281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:29.803807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:29.804233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:29.866389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:29.874309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:29.875798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:29.876917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-16aaedb8-73b3-4ff0-9fd0-0319a4cc9dd2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.084796 Jul 28 20:03:29.877460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 318/662] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:29 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:30.007421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9acd9612-eda8-4261-a113-6ac2804e19fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:30.007963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9acd9612-eda8-4261-a113-6ac2804e19fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:30.014402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9acd9612-eda8-4261-a113-6ac2804e19fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:30.014881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9acd9612-eda8-4261-a113-6ac2804e19fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:30.015647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9acd9612-eda8-4261-a113-6ac2804e19fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:30.016081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9acd9612-eda8-4261-a113-6ac2804e19fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:30.148863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9acd9612-eda8-4261-a113-6ac2804e19fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:30.158788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9acd9612-eda8-4261-a113-6ac2804e19fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.155936 Jul 28 20:03:30.159350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 345/663] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:30 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:30.268071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c24e1f12-0976-4d0b-93ce-08047f89d826 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:30.270341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c24e1f12-0976-4d0b-93ce-08047f89d826 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:30.276429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c24e1f12-0976-4d0b-93ce-08047f89d826 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:30.276898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c24e1f12-0976-4d0b-93ce-08047f89d826 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:30.277644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c24e1f12-0976-4d0b-93ce-08047f89d826 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:30.278067 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c24e1f12-0976-4d0b-93ce-08047f89d826 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:30.306168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c24e1f12-0976-4d0b-93ce-08047f89d826 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042033 Jul 28 20:03:30.306707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 319/664] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:30.902697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:30.903300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:30.909670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:30.910115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:30.910855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:30.911283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:30.970727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:30.979391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:30.980932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:30.982027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-40958482-e067-4758-985d-b1eec6356d0f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.083234 Jul 28 20:03:30.982578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 346/665] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:30 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:31.180784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c6c2713d-fcd8-4ae4-b3f4-f2b0ad939908 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:31.181516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c6c2713d-fcd8-4ae4-b3f4-f2b0ad939908 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:31.188335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6c2713d-fcd8-4ae4-b3f4-f2b0ad939908 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:31.188813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6c2713d-fcd8-4ae4-b3f4-f2b0ad939908 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:31.189577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6c2713d-fcd8-4ae4-b3f4-f2b0ad939908 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:31.190011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6c2713d-fcd8-4ae4-b3f4-f2b0ad939908 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:31.319075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9dc61ca1-6c75-4cff-b854-111f80145f87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:31.321285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9dc61ca1-6c75-4cff-b854-111f80145f87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:31.321831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c6c2713d-fcd8-4ae4-b3f4-f2b0ad939908 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:31.327260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9dc61ca1-6c75-4cff-b854-111f80145f87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:31.327696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9dc61ca1-6c75-4cff-b854-111f80145f87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:31.328554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9dc61ca1-6c75-4cff-b854-111f80145f87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:31.329031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9dc61ca1-6c75-4cff-b854-111f80145f87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:31.329856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c6c2713d-fcd8-4ae4-b3f4-f2b0ad939908 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.152779 Jul 28 20:03:31.330504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 320/666] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:31 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:31.358180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9dc61ca1-6c75-4cff-b854-111f80145f87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043616 Jul 28 20:03:31.358717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 347/667] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:03:32.004813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:32.005342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:32.011939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:32.012376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:32.013157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:32.013583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:32.076064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:32.083915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:32.086165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:32.087249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d06bc0e3-3ce7-4a55-bf98-12fa25c17310 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.086389 Jul 28 20:03:32.087829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 321/668] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:31 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:32.353600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b903edf5-34cd-4621-9c54-9aa3a150e7a1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:32.354205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b903edf5-34cd-4621-9c54-9aa3a150e7a1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:32.360637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b903edf5-34cd-4621-9c54-9aa3a150e7a1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:32.361078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b903edf5-34cd-4621-9c54-9aa3a150e7a1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:32.361819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b903edf5-34cd-4621-9c54-9aa3a150e7a1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:32.362246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b903edf5-34cd-4621-9c54-9aa3a150e7a1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:32.370790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-479972a6-9763-4bd4-a195-ff407b53c888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:32.373116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-479972a6-9763-4bd4-a195-ff407b53c888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:32.379645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-479972a6-9763-4bd4-a195-ff407b53c888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:32.380091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-479972a6-9763-4bd4-a195-ff407b53c888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:32.381527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-479972a6-9763-4bd4-a195-ff407b53c888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:32.382046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-479972a6-9763-4bd4-a195-ff407b53c888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:32.410549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-479972a6-9763-4bd4-a195-ff407b53c888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Jul 28 20:03:32.411101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 322/669] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:03:32.491420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b903edf5-34cd-4621-9c54-9aa3a150e7a1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:32.498740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b903edf5-34cd-4621-9c54-9aa3a150e7a1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.150486 Jul 28 20:03:32.499309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 348/670] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:32 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:33.110012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:33.110606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:33.117494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:33.117957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:33.118698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:33.119121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:33.178519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:33.186487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:33.187971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:33.189088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eca4f212-2071-48bc-8c57-317361811b51 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.082941 Jul 28 20:03:33.189684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 323/671] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:33 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:33.422968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fd79ce9b-339d-43b9-b0d1-a7a91f0ce989 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:33.425060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fd79ce9b-339d-43b9-b0d1-a7a91f0ce989 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:33.432264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd79ce9b-339d-43b9-b0d1-a7a91f0ce989 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:33.432759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd79ce9b-339d-43b9-b0d1-a7a91f0ce989 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:33.433523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd79ce9b-339d-43b9-b0d1-a7a91f0ce989 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:33.433963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd79ce9b-339d-43b9-b0d1-a7a91f0ce989 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:33.461698 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fd79ce9b-339d-43b9-b0d1-a7a91f0ce989 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042783 Jul 28 20:03:33.462243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 349/672] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:33.520593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1802df03-07e2-4d28-831e-85ce07d3d775 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:33.521201 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1802df03-07e2-4d28-831e-85ce07d3d775 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:33.527102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1802df03-07e2-4d28-831e-85ce07d3d775 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:33.527540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1802df03-07e2-4d28-831e-85ce07d3d775 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:33.528282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1802df03-07e2-4d28-831e-85ce07d3d775 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:33.528734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1802df03-07e2-4d28-831e-85ce07d3d775 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:33.656152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1802df03-07e2-4d28-831e-85ce07d3d775 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:33.664625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1802df03-07e2-4d28-831e-85ce07d3d775 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.147856 Jul 28 20:03:33.665176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 324/673] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:33 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:34.212845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:34.213450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:34.219514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:34.219951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:34.220728 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:34.221173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:34.280096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:34.288799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:34.290292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:34.291382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a8ac2ce3-478b-4618-8f38-5eea26f6d60d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.082890 Jul 28 20:03:34.291929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 350/674] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:34 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:34.474193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-19212c60-04d6-4bc5-b93e-7f5c4ff1e299 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:34.476931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-19212c60-04d6-4bc5-b93e-7f5c4ff1e299 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:34.483441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19212c60-04d6-4bc5-b93e-7f5c4ff1e299 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:34.483890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19212c60-04d6-4bc5-b93e-7f5c4ff1e299 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:34.484689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19212c60-04d6-4bc5-b93e-7f5c4ff1e299 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:34.485125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19212c60-04d6-4bc5-b93e-7f5c4ff1e299 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:34.513919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-19212c60-04d6-4bc5-b93e-7f5c4ff1e299 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 Jul 28 20:03:34.514464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 325/675] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:34.686043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d6b5c7a1-0769-4ad2-9c5f-2a8c3b936f20 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:34.686596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d6b5c7a1-0769-4ad2-9c5f-2a8c3b936f20 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:34.692963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6b5c7a1-0769-4ad2-9c5f-2a8c3b936f20 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:34.693485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6b5c7a1-0769-4ad2-9c5f-2a8c3b936f20 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:34.694491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6b5c7a1-0769-4ad2-9c5f-2a8c3b936f20 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:34.694918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6b5c7a1-0769-4ad2-9c5f-2a8c3b936f20 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:34.820656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d6b5c7a1-0769-4ad2-9c5f-2a8c3b936f20 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:34.828066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d6b5c7a1-0769-4ad2-9c5f-2a8c3b936f20 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.145918 Jul 28 20:03:34.828634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 351/676] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:34 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:35.314464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:35.315063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:35.321445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:35.321871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:35.322674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:35.323058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:35.385587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:35.393533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:35.395037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:35.396130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-577c7041-2e21-424d-8501-b85f413c5702 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.085596 Jul 28 20:03:35.397290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 326/677] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:35 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:35.526328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e93720ea-6eca-4342-ace3-e6eaa185ace5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:35.528526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e93720ea-6eca-4342-ace3-e6eaa185ace5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:35.534867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e93720ea-6eca-4342-ace3-e6eaa185ace5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:35.535314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e93720ea-6eca-4342-ace3-e6eaa185ace5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:35.536081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e93720ea-6eca-4342-ace3-e6eaa185ace5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:35.536510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e93720ea-6eca-4342-ace3-e6eaa185ace5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:35.564472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e93720ea-6eca-4342-ace3-e6eaa185ace5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042145 Jul 28 20:03:35.565060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 352/678] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:35.849907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b8aff45c-48d5-4544-9ebb-1cd7213ba7b8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:35.850511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b8aff45c-48d5-4544-9ebb-1cd7213ba7b8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:35.857007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8aff45c-48d5-4544-9ebb-1cd7213ba7b8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:35.857454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8aff45c-48d5-4544-9ebb-1cd7213ba7b8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:35.858208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8aff45c-48d5-4544-9ebb-1cd7213ba7b8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:35.858636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8aff45c-48d5-4544-9ebb-1cd7213ba7b8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:35.984497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8aff45c-48d5-4544-9ebb-1cd7213ba7b8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:35.992752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b8aff45c-48d5-4544-9ebb-1cd7213ba7b8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.146632 Jul 28 20:03:35.993331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 327/679] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:35 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:36.419031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:36.419640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:36.426091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:36.426538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:36.427291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:36.428492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:36.486983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:36.495753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:36.497278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:36.498365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d2b8aa7e-2f5a-4379-9ce4-41d1f4cbd66a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.083171 Jul 28 20:03:36.498918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 353/680] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:36 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:36.577453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5634d28b-cb1d-489c-9e6c-7f5157e45201 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:36.579600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5634d28b-cb1d-489c-9e6c-7f5157e45201 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:36.585631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5634d28b-cb1d-489c-9e6c-7f5157e45201 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:36.586073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5634d28b-cb1d-489c-9e6c-7f5157e45201 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:36.586827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5634d28b-cb1d-489c-9e6c-7f5157e45201 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:36.587258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5634d28b-cb1d-489c-9e6c-7f5157e45201 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:36.616688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5634d28b-cb1d-489c-9e6c-7f5157e45201 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043048 Jul 28 20:03:36.617222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 328/681] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:36 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:37.014749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fedea92a-433d-4f33-aee7-2a79581b559b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:37.015363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fedea92a-433d-4f33-aee7-2a79581b559b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:37.021930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fedea92a-433d-4f33-aee7-2a79581b559b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:37.022375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fedea92a-433d-4f33-aee7-2a79581b559b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:37.023128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fedea92a-433d-4f33-aee7-2a79581b559b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:37.023562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fedea92a-433d-4f33-aee7-2a79581b559b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:37.027440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:37.156241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fedea92a-433d-4f33-aee7-2a79581b559b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:37.164992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fedea92a-433d-4f33-aee7-2a79581b559b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.153959 Jul 28 20:03:37.166021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 354/682] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:37 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:37.521069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:37.521677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:37.528076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:37.528517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:37.529310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:37.529736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:37.590280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:37.598511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:37.601480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:37.602766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3f9fbacd-d759-4f27-ad0e-4c3070c17d06 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.085660 Jul 28 20:03:37.603322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 329/683] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:37 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:37.628919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0eb86186-6af2-4870-af35-e3795d542468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:37.632103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0eb86186-6af2-4870-af35-e3795d542468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:37.638481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eb86186-6af2-4870-af35-e3795d542468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:37.638920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eb86186-6af2-4870-af35-e3795d542468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:37.639673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eb86186-6af2-4870-af35-e3795d542468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:37.640100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0eb86186-6af2-4870-af35-e3795d542468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:37.668248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0eb86186-6af2-4870-af35-e3795d542468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043229 Jul 28 20:03:37.668745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 355/684] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:38.186177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2d029956-e865-4d7b-89f6-18a3e90bf0b9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:38.186786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2d029956-e865-4d7b-89f6-18a3e90bf0b9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:38.192993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d029956-e865-4d7b-89f6-18a3e90bf0b9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:38.193759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d029956-e865-4d7b-89f6-18a3e90bf0b9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:38.194300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d029956-e865-4d7b-89f6-18a3e90bf0b9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:38.194732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d029956-e865-4d7b-89f6-18a3e90bf0b9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:38.322673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2d029956-e865-4d7b-89f6-18a3e90bf0b9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:38.329966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2d029956-e865-4d7b-89f6-18a3e90bf0b9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.147711 Jul 28 20:03:38.330513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 330/685] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:38 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:38.626075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:38.626716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:38.633599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:38.634196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:38.634800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:38.635245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:38.680423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8a173af2-e6ad-42d7-9c4b-048bd06be577 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:38.682630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8a173af2-e6ad-42d7-9c4b-048bd06be577 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:38.689009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a173af2-e6ad-42d7-9c4b-048bd06be577 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:38.689453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a173af2-e6ad-42d7-9c4b-048bd06be577 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:38.690210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a173af2-e6ad-42d7-9c4b-048bd06be577 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:38.690640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a173af2-e6ad-42d7-9c4b-048bd06be577 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:38.700119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:38.708073 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:38.710415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:38.711522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cda3c5e9-e160-4904-a2eb-f78b97ff045b tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.089328 Jul 28 20:03:38.712072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 356/686] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:38 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:38.721472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8a173af2-e6ad-42d7-9c4b-048bd06be577 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Jul 28 20:03:38.722008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 331/687] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:03:39.351026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0b5e108a-1085-4097-98f9-921c3d9555aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:39.351642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0b5e108a-1085-4097-98f9-921c3d9555aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:39.357640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b5e108a-1085-4097-98f9-921c3d9555aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:39.358087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b5e108a-1085-4097-98f9-921c3d9555aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:39.358838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b5e108a-1085-4097-98f9-921c3d9555aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:39.359268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b5e108a-1085-4097-98f9-921c3d9555aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:39.487293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0b5e108a-1085-4097-98f9-921c3d9555aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:39.495858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0b5e108a-1085-4097-98f9-921c3d9555aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.148814 Jul 28 20:03:39.496406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 357/688] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:39 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:39.734468 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f9e3ef3e-c9d0-407c-97b9-bbf808f08b6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:39.734999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:39.735509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:39.736654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f9e3ef3e-c9d0-407c-97b9-bbf808f08b6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:39.743077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:39.743522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:39.743666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9e3ef3e-c9d0-407c-97b9-bbf808f08b6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:39.744042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9e3ef3e-c9d0-407c-97b9-bbf808f08b6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:39.744274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:39.744734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:39.744847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9e3ef3e-c9d0-407c-97b9-bbf808f08b6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:39.745248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9e3ef3e-c9d0-407c-97b9-bbf808f08b6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:39.777027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f9e3ef3e-c9d0-407c-97b9-bbf808f08b6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046230 Jul 28 20:03:39.777696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 332/689] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:39.806417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:39.814308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:39.815793 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:39.816905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-113df993-424e-468c-87c4-c92dc57332e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.086254 Jul 28 20:03:39.817455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 358/690] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:39 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:40.517664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-47a03208-a329-43cb-afbf-46a7134d3cdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:40.518135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-47a03208-a329-43cb-afbf-46a7134d3cdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:40.524412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47a03208-a329-43cb-afbf-46a7134d3cdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:40.524901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47a03208-a329-43cb-afbf-46a7134d3cdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:40.525722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47a03208-a329-43cb-afbf-46a7134d3cdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:40.526157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47a03208-a329-43cb-afbf-46a7134d3cdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:40.654974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-47a03208-a329-43cb-afbf-46a7134d3cdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:40.662763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-47a03208-a329-43cb-afbf-46a7134d3cdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.149104 Jul 28 20:03:40.663312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 333/691] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:40 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:40.789765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-252bd88f-004d-473c-afb2-b6726d1f5192 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:40.791888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-252bd88f-004d-473c-afb2-b6726d1f5192 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:40.798330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-252bd88f-004d-473c-afb2-b6726d1f5192 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:40.798779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-252bd88f-004d-473c-afb2-b6726d1f5192 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:40.799536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-252bd88f-004d-473c-afb2-b6726d1f5192 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:40.799970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-252bd88f-004d-473c-afb2-b6726d1f5192 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:40.829585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-252bd88f-004d-473c-afb2-b6726d1f5192 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Jul 28 20:03:40.830122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 359/692] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:40.839580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:40.840194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:40.846616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:40.847061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:40.847811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:40.848236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:40.852221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:40.907593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:40.916268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:40.917801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:40.918887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-32588bae-fd49-4fda-90d9-f8335ac51e20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.083152 Jul 28 20:03:40.919432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 334/693] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:40 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:41.683293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8364e25a-fac1-4653-a7c6-2277498c9def tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:41.683878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8364e25a-fac1-4653-a7c6-2277498c9def tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:41.689877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8364e25a-fac1-4653-a7c6-2277498c9def tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:41.690322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8364e25a-fac1-4653-a7c6-2277498c9def tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:41.691062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8364e25a-fac1-4653-a7c6-2277498c9def tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:41.691486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8364e25a-fac1-4653-a7c6-2277498c9def tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:41.817557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8364e25a-fac1-4653-a7c6-2277498c9def tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:41.826030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8364e25a-fac1-4653-a7c6-2277498c9def tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.146603 Jul 28 20:03:41.826597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 360/694] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:41 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:41.841995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8e564f07-ea2e-452e-b720-c90b65db112b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:41.844120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8e564f07-ea2e-452e-b720-c90b65db112b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:41.850898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e564f07-ea2e-452e-b720-c90b65db112b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:41.851342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e564f07-ea2e-452e-b720-c90b65db112b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:41.852096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e564f07-ea2e-452e-b720-c90b65db112b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:41.852527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e564f07-ea2e-452e-b720-c90b65db112b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:41.882665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8e564f07-ea2e-452e-b720-c90b65db112b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Jul 28 20:03:41.883215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 335/695] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:41.942157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:41.942768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:41.949715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:41.950160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:41.950915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:41.951343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:42.017499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:42.025972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:42.027472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:42.028597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-94a9c9e2-05fc-4f80-845e-0884db56c386 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.090274 Jul 28 20:03:42.029154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 361/696] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:41 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:42.847133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a408a466-e9e4-432f-983b-cc1d022c4b46 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:42.847743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a408a466-e9e4-432f-983b-cc1d022c4b46 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:42.854745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a408a466-e9e4-432f-983b-cc1d022c4b46 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:42.855193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a408a466-e9e4-432f-983b-cc1d022c4b46 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:42.855968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a408a466-e9e4-432f-983b-cc1d022c4b46 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:42.856397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a408a466-e9e4-432f-983b-cc1d022c4b46 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:42.894364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-85c09b2e-367f-46c6-80da-783326c03740 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:42.897397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-85c09b2e-367f-46c6-80da-783326c03740 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:42.904276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85c09b2e-367f-46c6-80da-783326c03740 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:42.904757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85c09b2e-367f-46c6-80da-783326c03740 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:42.905532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85c09b2e-367f-46c6-80da-783326c03740 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:42.905972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85c09b2e-367f-46c6-80da-783326c03740 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:42.935469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-85c09b2e-367f-46c6-80da-783326c03740 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045205 Jul 28 20:03:42.936025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 362/697] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:03:42.988533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a408a466-e9e4-432f-983b-cc1d022c4b46 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:42.996495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a408a466-e9e4-432f-983b-cc1d022c4b46 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.153190 Jul 28 20:03:42.997073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 336/698] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:42 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:43.051830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:43.053023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:43.058933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:43.059369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:43.060112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:43.060555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:43.119842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:43.127694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:43.129239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:43.131007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-10abf6b1-f764-4daf-a606-28365716a9e3 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.082349 Jul 28 20:03:43.131562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 363/699] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:43 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:43.947836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-317bb3a1-dc60-4aeb-a23c-57fd0ec98d87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:43.950024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-317bb3a1-dc60-4aeb-a23c-57fd0ec98d87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:43.956470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-317bb3a1-dc60-4aeb-a23c-57fd0ec98d87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:43.956938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-317bb3a1-dc60-4aeb-a23c-57fd0ec98d87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:43.957688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-317bb3a1-dc60-4aeb-a23c-57fd0ec98d87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:43.958210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-317bb3a1-dc60-4aeb-a23c-57fd0ec98d87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:43.987938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-317bb3a1-dc60-4aeb-a23c-57fd0ec98d87 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Jul 28 20:03:43.988455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 337/700] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:44.018646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ef47e6b0-7d6c-4cfd-a977-5c05dfdc735f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:44.019247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ef47e6b0-7d6c-4cfd-a977-5c05dfdc735f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:44.026439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef47e6b0-7d6c-4cfd-a977-5c05dfdc735f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:44.026875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef47e6b0-7d6c-4cfd-a977-5c05dfdc735f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:44.027618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef47e6b0-7d6c-4cfd-a977-5c05dfdc735f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:44.028047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef47e6b0-7d6c-4cfd-a977-5c05dfdc735f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:44.153376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:44.154412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:44.156408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ef47e6b0-7d6c-4cfd-a977-5c05dfdc735f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:44.163587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:44.163587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:44.163587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:44.163587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:44.165007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ef47e6b0-7d6c-4cfd-a977-5c05dfdc735f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.149931 Jul 28 20:03:44.174561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 364/701] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:44 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:44.222289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:44.230074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:44.231570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:44.232689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-23f5ecfc-94d6-45c2-93dc-b4201501a819 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.083151 Jul 28 20:03:44.233243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 338/702] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:44 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:03:45.000410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f0e78ab3-1d5c-499c-8f4f-7535740d4f14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:45.002595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f0e78ab3-1d5c-499c-8f4f-7535740d4f14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:45.009466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0e78ab3-1d5c-499c-8f4f-7535740d4f14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:45.009942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0e78ab3-1d5c-499c-8f4f-7535740d4f14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:45.010760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0e78ab3-1d5c-499c-8f4f-7535740d4f14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:45.011236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0e78ab3-1d5c-499c-8f4f-7535740d4f14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:45.041617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f0e78ab3-1d5c-499c-8f4f-7535740d4f14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Jul 28 20:03:45.042302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 365/703] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:45.186250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d2150114-436d-4c57-9f57-2a1d1bcbe9a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:45.186854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d2150114-436d-4c57-9f57-2a1d1bcbe9a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:45.194311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2150114-436d-4c57-9f57-2a1d1bcbe9a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:45.194743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2150114-436d-4c57-9f57-2a1d1bcbe9a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:45.195494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2150114-436d-4c57-9f57-2a1d1bcbe9a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:45.195912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2150114-436d-4c57-9f57-2a1d1bcbe9a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:45.256260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:45.256815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:45.263095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:45.263545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:45.264324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:45.264798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:45.354539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:45.363290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:45.365719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:45.367344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f223a88f-7eb2-4b5f-9992-06ea2a8b66d5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.115857 Jul 28 20:03:45.367904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 366/704] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:45 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:03:45.370419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d2150114-436d-4c57-9f57-2a1d1bcbe9a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:45.379041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d2150114-436d-4c57-9f57-2a1d1bcbe9a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.196541 Jul 28 20:03:45.380076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 339/705] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:45 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:46.055272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-880fbb59-7529-43ba-88c5-44d5f992f468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:46.057466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-880fbb59-7529-43ba-88c5-44d5f992f468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:46.064198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-880fbb59-7529-43ba-88c5-44d5f992f468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:46.064682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-880fbb59-7529-43ba-88c5-44d5f992f468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:46.065457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-880fbb59-7529-43ba-88c5-44d5f992f468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:46.065890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-880fbb59-7529-43ba-88c5-44d5f992f468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:46.095264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-880fbb59-7529-43ba-88c5-44d5f992f468 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Jul 28 20:03:46.095814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 367/706] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:46.390990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:46.391624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:46.398179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:46.398615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:46.399368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:46.399793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:46.401268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0e178299-a54c-43c2-89c2-99e75cc6169a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:46.401879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0e178299-a54c-43c2-89c2-99e75cc6169a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:46.407998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e178299-a54c-43c2-89c2-99e75cc6169a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:46.408442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e178299-a54c-43c2-89c2-99e75cc6169a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:46.409222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e178299-a54c-43c2-89c2-99e75cc6169a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:46.409653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e178299-a54c-43c2-89c2-99e75cc6169a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:46.671690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:46.680529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:46.682079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:46.683170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5eeb9e79-c680-4a13-96d1-d67a57ac425a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.296071 Jul 28 20:03:46.683924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 340/707] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:46 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:46.754136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0e178299-a54c-43c2-89c2-99e75cc6169a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:46.762428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0e178299-a54c-43c2-89c2-99e75cc6169a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.365022 Jul 28 20:03:46.762979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 368/708] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:46 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:03:47.107589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-55fdcb09-11ee-4a32-9a79-f2b3bb051315 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:47.109767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-55fdcb09-11ee-4a32-9a79-f2b3bb051315 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:47.117449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55fdcb09-11ee-4a32-9a79-f2b3bb051315 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:47.117890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55fdcb09-11ee-4a32-9a79-f2b3bb051315 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:47.118645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55fdcb09-11ee-4a32-9a79-f2b3bb051315 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:47.119066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55fdcb09-11ee-4a32-9a79-f2b3bb051315 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:47.147633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-55fdcb09-11ee-4a32-9a79-f2b3bb051315 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Jul 28 20:03:47.148177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 341/709] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:47 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:47.706184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:47.706722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:47.713399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:47.713849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:47.714611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:47.715046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:47.775379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:47.783352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8e7c9b9f-5a57-40a2-9c84-c34d6226c6fe tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:47.783811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:47.783965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8e7c9b9f-5a57-40a2-9c84-c34d6226c6fe tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:47.784901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:47.786087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b8bea932-6f42-4597-936e-f49b9ef1840a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.083760 Jul 28 20:03:47.787185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 369/710] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:47 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:47.790974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7c9b9f-5a57-40a2-9c84-c34d6226c6fe tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:47.791447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7c9b9f-5a57-40a2-9c84-c34d6226c6fe tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:47.792240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7c9b9f-5a57-40a2-9c84-c34d6226c6fe tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:47.792705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7c9b9f-5a57-40a2-9c84-c34d6226c6fe tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:47.921287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e7c9b9f-5a57-40a2-9c84-c34d6226c6fe tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:47.929251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8e7c9b9f-5a57-40a2-9c84-c34d6226c6fe tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.149895 Jul 28 20:03:47.929807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 342/711] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:47 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:03:48.159512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4c30f989-f8a1-48ab-b288-c667e9fe36ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:48.162954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4c30f989-f8a1-48ab-b288-c667e9fe36ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:48.169148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4c30f989-f8a1-48ab-b288-c667e9fe36ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:48.169596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4c30f989-f8a1-48ab-b288-c667e9fe36ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:48.170361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4c30f989-f8a1-48ab-b288-c667e9fe36ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:48.170797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4c30f989-f8a1-48ab-b288-c667e9fe36ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:48.195945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:48.200968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4c30f989-f8a1-48ab-b288-c667e9fe36ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045632 Jul 28 20:03:48.201512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 370/712] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:48.809032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:48.809642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:48.816151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:48.816630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:48.817386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:48.818614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:48.878847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:48.887461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:48.889001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:48.890086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bfb225c8-3ce2-4381-91b2-8db659fce6bd tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.084977 Jul 28 20:03:48.890633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 343/713] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:48 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:48.950838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b6ffb910-a842-43a7-afad-60db67015b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:48.951498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b6ffb910-a842-43a7-afad-60db67015b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:48.959155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6ffb910-a842-43a7-afad-60db67015b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:48.959603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6ffb910-a842-43a7-afad-60db67015b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:48.960394 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6ffb910-a842-43a7-afad-60db67015b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:48.960855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6ffb910-a842-43a7-afad-60db67015b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:49.090487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b6ffb910-a842-43a7-afad-60db67015b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:49.097939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b6ffb910-a842-43a7-afad-60db67015b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.151044 Jul 28 20:03:49.098504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 371/714] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:48 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:49.213562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6bf43f1-4efd-4b9d-9b30-e3e2bb2bb866 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:49.215821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b6bf43f1-4efd-4b9d-9b30-e3e2bb2bb866 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:49.221737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6bf43f1-4efd-4b9d-9b30-e3e2bb2bb866 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:49.222191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6bf43f1-4efd-4b9d-9b30-e3e2bb2bb866 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:49.222963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6bf43f1-4efd-4b9d-9b30-e3e2bb2bb866 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:49.223402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6bf43f1-4efd-4b9d-9b30-e3e2bb2bb866 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:49.253469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b6bf43f1-4efd-4b9d-9b30-e3e2bb2bb866 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Jul 28 20:03:49.254024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 344/715] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:49.913933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:49.914577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:49.920611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:49.921062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:49.921816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:49.922255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:49.984238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:49.992852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:49.994305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:49.995403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-714a790d-43c3-44b1-958e-69ae52c4a769 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.086388 Jul 28 20:03:49.995952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 372/716] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:49 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:50.120092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-35fd5df9-251f-4a82-abd3-a45f06da4012 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:50.120742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-35fd5df9-251f-4a82-abd3-a45f06da4012 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:50.127227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35fd5df9-251f-4a82-abd3-a45f06da4012 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:50.127670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35fd5df9-251f-4a82-abd3-a45f06da4012 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:50.128419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35fd5df9-251f-4a82-abd3-a45f06da4012 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:50.128900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35fd5df9-251f-4a82-abd3-a45f06da4012 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:50.256874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-35fd5df9-251f-4a82-abd3-a45f06da4012 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:50.264862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-35fd5df9-251f-4a82-abd3-a45f06da4012 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.148526 Jul 28 20:03:50.265601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 345/717] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:50 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:50.265883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-395db1cc-4a13-4350-b7cf-28dba3c98913 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:50.267986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-395db1cc-4a13-4350-b7cf-28dba3c98913 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:50.274651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-395db1cc-4a13-4350-b7cf-28dba3c98913 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:50.275102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-395db1cc-4a13-4350-b7cf-28dba3c98913 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:50.275869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-395db1cc-4a13-4350-b7cf-28dba3c98913 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:50.276300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-395db1cc-4a13-4350-b7cf-28dba3c98913 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:50.306245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-395db1cc-4a13-4350-b7cf-28dba3c98913 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Jul 28 20:03:50.306795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 373/718] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:03:51.017931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:51.018535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:51.025649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:51.026087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:51.026838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:51.027268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:51.088928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:51.097001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:51.098570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:51.100306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fc46e897-bf57-4a4d-b26f-97fc43a856fe tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.086202 Jul 28 20:03:51.100884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 346/719] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:51 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:51.287490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-71fa2432-17e5-462b-ba5b-fe9420219f83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:51.288109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-71fa2432-17e5-462b-ba5b-fe9420219f83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:51.294551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71fa2432-17e5-462b-ba5b-fe9420219f83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:51.294997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71fa2432-17e5-462b-ba5b-fe9420219f83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:51.295756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71fa2432-17e5-462b-ba5b-fe9420219f83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:51.296186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71fa2432-17e5-462b-ba5b-fe9420219f83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:51.319312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cfeda646-a322-4ba2-9dfb-99e45e31ebbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:51.321765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cfeda646-a322-4ba2-9dfb-99e45e31ebbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:51.328288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfeda646-a322-4ba2-9dfb-99e45e31ebbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:51.328778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfeda646-a322-4ba2-9dfb-99e45e31ebbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:51.329545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfeda646-a322-4ba2-9dfb-99e45e31ebbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:51.329978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfeda646-a322-4ba2-9dfb-99e45e31ebbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:51.368237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cfeda646-a322-4ba2-9dfb-99e45e31ebbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048255 Jul 28 20:03:51.368237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 347/720] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:51.437162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-71fa2432-17e5-462b-ba5b-fe9420219f83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:51.445584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-71fa2432-17e5-462b-ba5b-fe9420219f83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.162849 Jul 28 20:03:51.446143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 374/721] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:51 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:52.122527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:52.123136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:52.129101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:52.129544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:52.131348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:52.131779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:52.193622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:52.202345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:52.203840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:52.204966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8f6af5e0-03d5-4f5f-8daa-4ea7e54a9d3f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.086327 Jul 28 20:03:52.205513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 348/722] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:52 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:52.375404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1249aa8e-8ff4-479a-8fa4-1ac73b6e7a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:52.377478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1249aa8e-8ff4-479a-8fa4-1ac73b6e7a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:52.385281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1249aa8e-8ff4-479a-8fa4-1ac73b6e7a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:52.385731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1249aa8e-8ff4-479a-8fa4-1ac73b6e7a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:52.386499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1249aa8e-8ff4-479a-8fa4-1ac73b6e7a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:52.386934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1249aa8e-8ff4-479a-8fa4-1ac73b6e7a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:52.418064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1249aa8e-8ff4-479a-8fa4-1ac73b6e7a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046660 Jul 28 20:03:52.418626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 375/723] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:52.466966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-70a05511-b537-43c2-a39a-bbbf780373d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:52.467590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-70a05511-b537-43c2-a39a-bbbf780373d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:52.474127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70a05511-b537-43c2-a39a-bbbf780373d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:52.474570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70a05511-b537-43c2-a39a-bbbf780373d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:52.475339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70a05511-b537-43c2-a39a-bbbf780373d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:52.475763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70a05511-b537-43c2-a39a-bbbf780373d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:52.610667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-70a05511-b537-43c2-a39a-bbbf780373d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:52.619045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-70a05511-b537-43c2-a39a-bbbf780373d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.155932 Jul 28 20:03:52.619605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 349/724] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:52 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:53.229067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:53.229683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:53.231527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=82 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:53.236818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:53.237271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:53.238030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:53.238468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:53.298004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:53.306418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:53.307923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:53.309060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fa235068-2c1c-4dfc-8506-222442c0b755 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.083878 Jul 28 20:03:53.309610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 376/725] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:53 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:53.430888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6825f43f-63a7-459a-b6b1-b0cdcb42b363 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:53.433058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6825f43f-63a7-459a-b6b1-b0cdcb42b363 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:53.435023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:53.440350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6825f43f-63a7-459a-b6b1-b0cdcb42b363 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:53.440901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6825f43f-63a7-459a-b6b1-b0cdcb42b363 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:53.441769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6825f43f-63a7-459a-b6b1-b0cdcb42b363 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:53.442099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6825f43f-63a7-459a-b6b1-b0cdcb42b363 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:53.475666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:03:53.481341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6825f43f-63a7-459a-b6b1-b0cdcb42b363 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055173 Jul 28 20:03:53.481896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 350/726] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:53.640270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-de68bb1e-c714-408f-b2d1-a820e71fe1f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:53.640909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-de68bb1e-c714-408f-b2d1-a820e71fe1f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:53.647881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de68bb1e-c714-408f-b2d1-a820e71fe1f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:53.648327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de68bb1e-c714-408f-b2d1-a820e71fe1f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:53.649125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de68bb1e-c714-408f-b2d1-a820e71fe1f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:53.649562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de68bb1e-c714-408f-b2d1-a820e71fe1f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:53.777276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-de68bb1e-c714-408f-b2d1-a820e71fe1f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:53.785168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-de68bb1e-c714-408f-b2d1-a820e71fe1f8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.148692 Jul 28 20:03:53.785739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 377/727] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:53 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:54.331295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:54.331929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:54.338708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:54.339151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:54.339895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:54.340319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:54.400170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:54.408222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:54.409728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:54.410804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1c973297-9086-4373-a704-d3166242f072 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.083458 Jul 28 20:03:54.411425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 351/728] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:54 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:54.494248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5eaa68ba-bfaf-4ea4-93fe-5d0a84e9dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:54.496472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5eaa68ba-bfaf-4ea4-93fe-5d0a84e9dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:54.502643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5eaa68ba-bfaf-4ea4-93fe-5d0a84e9dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:54.503122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5eaa68ba-bfaf-4ea4-93fe-5d0a84e9dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:54.503932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5eaa68ba-bfaf-4ea4-93fe-5d0a84e9dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:54.504416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5eaa68ba-bfaf-4ea4-93fe-5d0a84e9dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:54.534139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5eaa68ba-bfaf-4ea4-93fe-5d0a84e9dab3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Jul 28 20:03:54.534665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 378/729] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:54.807861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9c2faa52-7d7a-41a5-814a-663f37422f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:54.808395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9c2faa52-7d7a-41a5-814a-663f37422f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:54.815367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c2faa52-7d7a-41a5-814a-663f37422f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:54.815806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c2faa52-7d7a-41a5-814a-663f37422f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:54.816565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c2faa52-7d7a-41a5-814a-663f37422f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:54.817000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c2faa52-7d7a-41a5-814a-663f37422f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:54.946937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9c2faa52-7d7a-41a5-814a-663f37422f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:54.954553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9c2faa52-7d7a-41a5-814a-663f37422f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.150689 Jul 28 20:03:54.955107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 352/730] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:54 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:55.433992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:55.434606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:55.441101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:55.441547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:55.442470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:55.443320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:55.505014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:55.513167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:55.514680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:55.515777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-757413e3-8306-445a-a920-bbb7c5ba0b16 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.085735 Jul 28 20:03:55.516327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 379/731] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:55 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:55.549469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cbb2d5a7-8a7c-409c-849a-7a2ed6fca281 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:55.552202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cbb2d5a7-8a7c-409c-849a-7a2ed6fca281 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:55.558326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbb2d5a7-8a7c-409c-849a-7a2ed6fca281 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:55.559075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbb2d5a7-8a7c-409c-849a-7a2ed6fca281 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:55.559835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbb2d5a7-8a7c-409c-849a-7a2ed6fca281 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:55.560260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbb2d5a7-8a7c-409c-849a-7a2ed6fca281 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:55.593986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cbb2d5a7-8a7c-409c-849a-7a2ed6fca281 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048410 Jul 28 20:03:55.594709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 353/732] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:55.975842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-df7eb389-5492-4825-9f93-5bd59b86b6cd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:55.976448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-df7eb389-5492-4825-9f93-5bd59b86b6cd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:55.982637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df7eb389-5492-4825-9f93-5bd59b86b6cd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:55.983082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df7eb389-5492-4825-9f93-5bd59b86b6cd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:55.983833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df7eb389-5492-4825-9f93-5bd59b86b6cd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:55.984264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df7eb389-5492-4825-9f93-5bd59b86b6cd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:56.115516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-df7eb389-5492-4825-9f93-5bd59b86b6cd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:56.123029 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-df7eb389-5492-4825-9f93-5bd59b86b6cd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.151231 Jul 28 20:03:56.123587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 380/733] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:55 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:56.538955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:56.539555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:56.546447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:56.546900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:56.547656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:56.548087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:56.606226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-938d7ad2-3516-46cf-8fa0-c07b4265b730 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:56.609106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-938d7ad2-3516-46cf-8fa0-c07b4265b730 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:56.609487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:56.617065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-938d7ad2-3516-46cf-8fa0-c07b4265b730 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:56.617520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-938d7ad2-3516-46cf-8fa0-c07b4265b730 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:56.618343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:56.618508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-938d7ad2-3516-46cf-8fa0-c07b4265b730 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:56.619111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-938d7ad2-3516-46cf-8fa0-c07b4265b730 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:56.620247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:56.621082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4ec93158-c843-483a-a220-2058dc10dabc tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.086126 Jul 28 20:03:56.621943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 354/734] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:56 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:56.663574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-938d7ad2-3516-46cf-8fa0-c07b4265b730 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061290 Jul 28 20:03:56.664133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 381/735] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:56 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:03:57.145268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-18033c1f-8ad5-4e82-b906-d93a6c1d9d33 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:57.146446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-18033c1f-8ad5-4e82-b906-d93a6c1d9d33 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:57.152430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18033c1f-8ad5-4e82-b906-d93a6c1d9d33 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:57.152907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18033c1f-8ad5-4e82-b906-d93a6c1d9d33 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:57.153661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18033c1f-8ad5-4e82-b906-d93a6c1d9d33 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:57.154086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18033c1f-8ad5-4e82-b906-d93a6c1d9d33 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:57.285430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-18033c1f-8ad5-4e82-b906-d93a6c1d9d33 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:57.293149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-18033c1f-8ad5-4e82-b906-d93a6c1d9d33 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.151767 Jul 28 20:03:57.293708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 355/736] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:57 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:57.645402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:57.646419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:57.655977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:57.656694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:57.658093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:57.658671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:57.675278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-49eca6b2-a2ee-4f55-9e01-5c3f7114e5e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:57.678702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-49eca6b2-a2ee-4f55-9e01-5c3f7114e5e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:57.686886 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49eca6b2-a2ee-4f55-9e01-5c3f7114e5e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:57.686886 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49eca6b2-a2ee-4f55-9e01-5c3f7114e5e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:57.688300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49eca6b2-a2ee-4f55-9e01-5c3f7114e5e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:57.688790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49eca6b2-a2ee-4f55-9e01-5c3f7114e5e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:57.718791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-49eca6b2-a2ee-4f55-9e01-5c3f7114e5e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047472 Jul 28 20:03:57.719352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 356/737] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:03:57.727395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:57.735230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:57.736762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:57.737856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-47aa8916-62ea-4719-ac76-8cccdea1aca5 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1285 microversion: 2.20 time: 0.097255 Jul 28 20:03:57.738397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 382/738] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:57 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:58.315130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d16c68f5-7d95-459a-a9f4-c39499b70a78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:58.315662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d16c68f5-7d95-459a-a9f4-c39499b70a78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:58.322626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d16c68f5-7d95-459a-a9f4-c39499b70a78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:58.323076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d16c68f5-7d95-459a-a9f4-c39499b70a78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:58.323837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d16c68f5-7d95-459a-a9f4-c39499b70a78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:58.324268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d16c68f5-7d95-459a-a9f4-c39499b70a78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:58.455434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d16c68f5-7d95-459a-a9f4-c39499b70a78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:58.463136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d16c68f5-7d95-459a-a9f4-c39499b70a78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1682 microversion: 2.1 time: 0.151979 Jul 28 20:03:58.463701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 357/739] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:58 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:58.731340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-677b1c77-e95f-48d2-83b1-cc2b893782a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:58.733488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-677b1c77-e95f-48d2-83b1-cc2b893782a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:58.740335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-677b1c77-e95f-48d2-83b1-cc2b893782a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:58.740714 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-677b1c77-e95f-48d2-83b1-cc2b893782a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:58.741479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-677b1c77-e95f-48d2-83b1-cc2b893782a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:58.741908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-677b1c77-e95f-48d2-83b1-cc2b893782a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:58.761013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:58.761721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:58.768162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:58.769101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:58.769550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:58.770042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:58.775622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-677b1c77-e95f-48d2-83b1-cc2b893782a5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047466 Jul 28 20:03:58.775622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 383/740] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:58.836377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:58.844164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:58.845678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:58.846750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c3be3030-a036-4f90-a293-0f8b6942e834 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1333 microversion: 2.20 time: 0.089618 Jul 28 20:03:58.847297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 358/741] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:58 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:03:59.485556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-abed6b94-985e-4d97-93f8-bd56b673c1c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:59.486156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-abed6b94-985e-4d97-93f8-bd56b673c1c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:59.493298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abed6b94-985e-4d97-93f8-bd56b673c1c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:59.493804 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abed6b94-985e-4d97-93f8-bd56b673c1c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:59.494568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abed6b94-985e-4d97-93f8-bd56b673c1c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:59.495001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abed6b94-985e-4d97-93f8-bd56b673c1c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:59.560974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-abed6b94-985e-4d97-93f8-bd56b673c1c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:03:59.568774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-abed6b94-985e-4d97-93f8-bd56b673c1c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1614 microversion: 2.1 time: 0.087041 Jul 28 20:03:59.569347 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 384/742] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:03:59 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:03:59.789060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-461969e6-3af8-435d-b4c7-d4333ebb886f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:59.792357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-461969e6-3af8-435d-b4c7-d4333ebb886f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:59.803396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-461969e6-3af8-435d-b4c7-d4333ebb886f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:59.806801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-461969e6-3af8-435d-b4c7-d4333ebb886f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:59.807673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-461969e6-3af8-435d-b4c7-d4333ebb886f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:59.808176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-461969e6-3af8-435d-b4c7-d4333ebb886f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:59.839536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-461969e6-3af8-435d-b4c7-d4333ebb886f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055400 Jul 28 20:03:59.840494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 359/743] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:03:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:03:59.882646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:03:59.883470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:03:59.897389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:59.898190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:59.899041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:59.899480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:59.979674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-9430402a-e81a-4377-87b5-d6cec4af17cb req-4263a35b-fbed-4c2c-a741-d22932e6e136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38734333-d64b-4885-a501-8d6d573d1457", "name": "network-vif-deleted", "tag": "57fdf7c6-890a-4846-a012-38d6bc979e3b"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:03:59.994229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-9430402a-e81a-4377-87b5-d6cec4af17cb req-4263a35b-fbed-4c2c-a741-d22932e6e136 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:03:59.994809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-9430402a-e81a-4377-87b5-d6cec4af17cb req-4263a35b-fbed-4c2c-a741-d22932e6e136 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:03:59.999182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:00.007110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-9430402a-e81a-4377-87b5-d6cec4af17cb req-4263a35b-fbed-4c2c-a741-d22932e6e136 service nova] Creating event network-vif-deleted:57fdf7c6-890a-4846-a012-38d6bc979e3b for instance 38734333-d64b-4885-a501-8d6d573d1457 on hv-cinder-85144 Jul 28 20:04:00.009188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:00.012528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:00.012918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-9430402a-e81a-4377-87b5-d6cec4af17cb req-4263a35b-fbed-4c2c-a741-d22932e6e136 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133989 Jul 28 20:04:00.013951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 360/744] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:00.017437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-58152c71-cd32-4f78-b0bc-e820c09f5252 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1341 microversion: 2.20 time: 0.141289 Jul 28 20:04:00.018362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 385/745] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:03:59 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1341 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:00.022821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d0f20d97-d83e-4f5f-ac87-9ccbe2e111f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:04:00.025334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d0f20d97-d83e-4f5f-ac87-9ccbe2e111f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:00.031744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0f20d97-d83e-4f5f-ac87-9ccbe2e111f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:00.032674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0f20d97-d83e-4f5f-ac87-9ccbe2e111f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:00.033562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0f20d97-d83e-4f5f-ac87-9ccbe2e111f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:00.040660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0f20d97-d83e-4f5f-ac87-9ccbe2e111f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:00.080957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-d0f20d97-d83e-4f5f-ac87-9ccbe2e111f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'flavor' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:04:00.329621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d0f20d97-d83e-4f5f-ac87-9ccbe2e111f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/action" status: 200 len: 32 microversion: 2.1 time: 0.314233 Jul 28 20:04:00.333098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 361/746] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:04:00 2022] POST /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/action => generated 32 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 20:04:00.341765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d88f6922-b383-4e02-8c3c-cac84ea0a757 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:00.342694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d88f6922-b383-4e02-8c3c-cac84ea0a757 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:00.350977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d88f6922-b383-4e02-8c3c-cac84ea0a757 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:00.351551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d88f6922-b383-4e02-8c3c-cac84ea0a757 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:00.352510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d88f6922-b383-4e02-8c3c-cac84ea0a757 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:00.353228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d88f6922-b383-4e02-8c3c-cac84ea0a757 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:00.506305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d88f6922-b383-4e02-8c3c-cac84ea0a757 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:00.515067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d88f6922-b383-4e02-8c3c-cac84ea0a757 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.176900 Jul 28 20:04:00.515223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 386/747] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:00.591242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:00.592406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:00.599779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:00.600243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:00.601050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:00.601653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:00.637913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:00.638354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:00.638800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lazy-loading 'fault' on Instance uuid 38734333-d64b-4885-a501-8d6d573d1457 {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:04:00.682341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:00.689772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-424beb93-1741-475b-a5b0-4db1e1bff9c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 200 len: 1332 microversion: 2.1 time: 0.103183 Jul 28 20:04:00.690258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 362/748] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:00 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:00.851828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e5745c30-b466-4223-aa54-da583648636a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:00.855502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e5745c30-b466-4223-aa54-da583648636a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:00.865773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e5745c30-b466-4223-aa54-da583648636a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:00.866460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e5745c30-b466-4223-aa54-da583648636a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:00.873627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e5745c30-b466-4223-aa54-da583648636a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:00.878210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e5745c30-b466-4223-aa54-da583648636a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:00.903499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:00.918227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e5745c30-b466-4223-aa54-da583648636a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070741 Jul 28 20:04:00.918976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 387/749] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:01.043493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:01.044873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:01.054146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:01.054872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:01.055822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:01.056439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:01.134770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:01.143592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:01.145864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:01.147172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2a014d02-f38d-4629-b7ec-d5687744f52f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1339 microversion: 2.20 time: 0.107664 Jul 28 20:04:01.148087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 363/750] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:01 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:01.537648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3469db55-d0f9-42cc-93b4-29150b4aac6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:01.538291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3469db55-d0f9-42cc-93b4-29150b4aac6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:01.544641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3469db55-d0f9-42cc-93b4-29150b4aac6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:01.545091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3469db55-d0f9-42cc-93b4-29150b4aac6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:01.546076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3469db55-d0f9-42cc-93b4-29150b4aac6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:01.546512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3469db55-d0f9-42cc-93b4-29150b4aac6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:01.688612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3469db55-d0f9-42cc-93b4-29150b4aac6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:01.697423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3469db55-d0f9-42cc-93b4-29150b4aac6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.164420 Jul 28 20:04:01.697836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 388/751] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:01.712652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:01.713522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:01.719529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:01.719977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:01.720787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:01.721412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:01.735842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 HTTP/1.1 Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:04:01.737503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:04:01.739043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '38734333-d64b-4885-a501-8d6d573d1457'} Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:04:01.739783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:04:01.741216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:01.742335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:04:01.742335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3c0ab4ed-bfe0-41d5-bfe8-4760ea7831e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 404 len: 111 microversion: 2.1 time: 0.031489 Jul 28 20:04:01.742335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 364/752] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:01 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:04:01.748433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-da4d1cbb-bdd3-4fe3-83f0-86b1e298564a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '.version_select at 0x7f5036e4f430>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:01.769365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-da4d1cbb-bdd3-4fe3-83f0-86b1e298564a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632111047" status: 202 len: 0 microversion: 2.1 time: 0.024667 Jul 28 20:04:01.770608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 389/753] 10.222.0.67 () {58 vars in 1221 bytes} [Thu Jul 28 20:04:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632111047 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:04:01.931580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c902c51-76c2-4871-8418-c557c06084c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:01.937126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1c902c51-76c2-4871-8418-c557c06084c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:01.944936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c902c51-76c2-4871-8418-c557c06084c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:01.945752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c902c51-76c2-4871-8418-c557c06084c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:01.959605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c902c51-76c2-4871-8418-c557c06084c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:01.960556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c902c51-76c2-4871-8418-c557c06084c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:01.998214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1c902c51-76c2-4871-8418-c557c06084c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070709 Jul 28 20:04:01.998856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 365/754] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:02.174200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:02.174816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:02.182495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:02.182949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:02.183721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:02.184158 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:02.260228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:02.269189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:02.271688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:02.273253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f4091c72-0115-452f-936e-7ee3fa4b00a0 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1339 microversion: 2.20 time: 0.105776 Jul 28 20:04:02.274342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 390/755] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:02 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:02.506616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d2e4d779-5cc9-495e-8e0b-0e72c17942ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:02.507161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d2e4d779-5cc9-495e-8e0b-0e72c17942ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:02.513277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2e4d779-5cc9-495e-8e0b-0e72c17942ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:02.513724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2e4d779-5cc9-495e-8e0b-0e72c17942ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:02.514558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2e4d779-5cc9-495e-8e0b-0e72c17942ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:02.514915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d2e4d779-5cc9-495e-8e0b-0e72c17942ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:02.533790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:02.603699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-d2e4d779-5cc9-495e-8e0b-0e72c17942ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lazy-loading 'services' on Instance uuid c1cb56a8-6993-4767-9e30-5786f3b94743 {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:04:02.683109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d2e4d779-5cc9-495e-8e0b-0e72c17942ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments/47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f" status: 202 len: 0 microversion: 2.1 time: 0.181373 Jul 28 20:04:02.686978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 366/756] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:04:02 2022] DELETE /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments/47d44e11-fd3b-426a-bbdc-6ff0f80dfc2f => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:04:02.692996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-70dde3e1-995a-49ba-a2d3-2eff78f9e23b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:02.695322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-70dde3e1-995a-49ba-a2d3-2eff78f9e23b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:02.701830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-70dde3e1-995a-49ba-a2d3-2eff78f9e23b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:02.702401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-70dde3e1-995a-49ba-a2d3-2eff78f9e23b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:02.703451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-70dde3e1-995a-49ba-a2d3-2eff78f9e23b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:02.704104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-70dde3e1-995a-49ba-a2d3-2eff78f9e23b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:02.722086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-db371611-37e7-4233-9644-808ae13063dc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:02.723608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-db371611-37e7-4233-9644-808ae13063dc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:02.731613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db371611-37e7-4233-9644-808ae13063dc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:02.732202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db371611-37e7-4233-9644-808ae13063dc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:02.733178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db371611-37e7-4233-9644-808ae13063dc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:02.733653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db371611-37e7-4233-9644-808ae13063dc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:02.737611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-70dde3e1-995a-49ba-a2d3-2eff78f9e23b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049373 Jul 28 20:04:02.738323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 391/757] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:02 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:02.870430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-db371611-37e7-4233-9644-808ae13063dc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:02.878419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-db371611-37e7-4233-9644-808ae13063dc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.161293 Jul 28 20:04:02.879064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 367/758] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:02 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:04:03.010912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-94c5293c-e26b-409a-9fe4-c1005f36d737 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:03.014487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-94c5293c-e26b-409a-9fe4-c1005f36d737 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:03.022624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94c5293c-e26b-409a-9fe4-c1005f36d737 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:03.023081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94c5293c-e26b-409a-9fe4-c1005f36d737 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:03.023862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94c5293c-e26b-409a-9fe4-c1005f36d737 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:03.024294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94c5293c-e26b-409a-9fe4-c1005f36d737 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:03.058104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-94c5293c-e26b-409a-9fe4-c1005f36d737 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051710 Jul 28 20:04:03.058679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 392/759] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:03 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:03.150094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-e6979bb9-341f-46ff-830d-3a1dbf844530 req-1615702d-ed97-4731-b533-b4b9632692c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f3dc00-9675-4747-97b5-ef6c45f6f2c2", "tag": "a128fb35-f85e-4481-9721-b707261faadd"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:04:03.164428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-e6979bb9-341f-46ff-830d-3a1dbf844530 req-1615702d-ed97-4731-b533-b4b9632692c0 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:03.165270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-e6979bb9-341f-46ff-830d-3a1dbf844530 req-1615702d-ed97-4731-b533-b4b9632692c0 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:03.182181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-e6979bb9-341f-46ff-830d-3a1dbf844530 req-1615702d-ed97-4731-b533-b4b9632692c0 service nova] Creating event network-changed:a128fb35-f85e-4481-9721-b707261faadd for instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 on hv-cinder-85144 Jul 28 20:04:03.190988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-e6979bb9-341f-46ff-830d-3a1dbf844530 req-1615702d-ed97-4731-b533-b4b9632692c0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048937 Jul 28 20:04:03.191599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 368/760] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:03.297937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:03.298543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:03.305396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:03.305838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:03.306585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:03.307010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:03.445595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:03.453588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:03.455096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:03.456231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e7594631-af07-43f4-b6df-0eb1a269bf20 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1407 microversion: 2.20 time: 0.162162 Jul 28 20:04:03.456848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 393/761] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:03 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:03.751681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-17cc5ef2-fffa-4bd5-bdfd-7f1451f95aaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:03.754040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-17cc5ef2-fffa-4bd5-bdfd-7f1451f95aaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:03.760489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17cc5ef2-fffa-4bd5-bdfd-7f1451f95aaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:03.760964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17cc5ef2-fffa-4bd5-bdfd-7f1451f95aaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:03.761731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17cc5ef2-fffa-4bd5-bdfd-7f1451f95aaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:03.762168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17cc5ef2-fffa-4bd5-bdfd-7f1451f95aaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:03.793302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-17cc5ef2-fffa-4bd5-bdfd-7f1451f95aaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046648 Jul 28 20:04:03.793842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 369/762] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:03 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:03.901071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e7e474e8-b7f9-4b1c-bd8b-79f9989b6611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:03.901682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e7e474e8-b7f9-4b1c-bd8b-79f9989b6611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:03.907961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7e474e8-b7f9-4b1c-bd8b-79f9989b6611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:03.908407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7e474e8-b7f9-4b1c-bd8b-79f9989b6611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:03.909195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7e474e8-b7f9-4b1c-bd8b-79f9989b6611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:03.909627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7e474e8-b7f9-4b1c-bd8b-79f9989b6611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:04.040317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e7e474e8-b7f9-4b1c-bd8b-79f9989b6611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:04.048239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e7e474e8-b7f9-4b1c-bd8b-79f9989b6611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151117 Jul 28 20:04:04.048903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 394/763] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:04.070598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6210f23f-ec57-4713-98d0-16c97ee75757 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:04.072817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6210f23f-ec57-4713-98d0-16c97ee75757 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:04.078824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6210f23f-ec57-4713-98d0-16c97ee75757 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:04.079269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6210f23f-ec57-4713-98d0-16c97ee75757 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:04.080081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6210f23f-ec57-4713-98d0-16c97ee75757 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:04.080559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6210f23f-ec57-4713-98d0-16c97ee75757 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:04.109353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6210f23f-ec57-4713-98d0-16c97ee75757 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042785 Jul 28 20:04:04.109916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 370/764] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:04.480383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:04.481054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:04.487436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:04.487968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:04.489721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:04.490153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:04.620457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:04.628248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:04.629987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:04.631072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dc8b03ce-c795-498d-a868-d650aa404445 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1407 microversion: 2.20 time: 0.154751 Jul 28 20:04:04.631619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 395/765] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:04 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:04.805951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-21fd301d-8b61-4719-99f9-da9d8f09c219 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:04.808224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-21fd301d-8b61-4719-99f9-da9d8f09c219 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:04.814821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21fd301d-8b61-4719-99f9-da9d8f09c219 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:04.815274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21fd301d-8b61-4719-99f9-da9d8f09c219 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:04.816044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21fd301d-8b61-4719-99f9-da9d8f09c219 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:04.816678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21fd301d-8b61-4719-99f9-da9d8f09c219 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:04.846247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-21fd301d-8b61-4719-99f9-da9d8f09c219 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Jul 28 20:04:04.846808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 371/766] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:04 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:05.070430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-512763e1-6cc8-4b47-a381-d3e490d88d9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:05.071046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-512763e1-6cc8-4b47-a381-d3e490d88d9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:05.076985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-512763e1-6cc8-4b47-a381-d3e490d88d9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:05.077438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-512763e1-6cc8-4b47-a381-d3e490d88d9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:05.078193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-512763e1-6cc8-4b47-a381-d3e490d88d9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:05.078630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-512763e1-6cc8-4b47-a381-d3e490d88d9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:05.121738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-939eef2d-1822-438f-8868-e383f18a3681 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:05.123949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-939eef2d-1822-438f-8868-e383f18a3681 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:05.130780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-939eef2d-1822-438f-8868-e383f18a3681 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:05.131843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-939eef2d-1822-438f-8868-e383f18a3681 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:05.132662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-939eef2d-1822-438f-8868-e383f18a3681 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:05.133099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-939eef2d-1822-438f-8868-e383f18a3681 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:05.170657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-939eef2d-1822-438f-8868-e383f18a3681 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052714 Jul 28 20:04:05.171561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 372/767] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:05 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:05.226560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-512763e1-6cc8-4b47-a381-d3e490d88d9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:05.235224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-512763e1-6cc8-4b47-a381-d3e490d88d9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.169148 Jul 28 20:04:05.235880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 396/768] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:05.654373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:05.654889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:05.661565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:05.662009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:05.662754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:05.663182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:05.790660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:05.798528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:05.800033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:05.801256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1c4df3f2-602c-4591-8dfb-36ef24d5e6f7 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1407 microversion: 2.20 time: 0.150699 Jul 28 20:04:05.801811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 373/769] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:05 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:05.859903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eb9bb3b6-3df5-4c82-bdab-004606954897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:05.862096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eb9bb3b6-3df5-4c82-bdab-004606954897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:05.868700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb9bb3b6-3df5-4c82-bdab-004606954897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:05.869153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb9bb3b6-3df5-4c82-bdab-004606954897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:05.869920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb9bb3b6-3df5-4c82-bdab-004606954897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:05.870355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb9bb3b6-3df5-4c82-bdab-004606954897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:05.900131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eb9bb3b6-3df5-4c82-bdab-004606954897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Jul 28 20:04:05.900698 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 397/770] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:05 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:06.183632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4e091847-1418-4441-882d-f74f9754591a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:06.185915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4e091847-1418-4441-882d-f74f9754591a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:06.193901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4e091847-1418-4441-882d-f74f9754591a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:06.194350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4e091847-1418-4441-882d-f74f9754591a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:06.195110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4e091847-1418-4441-882d-f74f9754591a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:06.195547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4e091847-1418-4441-882d-f74f9754591a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:06.224971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4e091847-1418-4441-882d-f74f9754591a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045207 Jul 28 20:04:06.225520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 374/771] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:06.256955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-db2fc4c2-f4a7-4eaa-a68c-ab282ed008a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:06.257567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-db2fc4c2-f4a7-4eaa-a68c-ab282ed008a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:06.265027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db2fc4c2-f4a7-4eaa-a68c-ab282ed008a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:06.265464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db2fc4c2-f4a7-4eaa-a68c-ab282ed008a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:06.266797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db2fc4c2-f4a7-4eaa-a68c-ab282ed008a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:06.266797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db2fc4c2-f4a7-4eaa-a68c-ab282ed008a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:06.402510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-db2fc4c2-f4a7-4eaa-a68c-ab282ed008a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:06.412259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-db2fc4c2-f4a7-4eaa-a68c-ab282ed008a1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158470 Jul 28 20:04:06.412859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 398/772] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:06.823844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:06.824449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:06.830500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:06.830941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:06.831682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:06.832109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:06.913785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a1aa145a-da8f-470d-baf3-6282dc0fdfd5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:06.915953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a1aa145a-da8f-470d-baf3-6282dc0fdfd5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:06.922476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1aa145a-da8f-470d-baf3-6282dc0fdfd5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:06.922925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1aa145a-da8f-470d-baf3-6282dc0fdfd5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:06.923694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1aa145a-da8f-470d-baf3-6282dc0fdfd5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:06.924130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1aa145a-da8f-470d-baf3-6282dc0fdfd5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:06.956020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a1aa145a-da8f-470d-baf3-6282dc0fdfd5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Jul 28 20:04:06.956609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 399/773] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:06 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:06.962157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:06.970043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:06.971554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:06.972785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e1bfa938-69ee-43f3-994f-d05c0e7818cb tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1407 microversion: 2.20 time: 0.152684 Jul 28 20:04:06.974053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 375/774] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:06 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:07.237244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-93ccf345-9cea-412c-9d00-214dcca53f30 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:07.239608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-93ccf345-9cea-412c-9d00-214dcca53f30 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:07.245823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-93ccf345-9cea-412c-9d00-214dcca53f30 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:07.246300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-93ccf345-9cea-412c-9d00-214dcca53f30 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:07.247099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-93ccf345-9cea-412c-9d00-214dcca53f30 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:07.247536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-93ccf345-9cea-412c-9d00-214dcca53f30 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:07.276973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-93ccf345-9cea-412c-9d00-214dcca53f30 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 Jul 28 20:04:07.277512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 400/775] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:07.433240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-72ea04dc-b98e-4c12-b433-0a0f7a6ebfe5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:07.433765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-72ea04dc-b98e-4c12-b433-0a0f7a6ebfe5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:07.440132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72ea04dc-b98e-4c12-b433-0a0f7a6ebfe5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:07.440597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72ea04dc-b98e-4c12-b433-0a0f7a6ebfe5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:07.441351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72ea04dc-b98e-4c12-b433-0a0f7a6ebfe5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:07.442302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72ea04dc-b98e-4c12-b433-0a0f7a6ebfe5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:07.571977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-72ea04dc-b98e-4c12-b433-0a0f7a6ebfe5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:07.579763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-72ea04dc-b98e-4c12-b433-0a0f7a6ebfe5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150340 Jul 28 20:04:07.580314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 376/776] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:07.970221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4ef10dfe-62e0-4110-b6d5-4332578c4ba5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:07.972375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4ef10dfe-62e0-4110-b6d5-4332578c4ba5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:07.979405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ef10dfe-62e0-4110-b6d5-4332578c4ba5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:07.979852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ef10dfe-62e0-4110-b6d5-4332578c4ba5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:07.980654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ef10dfe-62e0-4110-b6d5-4332578c4ba5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:07.981089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ef10dfe-62e0-4110-b6d5-4332578c4ba5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:07.995220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:07.995834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:08.002114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:08.002776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:08.003758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:08.004755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:08.013734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4ef10dfe-62e0-4110-b6d5-4332578c4ba5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047415 Jul 28 20:04:08.014616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 401/777] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:07 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:08.148165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:08.156283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:08.158124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:08.159211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-555d94bf-408d-476b-ade1-6a59aa006e1f tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1407 microversion: 2.20 time: 0.167919 Jul 28 20:04:08.159758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 377/778] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:07 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:04:08.289975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-05f39828-383b-4b3e-adf6-3327625c395c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:08.292023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-05f39828-383b-4b3e-adf6-3327625c395c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:08.298338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05f39828-383b-4b3e-adf6-3327625c395c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:08.298783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05f39828-383b-4b3e-adf6-3327625c395c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:08.299535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05f39828-383b-4b3e-adf6-3327625c395c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:08.299962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05f39828-383b-4b3e-adf6-3327625c395c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:08.327952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-05f39828-383b-4b3e-adf6-3327625c395c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042573 Jul 28 20:04:08.329200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 402/779] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:08.601490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bc5613ff-b64f-4206-9b40-cb5b79b4b46e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:08.602142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bc5613ff-b64f-4206-9b40-cb5b79b4b46e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:08.608681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc5613ff-b64f-4206-9b40-cb5b79b4b46e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:08.609125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc5613ff-b64f-4206-9b40-cb5b79b4b46e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:08.609882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc5613ff-b64f-4206-9b40-cb5b79b4b46e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:08.610314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc5613ff-b64f-4206-9b40-cb5b79b4b46e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:08.740335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bc5613ff-b64f-4206-9b40-cb5b79b4b46e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:08.748312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bc5613ff-b64f-4206-9b40-cb5b79b4b46e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151382 Jul 28 20:04:08.748913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 378/780] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:09.026108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dfdf901f-76a5-4414-9ebb-1d8cc7d38531 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:09.028257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dfdf901f-76a5-4414-9ebb-1d8cc7d38531 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:09.034910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dfdf901f-76a5-4414-9ebb-1d8cc7d38531 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:09.035370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dfdf901f-76a5-4414-9ebb-1d8cc7d38531 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:09.036120 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dfdf901f-76a5-4414-9ebb-1d8cc7d38531 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:09.036577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dfdf901f-76a5-4414-9ebb-1d8cc7d38531 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:09.065030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dfdf901f-76a5-4414-9ebb-1d8cc7d38531 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 Jul 28 20:04:09.065561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 403/781] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:09 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:09.183301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:09.183911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:09.190094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:09.190536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:09.191351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:09.192383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:09.321801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:09.329547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:09.331025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:09.332684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5a6b437d-c8be-4d08-a2bf-05fae8cc6c68 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1407 microversion: 2.20 time: 0.152741 Jul 28 20:04:09.333246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 379/782] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:09 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:09.340798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-efde89b3-ea91-4751-b975-69bfc9d16d23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:09.342958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-efde89b3-ea91-4751-b975-69bfc9d16d23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:09.350102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-efde89b3-ea91-4751-b975-69bfc9d16d23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:09.350553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-efde89b3-ea91-4751-b975-69bfc9d16d23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:09.351349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-efde89b3-ea91-4751-b975-69bfc9d16d23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:09.352016 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-efde89b3-ea91-4751-b975-69bfc9d16d23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:09.381285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-efde89b3-ea91-4751-b975-69bfc9d16d23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 Jul 28 20:04:09.381857 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 404/783] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:09 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:09.771959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4832eadf-3d2c-4043-b03b-79cded092acc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:09.772627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4832eadf-3d2c-4043-b03b-79cded092acc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:09.779340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4832eadf-3d2c-4043-b03b-79cded092acc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:09.779925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4832eadf-3d2c-4043-b03b-79cded092acc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:09.780878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4832eadf-3d2c-4043-b03b-79cded092acc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:09.781450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4832eadf-3d2c-4043-b03b-79cded092acc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:09.911969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4832eadf-3d2c-4043-b03b-79cded092acc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:09.920273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4832eadf-3d2c-4043-b03b-79cded092acc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153186 Jul 28 20:04:09.920859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 380/784] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:09 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:10.078336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-120b0128-a1aa-419f-ae1a-9cc210983bf3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:10.080594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-120b0128-a1aa-419f-ae1a-9cc210983bf3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:10.088310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-120b0128-a1aa-419f-ae1a-9cc210983bf3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:10.088846 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-120b0128-a1aa-419f-ae1a-9cc210983bf3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:10.089619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-120b0128-a1aa-419f-ae1a-9cc210983bf3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:10.090085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-120b0128-a1aa-419f-ae1a-9cc210983bf3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:10.094010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:10.119505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-f98421e1-8853-439d-84ac-7f50079b814a req-46752242-e039-4964-8878-ccb7c3c3d823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f3dc00-9675-4747-97b5-ef6c45f6f2c2", "name": "network-vif-plugged", "status": "completed", "tag": "a128fb35-f85e-4481-9721-b707261faadd"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:04:10.122236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-120b0128-a1aa-419f-ae1a-9cc210983bf3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047832 Jul 28 20:04:10.122996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 405/785] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:10 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:10.130018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-f98421e1-8853-439d-84ac-7f50079b814a req-46752242-e039-4964-8878-ccb7c3c3d823 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:10.130458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-f98421e1-8853-439d-84ac-7f50079b814a req-46752242-e039-4964-8878-ccb7c3c3d823 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:10.141945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-f98421e1-8853-439d-84ac-7f50079b814a req-46752242-e039-4964-8878-ccb7c3c3d823 service nova] Creating event network-vif-plugged:a128fb35-f85e-4481-9721-b707261faadd for instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 on hv-cinder-85144 Jul 28 20:04:10.146783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-f98421e1-8853-439d-84ac-7f50079b814a req-46752242-e039-4964-8878-ccb7c3c3d823 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Jul 28 20:04:10.147364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 381/786] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:10.355329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:10.355939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:10.362138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:10.362591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:10.363405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:10.364296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:10.396075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6246db61-a2af-4ebb-998b-51b628926334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:10.398931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6246db61-a2af-4ebb-998b-51b628926334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:10.405851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6246db61-a2af-4ebb-998b-51b628926334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:10.406327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6246db61-a2af-4ebb-998b-51b628926334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:10.407384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6246db61-a2af-4ebb-998b-51b628926334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:10.408071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6246db61-a2af-4ebb-998b-51b628926334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:10.440249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6246db61-a2af-4ebb-998b-51b628926334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050238 Jul 28 20:04:10.440835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 382/787] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:10 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:10.511335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:10.519258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:10.520982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:10.522127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6707025a-7132-479f-a3fd-247a0b75cb5d tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1407 microversion: 2.20 time: 0.170788 Jul 28 20:04:10.522697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 406/788] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:10 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:10.941342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a135fe4c-908e-44ed-9be4-ab9fb78fec00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:10.942147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a135fe4c-908e-44ed-9be4-ab9fb78fec00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:10.949719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a135fe4c-908e-44ed-9be4-ab9fb78fec00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:10.950170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a135fe4c-908e-44ed-9be4-ab9fb78fec00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:10.950922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a135fe4c-908e-44ed-9be4-ab9fb78fec00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:10.951348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a135fe4c-908e-44ed-9be4-ab9fb78fec00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:11.079686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a135fe4c-908e-44ed-9be4-ab9fb78fec00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:11.083676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:11.089086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a135fe4c-908e-44ed-9be4-ab9fb78fec00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151661 Jul 28 20:04:11.089643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 383/789] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:11.134761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cc562138-9def-4dfe-ad4f-62bf9c6b63c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:11.136951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cc562138-9def-4dfe-ad4f-62bf9c6b63c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:11.143358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc562138-9def-4dfe-ad4f-62bf9c6b63c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:11.143802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc562138-9def-4dfe-ad4f-62bf9c6b63c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:11.145137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc562138-9def-4dfe-ad4f-62bf9c6b63c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:11.145650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc562138-9def-4dfe-ad4f-62bf9c6b63c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:11.176020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cc562138-9def-4dfe-ad4f-62bf9c6b63c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045106 Jul 28 20:04:11.176635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 407/790] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:11 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:11.452680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9c2b6a24-de4f-4e72-a409-24b1aad2e6db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:11.454848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9c2b6a24-de4f-4e72-a409-24b1aad2e6db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:11.462693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c2b6a24-de4f-4e72-a409-24b1aad2e6db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:11.463143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c2b6a24-de4f-4e72-a409-24b1aad2e6db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:11.463916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c2b6a24-de4f-4e72-a409-24b1aad2e6db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:11.464353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c2b6a24-de4f-4e72-a409-24b1aad2e6db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:11.492386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9c2b6a24-de4f-4e72-a409-24b1aad2e6db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043651 Jul 28 20:04:11.492964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 384/791] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:11.545321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:11.545974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:11.553057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:11.553508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:11.554260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:11.554692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:11.686436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:11.694357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:11.695860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:11.696997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0e6f2368-c258-46c5-8240-dc78ab980832 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1407 microversion: 2.20 time: 0.155817 Jul 28 20:04:11.697555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 408/792] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:11 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:12.111094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6831dbc5-9652-480a-8ad5-6313e5dad2bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:12.111707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6831dbc5-9652-480a-8ad5-6313e5dad2bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:12.118270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6831dbc5-9652-480a-8ad5-6313e5dad2bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.118719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6831dbc5-9652-480a-8ad5-6313e5dad2bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.119478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6831dbc5-9652-480a-8ad5-6313e5dad2bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.119913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6831dbc5-9652-480a-8ad5-6313e5dad2bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.189849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-53642b8c-2e42-495d-9ab3-c54910311b73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:12.193511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-53642b8c-2e42-495d-9ab3-c54910311b73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:12.201300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53642b8c-2e42-495d-9ab3-c54910311b73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.202105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53642b8c-2e42-495d-9ab3-c54910311b73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.203152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53642b8c-2e42-495d-9ab3-c54910311b73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.203687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53642b8c-2e42-495d-9ab3-c54910311b73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.234416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-53642b8c-2e42-495d-9ab3-c54910311b73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049409 Jul 28 20:04:12.235047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 409/793] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:12 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:12.257270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6831dbc5-9652-480a-8ad5-6313e5dad2bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:12.265136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6831dbc5-9652-480a-8ad5-6313e5dad2bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.157980 Jul 28 20:04:12.265689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 385/794] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:12.504811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-067e7ec7-7a26-405e-9176-d2263d422f4f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:12.507021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-067e7ec7-7a26-405e-9176-d2263d422f4f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:12.513000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-067e7ec7-7a26-405e-9176-d2263d422f4f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.513447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-067e7ec7-7a26-405e-9176-d2263d422f4f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.514209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-067e7ec7-7a26-405e-9176-d2263d422f4f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.514644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-067e7ec7-7a26-405e-9176-d2263d422f4f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.544176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-067e7ec7-7a26-405e-9176-d2263d422f4f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 Jul 28 20:04:12.544767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 410/795] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:12.720423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:12.720985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:12.727730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.728173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.728962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.729390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.861400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:12.870216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:12.871710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:12.872929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-99194a19-ca7c-49c4-84bf-1ebb4acd56f6 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1598 microversion: 2.20 time: 0.156460 Jul 28 20:04:12.873482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 386/796] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:04:12 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:04:12.894846 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7dd788d9-1461-427b-bdf6-ecf208d34cf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:12.895498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7dd788d9-1461-427b-bdf6-ecf208d34cf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:12.901675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7dd788d9-1461-427b-bdf6-ecf208d34cf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.902115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7dd788d9-1461-427b-bdf6-ecf208d34cf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.902859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7dd788d9-1461-427b-bdf6-ecf208d34cf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:12.903289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7dd788d9-1461-427b-bdf6-ecf208d34cf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:12.984498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7dd788d9-1461-427b-bdf6-ecf208d34cf2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093560 Jul 28 20:04:12.985128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 411/797] 10.222.0.67 () {60 vars in 1316 bytes} [Thu Jul 28 20:04:12 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:04:13.246515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2505a4d8-7fd1-4087-b7fe-1d44f0a63af5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:13.248623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2505a4d8-7fd1-4087-b7fe-1d44f0a63af5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:13.255308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2505a4d8-7fd1-4087-b7fe-1d44f0a63af5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:13.255753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2505a4d8-7fd1-4087-b7fe-1d44f0a63af5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:13.256519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2505a4d8-7fd1-4087-b7fe-1d44f0a63af5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:13.256972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2505a4d8-7fd1-4087-b7fe-1d44f0a63af5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:13.289577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d6d134da-16fd-4272-8342-c57b6c62e22d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:13.290268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d6d134da-16fd-4272-8342-c57b6c62e22d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:13.290641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2505a4d8-7fd1-4087-b7fe-1d44f0a63af5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047841 Jul 28 20:04:13.291553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 387/798] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:13 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:13.296661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6d134da-16fd-4272-8342-c57b6c62e22d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:13.297112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6d134da-16fd-4272-8342-c57b6c62e22d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:13.297880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6d134da-16fd-4272-8342-c57b6c62e22d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:13.298346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6d134da-16fd-4272-8342-c57b6c62e22d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:13.429592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d6d134da-16fd-4272-8342-c57b6c62e22d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:13.437983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d6d134da-16fd-4272-8342-c57b6c62e22d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154404 Jul 28 20:04:13.438539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 412/799] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:04:13.557065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c0898fc-9d36-42b8-b0f8-e061d5d32633 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:13.559251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1c0898fc-9d36-42b8-b0f8-e061d5d32633 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:13.565322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c0898fc-9d36-42b8-b0f8-e061d5d32633 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:13.565770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c0898fc-9d36-42b8-b0f8-e061d5d32633 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:13.567356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c0898fc-9d36-42b8-b0f8-e061d5d32633 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:13.567923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c0898fc-9d36-42b8-b0f8-e061d5d32633 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:13.599518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1c0898fc-9d36-42b8-b0f8-e061d5d32633 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Jul 28 20:04:13.600347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 388/800] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:13 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:14.246254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-74699525-0144-40eb-a9d1-07aded97524c req-0ab8ad70-66b2-4066-8d56-6e85a7d17e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21f3dc00-9675-4747-97b5-ef6c45f6f2c2", "tag": "a128fb35-f85e-4481-9721-b707261faadd"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:04:14.256474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-74699525-0144-40eb-a9d1-07aded97524c req-0ab8ad70-66b2-4066-8d56-6e85a7d17e37 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:14.257118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-74699525-0144-40eb-a9d1-07aded97524c req-0ab8ad70-66b2-4066-8d56-6e85a7d17e37 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:14.267869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-74699525-0144-40eb-a9d1-07aded97524c req-0ab8ad70-66b2-4066-8d56-6e85a7d17e37 service nova] Creating event network-changed:a128fb35-f85e-4481-9721-b707261faadd for instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 on hv-cinder-85144 Jul 28 20:04:14.273091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-74699525-0144-40eb-a9d1-07aded97524c req-0ab8ad70-66b2-4066-8d56-6e85a7d17e37 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030401 Jul 28 20:04:14.273689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 413/801] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:14.303736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ccbb7fe5-3f5f-4981-85f2-abd740112b5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:14.306199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ccbb7fe5-3f5f-4981-85f2-abd740112b5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:14.312253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccbb7fe5-3f5f-4981-85f2-abd740112b5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:14.312741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccbb7fe5-3f5f-4981-85f2-abd740112b5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:14.313502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccbb7fe5-3f5f-4981-85f2-abd740112b5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:14.313932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccbb7fe5-3f5f-4981-85f2-abd740112b5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:14.342734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ccbb7fe5-3f5f-4981-85f2-abd740112b5f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Jul 28 20:04:14.343303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 389/802] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:14 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:14.461546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1e9ced15-5973-48dc-8047-fd1746842c36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:14.462290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1e9ced15-5973-48dc-8047-fd1746842c36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:14.468510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1e9ced15-5973-48dc-8047-fd1746842c36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:14.469075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1e9ced15-5973-48dc-8047-fd1746842c36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:14.469914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1e9ced15-5973-48dc-8047-fd1746842c36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:14.470359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1e9ced15-5973-48dc-8047-fd1746842c36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:14.604580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1e9ced15-5973-48dc-8047-fd1746842c36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:14.611734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4ea494f0-b927-440e-b98c-17b999b9e92c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:14.614734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1e9ced15-5973-48dc-8047-fd1746842c36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156975 Jul 28 20:04:14.614881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4ea494f0-b927-440e-b98c-17b999b9e92c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:14.620968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ea494f0-b927-440e-b98c-17b999b9e92c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:14.621411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ea494f0-b927-440e-b98c-17b999b9e92c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:14.622170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ea494f0-b927-440e-b98c-17b999b9e92c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:14.622602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4ea494f0-b927-440e-b98c-17b999b9e92c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:14.628999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 414/803] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:14.651324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4ea494f0-b927-440e-b98c-17b999b9e92c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Jul 28 20:04:14.651866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 390/804] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:15.355043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-375c6d85-8c71-43bb-8ca5-6082d0dd6f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:15.357270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-375c6d85-8c71-43bb-8ca5-6082d0dd6f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:15.363327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-375c6d85-8c71-43bb-8ca5-6082d0dd6f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:15.363780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-375c6d85-8c71-43bb-8ca5-6082d0dd6f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:15.364560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-375c6d85-8c71-43bb-8ca5-6082d0dd6f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:15.364995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-375c6d85-8c71-43bb-8ca5-6082d0dd6f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:15.393726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-375c6d85-8c71-43bb-8ca5-6082d0dd6f6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042618 Jul 28 20:04:15.394269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 415/805] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:15 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:15.636746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-051fd557-beee-469c-8ccf-376587d35c46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:15.637365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-051fd557-beee-469c-8ccf-376587d35c46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:15.643820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-051fd557-beee-469c-8ccf-376587d35c46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:15.644267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-051fd557-beee-469c-8ccf-376587d35c46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:15.645175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-051fd557-beee-469c-8ccf-376587d35c46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:15.645610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-051fd557-beee-469c-8ccf-376587d35c46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:15.663826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f8d6662a-0db1-4d2d-9792-09f337d48908 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:15.666048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f8d6662a-0db1-4d2d-9792-09f337d48908 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:15.672391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f8d6662a-0db1-4d2d-9792-09f337d48908 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:15.672864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f8d6662a-0db1-4d2d-9792-09f337d48908 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:15.673675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f8d6662a-0db1-4d2d-9792-09f337d48908 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:15.674103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f8d6662a-0db1-4d2d-9792-09f337d48908 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:15.714763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f8d6662a-0db1-4d2d-9792-09f337d48908 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054906 Jul 28 20:04:15.719003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 416/806] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:15.797761 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-051fd557-beee-469c-8ccf-376587d35c46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:15.806530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-051fd557-beee-469c-8ccf-376587d35c46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.173703 Jul 28 20:04:15.807208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 391/807] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:16.406460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ae411cb5-3311-4ba1-b2f6-b517288abcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:16.408985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ae411cb5-3311-4ba1-b2f6-b517288abcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:16.415619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae411cb5-3311-4ba1-b2f6-b517288abcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:16.416065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae411cb5-3311-4ba1-b2f6-b517288abcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:16.416853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae411cb5-3311-4ba1-b2f6-b517288abcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:16.417289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae411cb5-3311-4ba1-b2f6-b517288abcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:16.445226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ae411cb5-3311-4ba1-b2f6-b517288abcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042683 Jul 28 20:04:16.445769 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 417/808] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:16 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:16.727142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c0616685-62f1-4a09-bade-7e5ef718879d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:16.729219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c0616685-62f1-4a09-bade-7e5ef718879d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:16.735727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0616685-62f1-4a09-bade-7e5ef718879d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:16.736164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0616685-62f1-4a09-bade-7e5ef718879d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:16.736962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0616685-62f1-4a09-bade-7e5ef718879d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:16.737387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0616685-62f1-4a09-bade-7e5ef718879d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:16.765620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c0616685-62f1-4a09-bade-7e5ef718879d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042577 Jul 28 20:04:16.766148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 392/809] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:16 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:16.828276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-95849d30-7836-49a4-a844-47b0fd8ca6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:16.828917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-95849d30-7836-49a4-a844-47b0fd8ca6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:16.836126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95849d30-7836-49a4-a844-47b0fd8ca6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:16.836609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95849d30-7836-49a4-a844-47b0fd8ca6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:16.837376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95849d30-7836-49a4-a844-47b0fd8ca6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:16.837808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95849d30-7836-49a4-a844-47b0fd8ca6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:16.966192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-95849d30-7836-49a4-a844-47b0fd8ca6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:16.974887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-95849d30-7836-49a4-a844-47b0fd8ca6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1715 microversion: 2.1 time: 0.150457 Jul 28 20:04:16.975440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 418/810] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:17.034766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:17.035317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:17.041379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.041820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.042565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.042999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.121270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Cannot 'detach_volume' instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed while it is in vm_state rescued Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 HTTP/1.1 Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:04:17.122971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:04:17.124745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Cannot 'detach_volume' instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed while it is in vm_state rescued Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': '0038fe10-b9ea-4fe0-a220-9c2ab37f67ed', 'id': 'ead09975-af7f-40eb-ae0c-70936b340da0'} Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:04:17.125666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed while it is in vm_state rescued Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed while it is in vm_state rescued Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:04:17.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 409 to user: Cannot 'detach_volume' instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed while it is in vm_state rescued {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:04:17.128559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e0f5d224-d926-40de-8824-ec9bb593e2fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 409 len: 152 microversion: 2.1 time: 0.093861 Jul 28 20:04:17.128559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 393/811] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:04:17 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 20:04:17.134037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-205c083b-b0e8-4972-b27b-2a8e4d8cdfc5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:04:17.134677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-205c083b-b0e8-4972-b27b-2a8e4d8cdfc5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:17.141357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-205c083b-b0e8-4972-b27b-2a8e4d8cdfc5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.141920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-205c083b-b0e8-4972-b27b-2a8e4d8cdfc5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.142850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-205c083b-b0e8-4972-b27b-2a8e4d8cdfc5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.143383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-205c083b-b0e8-4972-b27b-2a8e4d8cdfc5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.211659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-205c083b-b0e8-4972-b27b-2a8e4d8cdfc5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/action" status: 202 len: 0 microversion: 2.1 time: 0.081872 Jul 28 20:04:17.215359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 419/812] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:04:17 2022] POST /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:04:17.220943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-656f27a7-c722-4728-a63e-feb027e88cbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:17.221586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-656f27a7-c722-4728-a63e-feb027e88cbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:17.227765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-656f27a7-c722-4728-a63e-feb027e88cbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.228320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-656f27a7-c722-4728-a63e-feb027e88cbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.229332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-656f27a7-c722-4728-a63e-feb027e88cbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.229910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-656f27a7-c722-4728-a63e-feb027e88cbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.371012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-656f27a7-c722-4728-a63e-feb027e88cbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:17.379174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-656f27a7-c722-4728-a63e-feb027e88cbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1723 microversion: 2.1 time: 0.162550 Jul 28 20:04:17.379758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 394/813] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:04:17.458685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fe0eab00-8bbd-48d6-95ec-198bf04519b4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:17.460994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fe0eab00-8bbd-48d6-95ec-198bf04519b4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:17.467100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe0eab00-8bbd-48d6-95ec-198bf04519b4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.467549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe0eab00-8bbd-48d6-95ec-198bf04519b4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.468311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe0eab00-8bbd-48d6-95ec-198bf04519b4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.468781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe0eab00-8bbd-48d6-95ec-198bf04519b4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.500457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fe0eab00-8bbd-48d6-95ec-198bf04519b4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046563 Jul 28 20:04:17.501165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 420/814] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:17 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:17.778611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-99658334-0d10-41f0-9842-cd5ade96be6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:17.780836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-99658334-0d10-41f0-9842-cd5ade96be6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:17.788316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99658334-0d10-41f0-9842-cd5ade96be6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.788784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99658334-0d10-41f0-9842-cd5ade96be6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.789537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99658334-0d10-41f0-9842-cd5ade96be6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:17.789960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99658334-0d10-41f0-9842-cd5ade96be6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:17.819576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-99658334-0d10-41f0-9842-cd5ade96be6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Jul 28 20:04:17.820170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 395/815] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:18.400682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-51f0d8c2-6bc1-4b78-9758-58e5fee7780b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:18.401297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-51f0d8c2-6bc1-4b78-9758-58e5fee7780b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:18.407953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51f0d8c2-6bc1-4b78-9758-58e5fee7780b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:18.408398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51f0d8c2-6bc1-4b78-9758-58e5fee7780b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:18.409182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51f0d8c2-6bc1-4b78-9758-58e5fee7780b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:18.409617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51f0d8c2-6bc1-4b78-9758-58e5fee7780b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:18.512848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-350be668-7ca4-42c2-b57b-2eb9a6cf2be4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:18.515094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-350be668-7ca4-42c2-b57b-2eb9a6cf2be4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:18.521426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-350be668-7ca4-42c2-b57b-2eb9a6cf2be4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:18.521873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-350be668-7ca4-42c2-b57b-2eb9a6cf2be4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:18.522644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-350be668-7ca4-42c2-b57b-2eb9a6cf2be4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:18.523084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-350be668-7ca4-42c2-b57b-2eb9a6cf2be4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:18.540620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-51f0d8c2-6bc1-4b78-9758-58e5fee7780b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:18.544152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:18.550135 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-51f0d8c2-6bc1-4b78-9758-58e5fee7780b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1723 microversion: 2.1 time: 0.153298 Jul 28 20:04:18.551321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 421/816] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:18.557131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-350be668-7ca4-42c2-b57b-2eb9a6cf2be4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048235 Jul 28 20:04:18.557680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 396/817] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:18 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:18.832229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8194abb1-595b-4598-9d98-c8bd54d03bac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:18.834418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8194abb1-595b-4598-9d98-c8bd54d03bac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:18.842294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8194abb1-595b-4598-9d98-c8bd54d03bac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:18.842767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8194abb1-595b-4598-9d98-c8bd54d03bac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:18.843521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8194abb1-595b-4598-9d98-c8bd54d03bac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:18.843946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8194abb1-595b-4598-9d98-c8bd54d03bac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:18.874018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8194abb1-595b-4598-9d98-c8bd54d03bac tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Jul 28 20:04:18.874555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 422/818] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:19.571261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bb8b2e47-9e9f-41b3-b1a3-ab5148e51cd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:19.573435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bb8b2e47-9e9f-41b3-b1a3-ab5148e51cd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:19.573566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b4f79db8-80fc-4b82-a8b7-923f6e45c049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:19.574103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b4f79db8-80fc-4b82-a8b7-923f6e45c049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:19.579985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb8b2e47-9e9f-41b3-b1a3-ab5148e51cd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:19.580434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb8b2e47-9e9f-41b3-b1a3-ab5148e51cd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:19.580574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b4f79db8-80fc-4b82-a8b7-923f6e45c049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:19.580917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b4f79db8-80fc-4b82-a8b7-923f6e45c049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:19.581231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb8b2e47-9e9f-41b3-b1a3-ab5148e51cd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:19.581671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb8b2e47-9e9f-41b3-b1a3-ab5148e51cd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:19.581839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b4f79db8-80fc-4b82-a8b7-923f6e45c049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:19.583330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b4f79db8-80fc-4b82-a8b7-923f6e45c049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:19.612674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bb8b2e47-9e9f-41b3-b1a3-ab5148e51cd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046911 Jul 28 20:04:19.613526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 397/819] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:19 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:19.712476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b4f79db8-80fc-4b82-a8b7-923f6e45c049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:19.720397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b4f79db8-80fc-4b82-a8b7-923f6e45c049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1723 microversion: 2.1 time: 0.150630 Jul 28 20:04:19.720982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 423/820] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:04:19.886491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a1137845-cb02-4995-a2de-b2d651ec7888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:19.888528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a1137845-cb02-4995-a2de-b2d651ec7888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:19.895268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1137845-cb02-4995-a2de-b2d651ec7888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:19.895734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1137845-cb02-4995-a2de-b2d651ec7888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:19.896490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1137845-cb02-4995-a2de-b2d651ec7888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:19.896938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1137845-cb02-4995-a2de-b2d651ec7888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:19.925011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a1137845-cb02-4995-a2de-b2d651ec7888 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042968 Jul 28 20:04:19.926106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 398/821] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:20.625251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1dc52ee4-5a96-43bf-ab7a-469c3e158e7b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:20.627389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1dc52ee4-5a96-43bf-ab7a-469c3e158e7b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:20.634453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1dc52ee4-5a96-43bf-ab7a-469c3e158e7b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:20.634900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1dc52ee4-5a96-43bf-ab7a-469c3e158e7b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:20.635663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1dc52ee4-5a96-43bf-ab7a-469c3e158e7b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:20.636098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1dc52ee4-5a96-43bf-ab7a-469c3e158e7b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:20.665960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1dc52ee4-5a96-43bf-ab7a-469c3e158e7b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Jul 28 20:04:20.666608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 424/822] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:20 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:20.741820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-01547e3f-e910-4e6a-b050-1377228b3767 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:20.742427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-01547e3f-e910-4e6a-b050-1377228b3767 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:20.744843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:20.750099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-01547e3f-e910-4e6a-b050-1377228b3767 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:20.750541 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-01547e3f-e910-4e6a-b050-1377228b3767 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:20.751286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-01547e3f-e910-4e6a-b050-1377228b3767 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:20.751709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-01547e3f-e910-4e6a-b050-1377228b3767 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:20.899664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-01547e3f-e910-4e6a-b050-1377228b3767 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:20.907859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-01547e3f-e910-4e6a-b050-1377228b3767 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1729 microversion: 2.1 time: 0.169959 Jul 28 20:04:20.908406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 399/823] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:20.929043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7af4a2e0-a1ba-4723-a5e6-ef7b66878537 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:20.929543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7af4a2e0-a1ba-4723-a5e6-ef7b66878537 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:20.931369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:20.937572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-66b5e2f5-67e2-4b51-b283-dfd1f65f3287 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:20.938036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7af4a2e0-a1ba-4723-a5e6-ef7b66878537 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:20.938497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7af4a2e0-a1ba-4723-a5e6-ef7b66878537 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:20.939269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7af4a2e0-a1ba-4723-a5e6-ef7b66878537 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:20.939701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7af4a2e0-a1ba-4723-a5e6-ef7b66878537 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:20.939829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-66b5e2f5-67e2-4b51-b283-dfd1f65f3287 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:20.946361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66b5e2f5-67e2-4b51-b283-dfd1f65f3287 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:20.946802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66b5e2f5-67e2-4b51-b283-dfd1f65f3287 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:20.947566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66b5e2f5-67e2-4b51-b283-dfd1f65f3287 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:20.948001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66b5e2f5-67e2-4b51-b283-dfd1f65f3287 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:20.965080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:20.979101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-66b5e2f5-67e2-4b51-b283-dfd1f65f3287 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Jul 28 20:04:20.981388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 400/824] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:20 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:21.019628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7af4a2e0-a1ba-4723-a5e6-ef7b66878537 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094108 Jul 28 20:04:21.020303 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 425/825] 10.222.0.67 () {58 vars in 1275 bytes} [Thu Jul 28 20:04:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:21.678813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-14b32de1-b207-45ac-97e5-0e44d527b846 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:21.681010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-14b32de1-b207-45ac-97e5-0e44d527b846 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:21.687320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14b32de1-b207-45ac-97e5-0e44d527b846 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:21.687774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14b32de1-b207-45ac-97e5-0e44d527b846 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:21.688561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14b32de1-b207-45ac-97e5-0e44d527b846 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:21.689033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14b32de1-b207-45ac-97e5-0e44d527b846 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:21.723569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-14b32de1-b207-45ac-97e5-0e44d527b846 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049435 Jul 28 20:04:21.724146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 401/826] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:21 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:21.972080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-58e5c3a5-5669-499e-9c54-3453843391e0 req-cd496949-71bc-4ec1-8da3-4875aa660d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0038fe10-b9ea-4fe0-a220-9c2ab37f67ed", "tag": "6dbb0ebe-84c3-436a-9f54-19cbea4b1db1"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:04:21.982875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-58e5c3a5-5669-499e-9c54-3453843391e0 req-cd496949-71bc-4ec1-8da3-4875aa660d3c service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:21.983440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-58e5c3a5-5669-499e-9c54-3453843391e0 req-cd496949-71bc-4ec1-8da3-4875aa660d3c service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:21.991578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d5bdac74-2fba-4bdb-ba82-7dbd425a4c09 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:21.993975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d5bdac74-2fba-4bdb-ba82-7dbd425a4c09 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:21.996832 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-58e5c3a5-5669-499e-9c54-3453843391e0 req-cd496949-71bc-4ec1-8da3-4875aa660d3c service nova] Creating event network-changed:6dbb0ebe-84c3-436a-9f54-19cbea4b1db1 for instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed on hv-cinder-85144 Jul 28 20:04:22.001189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5bdac74-2fba-4bdb-ba82-7dbd425a4c09 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:22.001678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5bdac74-2fba-4bdb-ba82-7dbd425a4c09 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:22.002164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-58e5c3a5-5669-499e-9c54-3453843391e0 req-cd496949-71bc-4ec1-8da3-4875aa660d3c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100818 Jul 28 20:04:22.002425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5bdac74-2fba-4bdb-ba82-7dbd425a4c09 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:22.002765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 426/827] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:22.002931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5bdac74-2fba-4bdb-ba82-7dbd425a4c09 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:22.034468 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d5bdac74-2fba-4bdb-ba82-7dbd425a4c09 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046964 Jul 28 20:04:22.035776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 402/828] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:22.735646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1a4ced49-0482-49f9-ae77-2b042f89d9da tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:22.737948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1a4ced49-0482-49f9-ae77-2b042f89d9da tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:22.745072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a4ced49-0482-49f9-ae77-2b042f89d9da tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:22.745522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a4ced49-0482-49f9-ae77-2b042f89d9da tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:22.746290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a4ced49-0482-49f9-ae77-2b042f89d9da tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:22.746720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a4ced49-0482-49f9-ae77-2b042f89d9da tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:22.780067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1a4ced49-0482-49f9-ae77-2b042f89d9da tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048566 Jul 28 20:04:22.780648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 427/829] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:22 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:23.047404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b3e97f08-0105-4283-a04e-5e9b8af12f47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:23.049549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b3e97f08-0105-4283-a04e-5e9b8af12f47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:23.056093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3e97f08-0105-4283-a04e-5e9b8af12f47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:23.056531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3e97f08-0105-4283-a04e-5e9b8af12f47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:23.057315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3e97f08-0105-4283-a04e-5e9b8af12f47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:23.057743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3e97f08-0105-4283-a04e-5e9b8af12f47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:23.086130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b3e97f08-0105-4283-a04e-5e9b8af12f47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042734 Jul 28 20:04:23.086674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 403/830] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:23.792678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e3c3ca4f-9c96-4a72-b07c-ea17e83ba3ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:23.794889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e3c3ca4f-9c96-4a72-b07c-ea17e83ba3ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:23.801429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3c3ca4f-9c96-4a72-b07c-ea17e83ba3ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:23.801876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3c3ca4f-9c96-4a72-b07c-ea17e83ba3ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:23.802622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3c3ca4f-9c96-4a72-b07c-ea17e83ba3ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:23.803052 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3c3ca4f-9c96-4a72-b07c-ea17e83ba3ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:23.833245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e3c3ca4f-9c96-4a72-b07c-ea17e83ba3ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Jul 28 20:04:23.833777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 428/831] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:23 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:24.017308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-1fa75352-d6d7-4783-828d-9c6d2f70c0b7 req-79cc5939-c4b8-4330-a929-5b3f37e798aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0038fe10-b9ea-4fe0-a220-9c2ab37f67ed", "tag": "6dbb0ebe-84c3-436a-9f54-19cbea4b1db1"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:04:24.027275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-1fa75352-d6d7-4783-828d-9c6d2f70c0b7 req-79cc5939-c4b8-4330-a929-5b3f37e798aa service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:24.027712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-1fa75352-d6d7-4783-828d-9c6d2f70c0b7 req-79cc5939-c4b8-4330-a929-5b3f37e798aa service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:24.039495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-1fa75352-d6d7-4783-828d-9c6d2f70c0b7 req-79cc5939-c4b8-4330-a929-5b3f37e798aa service nova] Creating event network-changed:6dbb0ebe-84c3-436a-9f54-19cbea4b1db1 for instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed on hv-cinder-85144 Jul 28 20:04:24.044425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-1fa75352-d6d7-4783-828d-9c6d2f70c0b7 req-79cc5939-c4b8-4330-a929-5b3f37e798aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030801 Jul 28 20:04:24.045028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 404/832] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:24.099011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b183b80b-ba77-4c13-a099-2731d4491388 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:24.101180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b183b80b-ba77-4c13-a099-2731d4491388 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:24.107402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b183b80b-ba77-4c13-a099-2731d4491388 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:24.107982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b183b80b-ba77-4c13-a099-2731d4491388 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:24.108836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b183b80b-ba77-4c13-a099-2731d4491388 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:24.109330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b183b80b-ba77-4c13-a099-2731d4491388 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:24.139866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b183b80b-ba77-4c13-a099-2731d4491388 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Jul 28 20:04:24.140458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 429/833] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:24.846095 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4b803180-c915-4acd-82c9-e04e11c12410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:24.848840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4b803180-c915-4acd-82c9-e04e11c12410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:24.855662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b803180-c915-4acd-82c9-e04e11c12410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:24.856143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b803180-c915-4acd-82c9-e04e11c12410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:24.856999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b803180-c915-4acd-82c9-e04e11c12410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:24.857454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b803180-c915-4acd-82c9-e04e11c12410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:24.887232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4b803180-c915-4acd-82c9-e04e11c12410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Jul 28 20:04:24.887781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 405/834] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:25.153383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fbc89b6f-6457-4955-b4ba-71f53aeb44c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:25.155608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fbc89b6f-6457-4955-b4ba-71f53aeb44c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:25.163209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbc89b6f-6457-4955-b4ba-71f53aeb44c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:25.163652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbc89b6f-6457-4955-b4ba-71f53aeb44c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:25.164414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbc89b6f-6457-4955-b4ba-71f53aeb44c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:25.164873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbc89b6f-6457-4955-b4ba-71f53aeb44c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:25.193724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fbc89b6f-6457-4955-b4ba-71f53aeb44c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044391 Jul 28 20:04:25.194268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 430/835] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:25.899692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e9cb9f01-d1de-4db1-9891-31d40a040e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:25.901915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e9cb9f01-d1de-4db1-9891-31d40a040e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:25.908675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9cb9f01-d1de-4db1-9891-31d40a040e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:25.909116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9cb9f01-d1de-4db1-9891-31d40a040e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:25.909997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9cb9f01-d1de-4db1-9891-31d40a040e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:25.910438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9cb9f01-d1de-4db1-9891-31d40a040e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:25.939926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e9cb9f01-d1de-4db1-9891-31d40a040e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Jul 28 20:04:25.940469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 406/836] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:26.205629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-35400bcf-ced1-42cc-8aba-fcb332c0399f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:26.208012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-35400bcf-ced1-42cc-8aba-fcb332c0399f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:26.214589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35400bcf-ced1-42cc-8aba-fcb332c0399f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:26.215048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35400bcf-ced1-42cc-8aba-fcb332c0399f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:26.215780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35400bcf-ced1-42cc-8aba-fcb332c0399f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:26.216209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35400bcf-ced1-42cc-8aba-fcb332c0399f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:26.244817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-35400bcf-ced1-42cc-8aba-fcb332c0399f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 Jul 28 20:04:26.245355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 431/837] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:26.952716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-987adebb-a0e9-4e9d-ae4d-ac7a8ba1af5a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:26.954907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-987adebb-a0e9-4e9d-ae4d-ac7a8ba1af5a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:26.962251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-987adebb-a0e9-4e9d-ae4d-ac7a8ba1af5a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:26.962705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-987adebb-a0e9-4e9d-ae4d-ac7a8ba1af5a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:26.963464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-987adebb-a0e9-4e9d-ae4d-ac7a8ba1af5a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:26.963902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-987adebb-a0e9-4e9d-ae4d-ac7a8ba1af5a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:26.994080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-987adebb-a0e9-4e9d-ae4d-ac7a8ba1af5a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045338 Jul 28 20:04:26.994630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 407/838] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:27.256497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d0e8fb88-5012-43b4-b04e-ea1d7e00df23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:27.258680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d0e8fb88-5012-43b4-b04e-ea1d7e00df23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:27.265118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0e8fb88-5012-43b4-b04e-ea1d7e00df23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:27.265565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0e8fb88-5012-43b4-b04e-ea1d7e00df23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:27.266315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0e8fb88-5012-43b4-b04e-ea1d7e00df23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:27.266740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0e8fb88-5012-43b4-b04e-ea1d7e00df23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:27.295981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d0e8fb88-5012-43b4-b04e-ea1d7e00df23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043516 Jul 28 20:04:27.296513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 432/839] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:27 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:28.006002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d611555b-2736-469e-af75-135fb1363bd2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:28.008140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d611555b-2736-469e-af75-135fb1363bd2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:28.014666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d611555b-2736-469e-af75-135fb1363bd2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:28.015038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d611555b-2736-469e-af75-135fb1363bd2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:28.015788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d611555b-2736-469e-af75-135fb1363bd2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:28.016214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d611555b-2736-469e-af75-135fb1363bd2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:28.045557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d611555b-2736-469e-af75-135fb1363bd2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 Jul 28 20:04:28.046137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 408/840] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:28 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:28.309475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-26e63bee-a099-4eb1-a0c6-e43099f792cc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:28.311437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-26e63bee-a099-4eb1-a0c6-e43099f792cc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:28.318442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26e63bee-a099-4eb1-a0c6-e43099f792cc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:28.318881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26e63bee-a099-4eb1-a0c6-e43099f792cc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:28.319631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26e63bee-a099-4eb1-a0c6-e43099f792cc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:28.320058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26e63bee-a099-4eb1-a0c6-e43099f792cc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:28.348953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-26e63bee-a099-4eb1-a0c6-e43099f792cc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Jul 28 20:04:28.349490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 433/841] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:29.057879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8f6626e3-d5a9-4805-bbbb-4907a503c0f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:29.060014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8f6626e3-d5a9-4805-bbbb-4907a503c0f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:29.067140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f6626e3-d5a9-4805-bbbb-4907a503c0f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:29.067583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f6626e3-d5a9-4805-bbbb-4907a503c0f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:29.068332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f6626e3-d5a9-4805-bbbb-4907a503c0f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:29.068784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f6626e3-d5a9-4805-bbbb-4907a503c0f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:29.096811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8f6626e3-d5a9-4805-bbbb-4907a503c0f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042613 Jul 28 20:04:29.097528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 409/842] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:29 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:29.361408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-19295629-c656-464b-82fd-34f903e7f9d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:29.364260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-19295629-c656-464b-82fd-34f903e7f9d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:29.370716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-19295629-c656-464b-82fd-34f903e7f9d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:29.371161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-19295629-c656-464b-82fd-34f903e7f9d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:29.371954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-19295629-c656-464b-82fd-34f903e7f9d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:29.372386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-19295629-c656-464b-82fd-34f903e7f9d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:29.400393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-19295629-c656-464b-82fd-34f903e7f9d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042955 Jul 28 20:04:29.400962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 434/843] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:30.108887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8794aa35-b267-4c39-acf3-b6b5b9a1d1c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:30.110980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8794aa35-b267-4c39-acf3-b6b5b9a1d1c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:30.117539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8794aa35-b267-4c39-acf3-b6b5b9a1d1c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:30.117984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8794aa35-b267-4c39-acf3-b6b5b9a1d1c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:30.118745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8794aa35-b267-4c39-acf3-b6b5b9a1d1c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:30.119170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8794aa35-b267-4c39-acf3-b6b5b9a1d1c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:30.151375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8794aa35-b267-4c39-acf3-b6b5b9a1d1c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046307 Jul 28 20:04:30.151976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 410/844] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:30 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:30.412563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-59a28e7b-4b06-45a8-b77e-efb5d124579b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:30.414715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-59a28e7b-4b06-45a8-b77e-efb5d124579b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:30.421180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59a28e7b-4b06-45a8-b77e-efb5d124579b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:30.421626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59a28e7b-4b06-45a8-b77e-efb5d124579b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:30.422382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59a28e7b-4b06-45a8-b77e-efb5d124579b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:30.422819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59a28e7b-4b06-45a8-b77e-efb5d124579b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:30.451480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-59a28e7b-4b06-45a8-b77e-efb5d124579b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043069 Jul 28 20:04:30.452021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 435/845] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:31.164244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2b8d8f31-769e-4c5a-bd2b-6819765deec3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:31.166562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2b8d8f31-769e-4c5a-bd2b-6819765deec3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:31.173204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b8d8f31-769e-4c5a-bd2b-6819765deec3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:31.173656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b8d8f31-769e-4c5a-bd2b-6819765deec3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:31.174421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b8d8f31-769e-4c5a-bd2b-6819765deec3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:31.174873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b8d8f31-769e-4c5a-bd2b-6819765deec3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:31.203802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2b8d8f31-769e-4c5a-bd2b-6819765deec3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Jul 28 20:04:31.204348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 411/846] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:31.463564 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f3c94aa3-75cf-4ff3-83a0-3b3e397cade7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:31.465707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f3c94aa3-75cf-4ff3-83a0-3b3e397cade7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:31.472786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3c94aa3-75cf-4ff3-83a0-3b3e397cade7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:31.473227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3c94aa3-75cf-4ff3-83a0-3b3e397cade7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:31.473975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3c94aa3-75cf-4ff3-83a0-3b3e397cade7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:31.474405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3c94aa3-75cf-4ff3-83a0-3b3e397cade7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:31.501672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f3c94aa3-75cf-4ff3-83a0-3b3e397cade7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042033 Jul 28 20:04:31.502198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 436/847] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:32.216775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4481f032-7520-4a07-afd2-5c8f8df77b15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:32.218966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4481f032-7520-4a07-afd2-5c8f8df77b15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:32.225644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4481f032-7520-4a07-afd2-5c8f8df77b15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:32.226084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4481f032-7520-4a07-afd2-5c8f8df77b15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:32.226845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4481f032-7520-4a07-afd2-5c8f8df77b15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:32.227278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4481f032-7520-4a07-afd2-5c8f8df77b15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:32.257234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4481f032-7520-4a07-afd2-5c8f8df77b15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044497 Jul 28 20:04:32.257793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 412/848] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:32.514050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1009fe26-0f73-41c4-ac3c-8bb1240a6c15 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:32.516084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1009fe26-0f73-41c4-ac3c-8bb1240a6c15 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:32.522667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1009fe26-0f73-41c4-ac3c-8bb1240a6c15 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:32.523098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1009fe26-0f73-41c4-ac3c-8bb1240a6c15 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:32.523846 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1009fe26-0f73-41c4-ac3c-8bb1240a6c15 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:32.524269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1009fe26-0f73-41c4-ac3c-8bb1240a6c15 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:32.553725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1009fe26-0f73-41c4-ac3c-8bb1240a6c15 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Jul 28 20:04:32.554299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 437/849] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:32.713419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-984a346a-8932-4c6e-b8b0-648915fa573b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:04:32.713955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-984a346a-8932-4c6e-b8b0-648915fa573b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:32.720051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-984a346a-8932-4c6e-b8b0-648915fa573b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:32.720495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-984a346a-8932-4c6e-b8b0-648915fa573b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:32.721282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-984a346a-8932-4c6e-b8b0-648915fa573b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:32.722392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-984a346a-8932-4c6e-b8b0-648915fa573b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:32.744417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-984a346a-8932-4c6e-b8b0-648915fa573b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lazy-loading 'flavor' on Instance uuid f86779ed-0aff-43b5-a713-44e5384deb0d {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:04:32.813295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-984a346a-8932-4c6e-b8b0-648915fa573b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "POST /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d/action" status: 202 len: 0 microversion: 2.1 time: 0.103477 Jul 28 20:04:32.813775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 413/850] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:04:32 2022] POST /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:04:32.822293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b61c0e3f-86ef-422f-91ad-6fd7313cecc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:32.822906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b61c0e3f-86ef-422f-91ad-6fd7313cecc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:32.829035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b61c0e3f-86ef-422f-91ad-6fd7313cecc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:32.830680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b61c0e3f-86ef-422f-91ad-6fd7313cecc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:32.830680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b61c0e3f-86ef-422f-91ad-6fd7313cecc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:32.830680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b61c0e3f-86ef-422f-91ad-6fd7313cecc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:33.170453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b61c0e3f-86ef-422f-91ad-6fd7313cecc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:33.178599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b61c0e3f-86ef-422f-91ad-6fd7313cecc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.360202 Jul 28 20:04:33.179157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 438/851] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:32 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:33.270635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5065aa96-e624-4cf5-94ef-2aab74779781 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:33.272908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5065aa96-e624-4cf5-94ef-2aab74779781 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:33.279219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5065aa96-e624-4cf5-94ef-2aab74779781 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:33.279659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5065aa96-e624-4cf5-94ef-2aab74779781 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:33.280414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5065aa96-e624-4cf5-94ef-2aab74779781 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:33.280878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5065aa96-e624-4cf5-94ef-2aab74779781 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:33.309706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5065aa96-e624-4cf5-94ef-2aab74779781 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044101 Jul 28 20:04:33.310250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 414/852] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:33.566905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-09584295-23b3-4233-8827-1befcce80cc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:33.569110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-09584295-23b3-4233-8827-1befcce80cc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:33.575864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09584295-23b3-4233-8827-1befcce80cc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:33.576309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09584295-23b3-4233-8827-1befcce80cc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:33.577115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09584295-23b3-4233-8827-1befcce80cc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:33.577574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09584295-23b3-4233-8827-1befcce80cc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:33.594245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:33.607377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-09584295-23b3-4233-8827-1befcce80cc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Jul 28 20:04:33.607921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 439/853] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:34.200807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8ed2a24d-8c44-4405-8e4a-957a929feac2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:34.201411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8ed2a24d-8c44-4405-8e4a-957a929feac2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:34.208398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ed2a24d-8c44-4405-8e4a-957a929feac2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:34.208859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ed2a24d-8c44-4405-8e4a-957a929feac2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:34.209611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ed2a24d-8c44-4405-8e4a-957a929feac2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:34.210034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ed2a24d-8c44-4405-8e4a-957a929feac2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:34.321282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6166dee3-c978-4fd4-ace8-8dd762c8e381 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:34.323480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6166dee3-c978-4fd4-ace8-8dd762c8e381 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:34.329371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6166dee3-c978-4fd4-ace8-8dd762c8e381 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:34.329808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6166dee3-c978-4fd4-ace8-8dd762c8e381 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:34.330699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6166dee3-c978-4fd4-ace8-8dd762c8e381 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:34.331707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6166dee3-c978-4fd4-ace8-8dd762c8e381 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:34.339317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8ed2a24d-8c44-4405-8e4a-957a929feac2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:34.342866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:34.348593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8ed2a24d-8c44-4405-8e4a-957a929feac2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151646 Jul 28 20:04:34.349170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 415/854] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:34 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:34.361685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6166dee3-c978-4fd4-ace8-8dd762c8e381 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044310 Jul 28 20:04:34.362283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 440/855] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:34 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:34.620346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f567c571-bc57-4532-ac7b-0f0c30400a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:34.622515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f567c571-bc57-4532-ac7b-0f0c30400a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:34.629110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f567c571-bc57-4532-ac7b-0f0c30400a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:34.629549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f567c571-bc57-4532-ac7b-0f0c30400a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:34.630295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f567c571-bc57-4532-ac7b-0f0c30400a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:34.630721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f567c571-bc57-4532-ac7b-0f0c30400a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:34.658867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f567c571-bc57-4532-ac7b-0f0c30400a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 Jul 28 20:04:34.659999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 416/856] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:35.370129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-733f6571-a57c-43c2-822f-be12004fef4a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:35.370649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-733f6571-a57c-43c2-822f-be12004fef4a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:35.373509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-56d1620f-ac86-4722-b0bd-30a1b375fa13 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:35.375677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-56d1620f-ac86-4722-b0bd-30a1b375fa13 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:35.377117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-733f6571-a57c-43c2-822f-be12004fef4a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:35.377560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-733f6571-a57c-43c2-822f-be12004fef4a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:35.378663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-733f6571-a57c-43c2-822f-be12004fef4a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:35.379156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-733f6571-a57c-43c2-822f-be12004fef4a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:35.382136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56d1620f-ac86-4722-b0bd-30a1b375fa13 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:35.382578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56d1620f-ac86-4722-b0bd-30a1b375fa13 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:35.383344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56d1620f-ac86-4722-b0bd-30a1b375fa13 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:35.383764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56d1620f-ac86-4722-b0bd-30a1b375fa13 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:35.417187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-56d1620f-ac86-4722-b0bd-30a1b375fa13 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047459 Jul 28 20:04:35.417785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 417/857] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:35 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:35.660661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-733f6571-a57c-43c2-822f-be12004fef4a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:35.668439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-733f6571-a57c-43c2-822f-be12004fef4a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.302234 Jul 28 20:04:35.669184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 441/858] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:35 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:35.673059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-55346d8a-3a88-409e-a3d8-d6d527fe1a67 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:35.675826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-55346d8a-3a88-409e-a3d8-d6d527fe1a67 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:35.681697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55346d8a-3a88-409e-a3d8-d6d527fe1a67 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:35.682146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55346d8a-3a88-409e-a3d8-d6d527fe1a67 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:35.682909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55346d8a-3a88-409e-a3d8-d6d527fe1a67 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:35.683343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55346d8a-3a88-409e-a3d8-d6d527fe1a67 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:35.713115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-55346d8a-3a88-409e-a3d8-d6d527fe1a67 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044083 Jul 28 20:04:35.713678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 418/859] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:36.430281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c28ac3f8-1bb0-4c5d-a984-990678c140bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:36.432312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c28ac3f8-1bb0-4c5d-a984-990678c140bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:36.438759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c28ac3f8-1bb0-4c5d-a984-990678c140bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:36.439205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c28ac3f8-1bb0-4c5d-a984-990678c140bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:36.439960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c28ac3f8-1bb0-4c5d-a984-990678c140bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:36.441203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c28ac3f8-1bb0-4c5d-a984-990678c140bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:36.469283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c28ac3f8-1bb0-4c5d-a984-990678c140bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 Jul 28 20:04:36.469807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 442/860] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:36 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:36.690126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc47de08-52d0-44be-adf1-80058f46f330 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:36.691745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc47de08-52d0-44be-adf1-80058f46f330 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:36.698274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc47de08-52d0-44be-adf1-80058f46f330 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:36.698713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc47de08-52d0-44be-adf1-80058f46f330 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:36.699464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc47de08-52d0-44be-adf1-80058f46f330 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:36.699890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc47de08-52d0-44be-adf1-80058f46f330 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:36.725649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1a050935-ed03-43ef-acac-2e33520fccd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:36.727753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1a050935-ed03-43ef-acac-2e33520fccd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:36.733805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a050935-ed03-43ef-acac-2e33520fccd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:36.734269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a050935-ed03-43ef-acac-2e33520fccd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:36.735015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a050935-ed03-43ef-acac-2e33520fccd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:36.735445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a050935-ed03-43ef-acac-2e33520fccd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:36.767162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1a050935-ed03-43ef-acac-2e33520fccd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Jul 28 20:04:36.767710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 443/861] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:36 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:36.831522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cc47de08-52d0-44be-adf1-80058f46f330 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:36.838417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc47de08-52d0-44be-adf1-80058f46f330 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152215 Jul 28 20:04:36.838971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 419/862] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:36 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:37.481716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-abec8f89-f50e-4533-a0d3-07bdc66a7610 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:37.483849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-abec8f89-f50e-4533-a0d3-07bdc66a7610 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:37.490871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abec8f89-f50e-4533-a0d3-07bdc66a7610 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:37.491341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abec8f89-f50e-4533-a0d3-07bdc66a7610 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:37.492089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abec8f89-f50e-4533-a0d3-07bdc66a7610 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:37.492518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abec8f89-f50e-4533-a0d3-07bdc66a7610 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:37.521253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-abec8f89-f50e-4533-a0d3-07bdc66a7610 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043445 Jul 28 20:04:37.521780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 444/863] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:37 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:37.779936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fe08283d-dda1-4ce2-a8f0-15eda1c1f567 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:37.782345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fe08283d-dda1-4ce2-a8f0-15eda1c1f567 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:37.788829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe08283d-dda1-4ce2-a8f0-15eda1c1f567 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:37.789306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe08283d-dda1-4ce2-a8f0-15eda1c1f567 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:37.790052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe08283d-dda1-4ce2-a8f0-15eda1c1f567 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:37.790480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe08283d-dda1-4ce2-a8f0-15eda1c1f567 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:37.818405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fe08283d-dda1-4ce2-a8f0-15eda1c1f567 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042423 Jul 28 20:04:37.818939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 420/864] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:37.859812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-00620186-dd7d-4d7a-988e-be57c77c16c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:37.860413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-00620186-dd7d-4d7a-988e-be57c77c16c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:37.866570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00620186-dd7d-4d7a-988e-be57c77c16c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:37.867011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00620186-dd7d-4d7a-988e-be57c77c16c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:37.867756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00620186-dd7d-4d7a-988e-be57c77c16c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:37.868182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00620186-dd7d-4d7a-988e-be57c77c16c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:37.997376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-00620186-dd7d-4d7a-988e-be57c77c16c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:38.005892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-00620186-dd7d-4d7a-988e-be57c77c16c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149876 Jul 28 20:04:38.006439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 445/865] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:37 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:38.533697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-38760318-a8ed-4be8-9844-67c76ef20ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:38.536444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-38760318-a8ed-4be8-9844-67c76ef20ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:38.542488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38760318-a8ed-4be8-9844-67c76ef20ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:38.542935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38760318-a8ed-4be8-9844-67c76ef20ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:38.543694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38760318-a8ed-4be8-9844-67c76ef20ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:38.544127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38760318-a8ed-4be8-9844-67c76ef20ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:38.573093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-38760318-a8ed-4be8-9844-67c76ef20ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Jul 28 20:04:38.573634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 421/866] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:38.830610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-01ceb506-ef01-4db0-9737-08ccd971f326 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:38.833467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-01ceb506-ef01-4db0-9737-08ccd971f326 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:38.839823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01ceb506-ef01-4db0-9737-08ccd971f326 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:38.840262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01ceb506-ef01-4db0-9737-08ccd971f326 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:38.841035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01ceb506-ef01-4db0-9737-08ccd971f326 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:38.841464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01ceb506-ef01-4db0-9737-08ccd971f326 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:38.869891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-01ceb506-ef01-4db0-9737-08ccd971f326 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043152 Jul 28 20:04:38.870423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 446/867] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:39.027410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c6b9130f-8397-42ca-ba20-4d1feb09d9e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:39.028021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c6b9130f-8397-42ca-ba20-4d1feb09d9e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:39.035521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6b9130f-8397-42ca-ba20-4d1feb09d9e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:39.035968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6b9130f-8397-42ca-ba20-4d1feb09d9e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:39.036758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6b9130f-8397-42ca-ba20-4d1feb09d9e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:39.037189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6b9130f-8397-42ca-ba20-4d1feb09d9e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:39.170371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c6b9130f-8397-42ca-ba20-4d1feb09d9e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:39.178157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c6b9130f-8397-42ca-ba20-4d1feb09d9e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.154573 Jul 28 20:04:39.178716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 422/868] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:39 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:39.584526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cb1b1306-57ce-44cf-a1cf-fb7f5ebe58ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:39.586665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cb1b1306-57ce-44cf-a1cf-fb7f5ebe58ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:39.592719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1b1306-57ce-44cf-a1cf-fb7f5ebe58ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:39.593161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1b1306-57ce-44cf-a1cf-fb7f5ebe58ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:39.593914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1b1306-57ce-44cf-a1cf-fb7f5ebe58ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:39.594346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1b1306-57ce-44cf-a1cf-fb7f5ebe58ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:39.624259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cb1b1306-57ce-44cf-a1cf-fb7f5ebe58ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Jul 28 20:04:39.624817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 447/869] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:39 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:39.881890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2cf51265-a006-48a1-8f43-210cd191fafb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:39.883955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2cf51265-a006-48a1-8f43-210cd191fafb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:39.890125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2cf51265-a006-48a1-8f43-210cd191fafb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:39.890574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2cf51265-a006-48a1-8f43-210cd191fafb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:39.891362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2cf51265-a006-48a1-8f43-210cd191fafb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:39.891825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2cf51265-a006-48a1-8f43-210cd191fafb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:39.920779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2cf51265-a006-48a1-8f43-210cd191fafb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Jul 28 20:04:39.921332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 423/870] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:40.199247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bb526177-e104-4ad0-bf20-9c913d445394 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:40.199854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bb526177-e104-4ad0-bf20-9c913d445394 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:40.206909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb526177-e104-4ad0-bf20-9c913d445394 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:40.207370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb526177-e104-4ad0-bf20-9c913d445394 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:40.208123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb526177-e104-4ad0-bf20-9c913d445394 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:40.208584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb526177-e104-4ad0-bf20-9c913d445394 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:40.336661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bb526177-e104-4ad0-bf20-9c913d445394 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:40.344148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bb526177-e104-4ad0-bf20-9c913d445394 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.148806 Jul 28 20:04:40.344726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 448/871] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:40 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:40.636905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-55e4064b-bd14-4cf9-b4b7-b7bbd51e102a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:40.639070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-55e4064b-bd14-4cf9-b4b7-b7bbd51e102a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:40.646408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55e4064b-bd14-4cf9-b4b7-b7bbd51e102a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:40.646858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55e4064b-bd14-4cf9-b4b7-b7bbd51e102a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:40.647631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55e4064b-bd14-4cf9-b4b7-b7bbd51e102a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:40.648062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55e4064b-bd14-4cf9-b4b7-b7bbd51e102a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:40.677491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-55e4064b-bd14-4cf9-b4b7-b7bbd51e102a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Jul 28 20:04:40.678052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 424/872] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:40.933938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ef34dd75-36b2-4477-9a0c-528b9518cdd3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:40.935975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ef34dd75-36b2-4477-9a0c-528b9518cdd3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:40.942769 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef34dd75-36b2-4477-9a0c-528b9518cdd3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:40.943213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef34dd75-36b2-4477-9a0c-528b9518cdd3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:40.943970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef34dd75-36b2-4477-9a0c-528b9518cdd3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:40.944405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef34dd75-36b2-4477-9a0c-528b9518cdd3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:40.973985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ef34dd75-36b2-4477-9a0c-528b9518cdd3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Jul 28 20:04:40.974530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 449/873] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:41.366886 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-13094c81-7aa9-4656-a219-9966d338f1dc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:41.367615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-13094c81-7aa9-4656-a219-9966d338f1dc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:41.373707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13094c81-7aa9-4656-a219-9966d338f1dc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:41.374150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13094c81-7aa9-4656-a219-9966d338f1dc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:41.374900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13094c81-7aa9-4656-a219-9966d338f1dc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:41.375327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13094c81-7aa9-4656-a219-9966d338f1dc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:41.511674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-13094c81-7aa9-4656-a219-9966d338f1dc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:41.519755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-13094c81-7aa9-4656-a219-9966d338f1dc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.157748 Jul 28 20:04:41.520350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 425/874] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:41 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:41.689886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4a2c3d08-820b-4125-9982-abea8939f554 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:41.692431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4a2c3d08-820b-4125-9982-abea8939f554 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:41.699357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a2c3d08-820b-4125-9982-abea8939f554 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:41.699811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a2c3d08-820b-4125-9982-abea8939f554 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:41.700622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a2c3d08-820b-4125-9982-abea8939f554 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:41.701055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a2c3d08-820b-4125-9982-abea8939f554 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:41.730457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4a2c3d08-820b-4125-9982-abea8939f554 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044527 Jul 28 20:04:41.730997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 450/875] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:41 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:41.986960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f09c292d-c220-4d13-bf61-1a34549861f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:41.989230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f09c292d-c220-4d13-bf61-1a34549861f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:41.995634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f09c292d-c220-4d13-bf61-1a34549861f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:41.996076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f09c292d-c220-4d13-bf61-1a34549861f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:41.996855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f09c292d-c220-4d13-bf61-1a34549861f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:41.997280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f09c292d-c220-4d13-bf61-1a34549861f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:42.027041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f09c292d-c220-4d13-bf61-1a34549861f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Jul 28 20:04:42.027506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 426/876] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:42.540921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f58f02cb-1638-4ab2-b7de-160c244d0be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:42.541448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f58f02cb-1638-4ab2-b7de-160c244d0be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:42.547351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f58f02cb-1638-4ab2-b7de-160c244d0be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:42.547789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f58f02cb-1638-4ab2-b7de-160c244d0be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:42.548530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f58f02cb-1638-4ab2-b7de-160c244d0be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:42.548976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f58f02cb-1638-4ab2-b7de-160c244d0be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:42.677682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f58f02cb-1638-4ab2-b7de-160c244d0be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:42.685145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f58f02cb-1638-4ab2-b7de-160c244d0be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.148186 Jul 28 20:04:42.685690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 451/877] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:42 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:42.742793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eb968522-3f54-4204-8a4f-da131a7b3e23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:42.744969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eb968522-3f54-4204-8a4f-da131a7b3e23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:42.750855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb968522-3f54-4204-8a4f-da131a7b3e23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:42.751302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb968522-3f54-4204-8a4f-da131a7b3e23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:42.752054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb968522-3f54-4204-8a4f-da131a7b3e23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:42.753208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb968522-3f54-4204-8a4f-da131a7b3e23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:42.782363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eb968522-3f54-4204-8a4f-da131a7b3e23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043419 Jul 28 20:04:42.782906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 427/878] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:42 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:43.138486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-859e7b34-b47b-45d8-b5af-43d25f36627b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:43.140856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-859e7b34-b47b-45d8-b5af-43d25f36627b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:43.147274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-859e7b34-b47b-45d8-b5af-43d25f36627b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:43.147728 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-859e7b34-b47b-45d8-b5af-43d25f36627b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:43.148497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-859e7b34-b47b-45d8-b5af-43d25f36627b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:43.148959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-859e7b34-b47b-45d8-b5af-43d25f36627b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:43.180147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-859e7b34-b47b-45d8-b5af-43d25f36627b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144288 Jul 28 20:04:43.180741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 452/879] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:43.706775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cb1fdcec-562b-4aed-9976-cce3507f11a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:43.707414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cb1fdcec-562b-4aed-9976-cce3507f11a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:43.714557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cb1fdcec-562b-4aed-9976-cce3507f11a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:43.714999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cb1fdcec-562b-4aed-9976-cce3507f11a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:43.715750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cb1fdcec-562b-4aed-9976-cce3507f11a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:43.716174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cb1fdcec-562b-4aed-9976-cce3507f11a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:43.794589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1b494f48-a0f4-4e41-84f1-2d4c39c78193 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:43.796774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1b494f48-a0f4-4e41-84f1-2d4c39c78193 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:43.803082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b494f48-a0f4-4e41-84f1-2d4c39c78193 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:43.803534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b494f48-a0f4-4e41-84f1-2d4c39c78193 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:43.804304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b494f48-a0f4-4e41-84f1-2d4c39c78193 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:43.804847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b494f48-a0f4-4e41-84f1-2d4c39c78193 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:43.836119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1b494f48-a0f4-4e41-84f1-2d4c39c78193 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Jul 28 20:04:43.836750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 453/880] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:43 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:43.850030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cb1fdcec-562b-4aed-9976-cce3507f11a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:43.857520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cb1fdcec-562b-4aed-9976-cce3507f11a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.154589 Jul 28 20:04:43.858112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 428/881] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:43 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:44.192586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-02f8b7af-3d94-453c-a76b-9efa13fceb29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:44.194702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-02f8b7af-3d94-453c-a76b-9efa13fceb29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:44.201070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02f8b7af-3d94-453c-a76b-9efa13fceb29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:44.201512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02f8b7af-3d94-453c-a76b-9efa13fceb29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:44.202264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02f8b7af-3d94-453c-a76b-9efa13fceb29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:44.202687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02f8b7af-3d94-453c-a76b-9efa13fceb29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:44.230491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-02f8b7af-3d94-453c-a76b-9efa13fceb29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042760 Jul 28 20:04:44.231032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 454/882] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:44.848801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0503a95f-b8fc-4550-b76f-97ce13388b03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:44.850976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0503a95f-b8fc-4550-b76f-97ce13388b03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:44.857515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0503a95f-b8fc-4550-b76f-97ce13388b03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:44.857960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0503a95f-b8fc-4550-b76f-97ce13388b03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:44.858717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0503a95f-b8fc-4550-b76f-97ce13388b03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:44.859148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0503a95f-b8fc-4550-b76f-97ce13388b03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:44.879580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-61badd3f-7197-41b7-b0cb-3f850c2f98c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:44.880220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-61badd3f-7197-41b7-b0cb-3f850c2f98c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:44.886360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61badd3f-7197-41b7-b0cb-3f850c2f98c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:44.886845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61badd3f-7197-41b7-b0cb-3f850c2f98c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:44.887403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0503a95f-b8fc-4550-b76f-97ce13388b03 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043230 Jul 28 20:04:44.887672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61badd3f-7197-41b7-b0cb-3f850c2f98c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:44.887961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 429/883] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:44 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:44.888157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61badd3f-7197-41b7-b0cb-3f850c2f98c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:45.021990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-61badd3f-7197-41b7-b0cb-3f850c2f98c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:45.029497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-61badd3f-7197-41b7-b0cb-3f850c2f98c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.154190 Jul 28 20:04:45.030108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 455/884] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:44 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:04:45.242826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4abb04ea-abad-4436-84a4-02a49a78608c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:45.245065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4abb04ea-abad-4436-84a4-02a49a78608c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:45.251102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4abb04ea-abad-4436-84a4-02a49a78608c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:45.251545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4abb04ea-abad-4436-84a4-02a49a78608c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:45.252842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4abb04ea-abad-4436-84a4-02a49a78608c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:45.253720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4abb04ea-abad-4436-84a4-02a49a78608c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:45.283035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4abb04ea-abad-4436-84a4-02a49a78608c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Jul 28 20:04:45.283596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 430/885] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:45.898884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-07a7cac2-d224-4344-89e5-9d765a425147 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:45.901122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-07a7cac2-d224-4344-89e5-9d765a425147 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:45.907808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07a7cac2-d224-4344-89e5-9d765a425147 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:45.908255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07a7cac2-d224-4344-89e5-9d765a425147 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:45.909553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07a7cac2-d224-4344-89e5-9d765a425147 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:45.909984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07a7cac2-d224-4344-89e5-9d765a425147 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:45.913790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:45.940404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-07a7cac2-d224-4344-89e5-9d765a425147 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 Jul 28 20:04:45.941026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 456/886] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:46.051917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b637b8e2-2331-4f1a-ba4a-f985f4026838 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:46.052442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b637b8e2-2331-4f1a-ba4a-f985f4026838 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:46.058889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b637b8e2-2331-4f1a-ba4a-f985f4026838 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:46.059331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b637b8e2-2331-4f1a-ba4a-f985f4026838 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:46.060074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b637b8e2-2331-4f1a-ba4a-f985f4026838 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:46.060498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b637b8e2-2331-4f1a-ba4a-f985f4026838 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:46.213568 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b637b8e2-2331-4f1a-ba4a-f985f4026838 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:46.222784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b637b8e2-2331-4f1a-ba4a-f985f4026838 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.175282 Jul 28 20:04:46.223363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 431/887] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:46 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:46.296926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5baaa503-6a61-4761-ae3d-cb428d0033cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:46.299525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5baaa503-6a61-4761-ae3d-cb428d0033cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:46.306007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5baaa503-6a61-4761-ae3d-cb428d0033cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:46.306385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5baaa503-6a61-4761-ae3d-cb428d0033cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:46.307151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5baaa503-6a61-4761-ae3d-cb428d0033cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:46.307584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5baaa503-6a61-4761-ae3d-cb428d0033cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:46.339434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5baaa503-6a61-4761-ae3d-cb428d0033cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047872 Jul 28 20:04:46.340118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 457/888] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:46.953130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b5d1a517-315e-4b18-8a09-efc1ab4b138b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:46.955184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b5d1a517-315e-4b18-8a09-efc1ab4b138b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:46.961701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5d1a517-315e-4b18-8a09-efc1ab4b138b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:46.962149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5d1a517-315e-4b18-8a09-efc1ab4b138b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:46.962903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5d1a517-315e-4b18-8a09-efc1ab4b138b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:46.963362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5d1a517-315e-4b18-8a09-efc1ab4b138b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:46.979540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:46.992957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b5d1a517-315e-4b18-8a09-efc1ab4b138b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Jul 28 20:04:46.993516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 432/889] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:47.244194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c4ca9efe-2529-4840-b8b0-93c761c759f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:47.244809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c4ca9efe-2529-4840-b8b0-93c761c759f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:47.251148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4ca9efe-2529-4840-b8b0-93c761c759f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:47.251589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4ca9efe-2529-4840-b8b0-93c761c759f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:47.253046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4ca9efe-2529-4840-b8b0-93c761c759f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:47.253425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4ca9efe-2529-4840-b8b0-93c761c759f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:47.352175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4c28a26f-02fd-45d2-bd6f-35eacdc0cda6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:47.354455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4c28a26f-02fd-45d2-bd6f-35eacdc0cda6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:47.360800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c28a26f-02fd-45d2-bd6f-35eacdc0cda6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:47.361266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c28a26f-02fd-45d2-bd6f-35eacdc0cda6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:47.362780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c28a26f-02fd-45d2-bd6f-35eacdc0cda6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:47.363215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c28a26f-02fd-45d2-bd6f-35eacdc0cda6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:47.389157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c4ca9efe-2529-4840-b8b0-93c761c759f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:47.392434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4c28a26f-02fd-45d2-bd6f-35eacdc0cda6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044247 Jul 28 20:04:47.393072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 433/890] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:47 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:47.397102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c4ca9efe-2529-4840-b8b0-93c761c759f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.156844 Jul 28 20:04:47.397647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 458/891] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:48.004681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c55ad45-c226-4b40-a052-f8fe30ffce37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:48.006807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3c55ad45-c226-4b40-a052-f8fe30ffce37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:48.012792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c55ad45-c226-4b40-a052-f8fe30ffce37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:48.013230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c55ad45-c226-4b40-a052-f8fe30ffce37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:48.013984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c55ad45-c226-4b40-a052-f8fe30ffce37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:48.014409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c55ad45-c226-4b40-a052-f8fe30ffce37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:48.044576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3c55ad45-c226-4b40-a052-f8fe30ffce37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Jul 28 20:04:48.045054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 434/892] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:48.404762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1f1023e9-3b4d-4169-be7d-5d290c21b02b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:48.407177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1f1023e9-3b4d-4169-be7d-5d290c21b02b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:48.413732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1f1023e9-3b4d-4169-be7d-5d290c21b02b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:48.414127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1f1023e9-3b4d-4169-be7d-5d290c21b02b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:48.414879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1f1023e9-3b4d-4169-be7d-5d290c21b02b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:48.415304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1f1023e9-3b4d-4169-be7d-5d290c21b02b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:48.418780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-306e419c-896c-44a4-9664-bae2c561ccab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:48.419391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-306e419c-896c-44a4-9664-bae2c561ccab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:48.426555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-306e419c-896c-44a4-9664-bae2c561ccab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:48.426998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-306e419c-896c-44a4-9664-bae2c561ccab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:48.427757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-306e419c-896c-44a4-9664-bae2c561ccab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:48.428187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-306e419c-896c-44a4-9664-bae2c561ccab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:48.444684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1f1023e9-3b4d-4169-be7d-5d290c21b02b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043760 Jul 28 20:04:48.445232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 459/893] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:48.558006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-306e419c-896c-44a4-9664-bae2c561ccab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:48.566463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-306e419c-896c-44a4-9664-bae2c561ccab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151463 Jul 28 20:04:48.567025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 435/894] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:04:49.056642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-47575d41-0aa2-4ea4-9826-0ab04daf1d9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:49.058785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-47575d41-0aa2-4ea4-9826-0ab04daf1d9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:49.064866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47575d41-0aa2-4ea4-9826-0ab04daf1d9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:49.065376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47575d41-0aa2-4ea4-9826-0ab04daf1d9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:49.066067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47575d41-0aa2-4ea4-9826-0ab04daf1d9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:49.066493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47575d41-0aa2-4ea4-9826-0ab04daf1d9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:49.093979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-47575d41-0aa2-4ea4-9826-0ab04daf1d9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041324 Jul 28 20:04:49.094512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 460/895] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:49 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:49.457877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a56d4cf7-de9b-4cdf-9e21-67ce2bf8c415 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:49.460048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a56d4cf7-de9b-4cdf-9e21-67ce2bf8c415 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:49.466493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a56d4cf7-de9b-4cdf-9e21-67ce2bf8c415 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:49.466932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a56d4cf7-de9b-4cdf-9e21-67ce2bf8c415 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:49.467676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a56d4cf7-de9b-4cdf-9e21-67ce2bf8c415 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:49.468099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a56d4cf7-de9b-4cdf-9e21-67ce2bf8c415 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:49.498121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a56d4cf7-de9b-4cdf-9e21-67ce2bf8c415 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Jul 28 20:04:49.498658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 436/896] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:49.587433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-69c7d390-9a44-404e-8a0f-21f7d61f1125 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:49.588044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-69c7d390-9a44-404e-8a0f-21f7d61f1125 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:49.594491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69c7d390-9a44-404e-8a0f-21f7d61f1125 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:49.594938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69c7d390-9a44-404e-8a0f-21f7d61f1125 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:49.595687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69c7d390-9a44-404e-8a0f-21f7d61f1125 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:49.596122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69c7d390-9a44-404e-8a0f-21f7d61f1125 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:49.726966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-69c7d390-9a44-404e-8a0f-21f7d61f1125 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:49.734636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-69c7d390-9a44-404e-8a0f-21f7d61f1125 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151099 Jul 28 20:04:49.735185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 461/897] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:49 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:50.106586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5342f0a3-2692-4964-97a0-537639000317 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:50.108744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5342f0a3-2692-4964-97a0-537639000317 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:50.115397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5342f0a3-2692-4964-97a0-537639000317 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:50.115837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5342f0a3-2692-4964-97a0-537639000317 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:50.116612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5342f0a3-2692-4964-97a0-537639000317 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:50.117039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5342f0a3-2692-4964-97a0-537639000317 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:50.146302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5342f0a3-2692-4964-97a0-537639000317 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043654 Jul 28 20:04:50.146907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 437/898] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:50 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:50.280080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-48e39f07-d1b0-4ca0-a235-a63876ebd3d0 req-469f081b-d5de-477d-9822-154dd50fd459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86779ed-0aff-43b5-a713-44e5384deb0d", "name": "network-vif-unplugged", "status": "completed", "tag": "0ef4ac93-7c07-48a3-8303-7e752c056864"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:04:50.291537 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-48e39f07-d1b0-4ca0-a235-a63876ebd3d0 req-469f081b-d5de-477d-9822-154dd50fd459 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:50.292004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-48e39f07-d1b0-4ca0-a235-a63876ebd3d0 req-469f081b-d5de-477d-9822-154dd50fd459 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:50.304075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-48e39f07-d1b0-4ca0-a235-a63876ebd3d0 req-469f081b-d5de-477d-9822-154dd50fd459 service nova] Creating event network-vif-unplugged:0ef4ac93-7c07-48a3-8303-7e752c056864 for instance f86779ed-0aff-43b5-a713-44e5384deb0d on hv-cinder-85144 Jul 28 20:04:50.309338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-48e39f07-d1b0-4ca0-a235-a63876ebd3d0 req-469f081b-d5de-477d-9822-154dd50fd459 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087623 Jul 28 20:04:50.310330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 462/899] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:50.321044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0a4d7b46-c12b-4334-874e-2615b983d172 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:50.321541 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0a4d7b46-c12b-4334-874e-2615b983d172 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:50.327464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a4d7b46-c12b-4334-874e-2615b983d172 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:50.327911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a4d7b46-c12b-4334-874e-2615b983d172 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:50.328729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a4d7b46-c12b-4334-874e-2615b983d172 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:50.329167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a4d7b46-c12b-4334-874e-2615b983d172 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:50.352523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0a4d7b46-c12b-4334-874e-2615b983d172 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2/ips" status: 200 len: 150 microversion: 2.20 time: 0.035394 Jul 28 20:04:50.353093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 438/900] 10.222.0.67 () {60 vars in 1289 bytes} [Thu Jul 28 20:04:50 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:04:50.511006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a17842e5-ba42-4ea4-9c43-8812609b0773 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:50.513178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a17842e5-ba42-4ea4-9c43-8812609b0773 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:50.519435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a17842e5-ba42-4ea4-9c43-8812609b0773 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:50.519877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a17842e5-ba42-4ea4-9c43-8812609b0773 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:50.520668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a17842e5-ba42-4ea4-9c43-8812609b0773 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:50.521098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a17842e5-ba42-4ea4-9c43-8812609b0773 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:50.550065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a17842e5-ba42-4ea4-9c43-8812609b0773 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 Jul 28 20:04:50.550667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 463/901] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:50.756347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-67fa9763-dfc7-47ee-aea3-930ff100f503 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:50.757355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-67fa9763-dfc7-47ee-aea3-930ff100f503 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:50.760151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=80 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:50.766281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67fa9763-dfc7-47ee-aea3-930ff100f503 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:50.766711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67fa9763-dfc7-47ee-aea3-930ff100f503 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:50.767534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67fa9763-dfc7-47ee-aea3-930ff100f503 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:50.768592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67fa9763-dfc7-47ee-aea3-930ff100f503 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:50.897516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-67fa9763-dfc7-47ee-aea3-930ff100f503 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:50.904992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-67fa9763-dfc7-47ee-aea3-930ff100f503 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153034 Jul 28 20:04:50.905554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 439/902] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:51.157988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-62a4b8d7-0c26-470b-b5e1-e709eeff69d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:51.160134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-62a4b8d7-0c26-470b-b5e1-e709eeff69d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:51.162983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:51.168335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-62a4b8d7-0c26-470b-b5e1-e709eeff69d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:51.168809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-62a4b8d7-0c26-470b-b5e1-e709eeff69d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:51.169571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-62a4b8d7-0c26-470b-b5e1-e709eeff69d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:51.169998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-62a4b8d7-0c26-470b-b5e1-e709eeff69d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:51.199112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-62a4b8d7-0c26-470b-b5e1-e709eeff69d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Jul 28 20:04:51.199647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 464/903] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:51.562745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-667ab741-bafe-487e-afce-ffd98bcf0085 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:51.565815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-667ab741-bafe-487e-afce-ffd98bcf0085 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:51.571864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-667ab741-bafe-487e-afce-ffd98bcf0085 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:51.572305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-667ab741-bafe-487e-afce-ffd98bcf0085 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:51.573097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-667ab741-bafe-487e-afce-ffd98bcf0085 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:51.573525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-667ab741-bafe-487e-afce-ffd98bcf0085 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:51.601792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-667ab741-bafe-487e-afce-ffd98bcf0085 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043154 Jul 28 20:04:51.602334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 440/904] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:51.927777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a26e49f0-9a40-44b9-a7fa-1f3efcefbef0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:51.928390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a26e49f0-9a40-44b9-a7fa-1f3efcefbef0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:51.934494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a26e49f0-9a40-44b9-a7fa-1f3efcefbef0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:51.934938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a26e49f0-9a40-44b9-a7fa-1f3efcefbef0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:51.935689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a26e49f0-9a40-44b9-a7fa-1f3efcefbef0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:51.936117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a26e49f0-9a40-44b9-a7fa-1f3efcefbef0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:52.064869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a26e49f0-9a40-44b9-a7fa-1f3efcefbef0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:52.072482 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a26e49f0-9a40-44b9-a7fa-1f3efcefbef0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149188 Jul 28 20:04:52.073058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 465/905] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:51 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:52.211930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-18f22607-a58a-47b8-93ee-bb0232c42290 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:52.214035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-18f22607-a58a-47b8-93ee-bb0232c42290 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:52.220435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18f22607-a58a-47b8-93ee-bb0232c42290 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:52.221537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18f22607-a58a-47b8-93ee-bb0232c42290 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:52.222333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18f22607-a58a-47b8-93ee-bb0232c42290 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:52.222760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18f22607-a58a-47b8-93ee-bb0232c42290 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:52.250882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-18f22607-a58a-47b8-93ee-bb0232c42290 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043013 Jul 28 20:04:52.251430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 441/906] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:52 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:52.614473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ab8bbe1-1c38-4434-ad49-364db074cb63 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:52.616725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0ab8bbe1-1c38-4434-ad49-364db074cb63 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:52.623191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ab8bbe1-1c38-4434-ad49-364db074cb63 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:52.623639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ab8bbe1-1c38-4434-ad49-364db074cb63 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:52.624397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ab8bbe1-1c38-4434-ad49-364db074cb63 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:52.624868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ab8bbe1-1c38-4434-ad49-364db074cb63 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:52.654071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0ab8bbe1-1c38-4434-ad49-364db074cb63 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044002 Jul 28 20:04:52.654617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 466/907] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:53.092892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bc827289-12fc-4157-a720-4377358913ea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:53.093504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bc827289-12fc-4157-a720-4377358913ea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:53.099571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc827289-12fc-4157-a720-4377358913ea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:53.100026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc827289-12fc-4157-a720-4377358913ea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:53.100866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc827289-12fc-4157-a720-4377358913ea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:53.101327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc827289-12fc-4157-a720-4377358913ea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:53.238655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bc827289-12fc-4157-a720-4377358913ea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:53.246230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bc827289-12fc-4157-a720-4377358913ea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.157184 Jul 28 20:04:53.246791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 442/908] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:53 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:53.263221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7e03a66a-bdc6-410c-ab02-71ef1dc27083 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:53.265374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7e03a66a-bdc6-410c-ab02-71ef1dc27083 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:53.271406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e03a66a-bdc6-410c-ab02-71ef1dc27083 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:53.271844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e03a66a-bdc6-410c-ab02-71ef1dc27083 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:53.272620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e03a66a-bdc6-410c-ab02-71ef1dc27083 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:53.273051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e03a66a-bdc6-410c-ab02-71ef1dc27083 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:53.303039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7e03a66a-bdc6-410c-ab02-71ef1dc27083 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Jul 28 20:04:53.303575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 467/909] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:53.667336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4f2c04ed-97be-4bfb-8d9f-874bdf6247d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:53.669511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4f2c04ed-97be-4bfb-8d9f-874bdf6247d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:53.676299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f2c04ed-97be-4bfb-8d9f-874bdf6247d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:53.676772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f2c04ed-97be-4bfb-8d9f-874bdf6247d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:53.677520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f2c04ed-97be-4bfb-8d9f-874bdf6247d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:53.677946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f2c04ed-97be-4bfb-8d9f-874bdf6247d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:53.707148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4f2c04ed-97be-4bfb-8d9f-874bdf6247d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 Jul 28 20:04:53.707679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 443/910] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:54.267357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d3060e9a-f32f-4094-bd14-1b55622532b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:54.268721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d3060e9a-f32f-4094-bd14-1b55622532b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:54.275090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3060e9a-f32f-4094-bd14-1b55622532b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:54.275534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3060e9a-f32f-4094-bd14-1b55622532b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:54.276286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3060e9a-f32f-4094-bd14-1b55622532b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:54.276750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3060e9a-f32f-4094-bd14-1b55622532b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:54.315732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-76f1d945-8f6f-48de-9db7-eba53ad1bc9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:54.317934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-76f1d945-8f6f-48de-9db7-eba53ad1bc9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:54.324431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76f1d945-8f6f-48de-9db7-eba53ad1bc9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:54.324917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76f1d945-8f6f-48de-9db7-eba53ad1bc9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:54.325684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76f1d945-8f6f-48de-9db7-eba53ad1bc9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:54.326120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76f1d945-8f6f-48de-9db7-eba53ad1bc9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:54.356519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-76f1d945-8f6f-48de-9db7-eba53ad1bc9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Jul 28 20:04:54.357103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 444/911] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:54.405562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d3060e9a-f32f-4094-bd14-1b55622532b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:54.413767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d3060e9a-f32f-4094-bd14-1b55622532b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.150248 Jul 28 20:04:54.414372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 468/912] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:54.719518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc327a59-d8b6-4f58-a7ea-fbe070af117d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:54.721783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc327a59-d8b6-4f58-a7ea-fbe070af117d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:54.728476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc327a59-d8b6-4f58-a7ea-fbe070af117d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:54.729115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc327a59-d8b6-4f58-a7ea-fbe070af117d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:54.730069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc327a59-d8b6-4f58-a7ea-fbe070af117d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:54.730652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc327a59-d8b6-4f58-a7ea-fbe070af117d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:54.760996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc327a59-d8b6-4f58-a7ea-fbe070af117d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045533 Jul 28 20:04:54.761609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 445/913] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:55.367853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-338e9cf4-e66a-4033-a500-f63be338757e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:55.370029 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-338e9cf4-e66a-4033-a500-f63be338757e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:55.376483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-338e9cf4-e66a-4033-a500-f63be338757e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:55.377063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-338e9cf4-e66a-4033-a500-f63be338757e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:55.377835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-338e9cf4-e66a-4033-a500-f63be338757e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:55.378272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-338e9cf4-e66a-4033-a500-f63be338757e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:55.407458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-338e9cf4-e66a-4033-a500-f63be338757e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043519 Jul 28 20:04:55.408004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 469/914] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:55 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:55.435308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3e0fed2b-1c83-420d-8bf8-ea5525448997 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:55.435924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3e0fed2b-1c83-420d-8bf8-ea5525448997 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:55.442381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e0fed2b-1c83-420d-8bf8-ea5525448997 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:55.442821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e0fed2b-1c83-420d-8bf8-ea5525448997 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:55.443570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e0fed2b-1c83-420d-8bf8-ea5525448997 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:55.443986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e0fed2b-1c83-420d-8bf8-ea5525448997 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:55.582416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3e0fed2b-1c83-420d-8bf8-ea5525448997 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:55.589944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3e0fed2b-1c83-420d-8bf8-ea5525448997 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.158473 Jul 28 20:04:55.590495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 446/915] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:55.773903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4fc34ad5-c672-4e62-a7e0-75683b8f0563 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:55.775954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4fc34ad5-c672-4e62-a7e0-75683b8f0563 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:55.782242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fc34ad5-c672-4e62-a7e0-75683b8f0563 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:55.782689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fc34ad5-c672-4e62-a7e0-75683b8f0563 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:55.783582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fc34ad5-c672-4e62-a7e0-75683b8f0563 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:55.784018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fc34ad5-c672-4e62-a7e0-75683b8f0563 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:55.811947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4fc34ad5-c672-4e62-a7e0-75683b8f0563 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042019 Jul 28 20:04:55.812493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 470/916] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:56.420474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b76c3f37-d277-466e-b9e3-59a2aae7d608 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:56.422577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b76c3f37-d277-466e-b9e3-59a2aae7d608 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:56.429209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b76c3f37-d277-466e-b9e3-59a2aae7d608 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:56.429661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b76c3f37-d277-466e-b9e3-59a2aae7d608 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:56.430420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b76c3f37-d277-466e-b9e3-59a2aae7d608 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:56.430854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b76c3f37-d277-466e-b9e3-59a2aae7d608 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:56.459890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b76c3f37-d277-466e-b9e3-59a2aae7d608 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Jul 28 20:04:56.460563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 447/917] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:56.610378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d587440d-7aa0-415f-b837-a4939af6f6ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:56.610979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d587440d-7aa0-415f-b837-a4939af6f6ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:56.618627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d587440d-7aa0-415f-b837-a4939af6f6ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:56.619066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d587440d-7aa0-415f-b837-a4939af6f6ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:56.619817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d587440d-7aa0-415f-b837-a4939af6f6ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:56.620243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d587440d-7aa0-415f-b837-a4939af6f6ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:56.752254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d587440d-7aa0-415f-b837-a4939af6f6ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:56.759607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d587440d-7aa0-415f-b837-a4939af6f6ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153100 Jul 28 20:04:56.760156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 471/918] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:56 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:56.824702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b9ae1c87-9924-4e34-9502-d46e793c9c18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:56.827000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b9ae1c87-9924-4e34-9502-d46e793c9c18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:56.842461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9ae1c87-9924-4e34-9502-d46e793c9c18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:56.842901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9ae1c87-9924-4e34-9502-d46e793c9c18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:56.843725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9ae1c87-9924-4e34-9502-d46e793c9c18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:56.844218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9ae1c87-9924-4e34-9502-d46e793c9c18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:56.874739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b9ae1c87-9924-4e34-9502-d46e793c9c18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053928 Jul 28 20:04:56.875614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 448/919] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:56 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:57.471549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2f2eac53-ef13-44f4-bd42-f6c0d954f960 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:57.473659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2f2eac53-ef13-44f4-bd42-f6c0d954f960 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:57.479509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f2eac53-ef13-44f4-bd42-f6c0d954f960 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:57.479950 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f2eac53-ef13-44f4-bd42-f6c0d954f960 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:57.480735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f2eac53-ef13-44f4-bd42-f6c0d954f960 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:57.481168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f2eac53-ef13-44f4-bd42-f6c0d954f960 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:57.510071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2f2eac53-ef13-44f4-bd42-f6c0d954f960 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042663 Jul 28 20:04:57.510602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 472/920] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:57 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:57.780623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a680a2b9-b259-4557-a1b1-d6fcfb1dc210 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:57.781336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a680a2b9-b259-4557-a1b1-d6fcfb1dc210 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:57.788234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a680a2b9-b259-4557-a1b1-d6fcfb1dc210 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:57.788724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a680a2b9-b259-4557-a1b1-d6fcfb1dc210 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:57.789490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a680a2b9-b259-4557-a1b1-d6fcfb1dc210 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:57.789926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a680a2b9-b259-4557-a1b1-d6fcfb1dc210 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:57.808712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:57.887290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cbf6723d-c93a-4a0b-af8f-d2be2aea8ca0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:57.889471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cbf6723d-c93a-4a0b-af8f-d2be2aea8ca0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:57.895888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbf6723d-c93a-4a0b-af8f-d2be2aea8ca0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:57.896366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbf6723d-c93a-4a0b-af8f-d2be2aea8ca0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:57.897194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbf6723d-c93a-4a0b-af8f-d2be2aea8ca0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:57.897630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbf6723d-c93a-4a0b-af8f-d2be2aea8ca0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:57.915140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:04:57.928402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a680a2b9-b259-4557-a1b1-d6fcfb1dc210 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:57.929826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cbf6723d-c93a-4a0b-af8f-d2be2aea8ca0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046365 Jul 28 20:04:57.930406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 473/921] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:57.935890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a680a2b9-b259-4557-a1b1-d6fcfb1dc210 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.159151 Jul 28 20:04:57.936430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 449/922] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:04:58.523623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-112a45b2-8f7a-40b4-8ad1-9b2327f02d35 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:58.525732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-112a45b2-8f7a-40b4-8ad1-9b2327f02d35 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:58.531993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-112a45b2-8f7a-40b4-8ad1-9b2327f02d35 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:58.532445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-112a45b2-8f7a-40b4-8ad1-9b2327f02d35 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:58.533889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-112a45b2-8f7a-40b4-8ad1-9b2327f02d35 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:58.534468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-112a45b2-8f7a-40b4-8ad1-9b2327f02d35 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:58.562750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-112a45b2-8f7a-40b4-8ad1-9b2327f02d35 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043184 Jul 28 20:04:58.563285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 474/923] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:58.941711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b2495d47-3078-4a7a-8dc1-e9b9ef33e9c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:58.943841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b2495d47-3078-4a7a-8dc1-e9b9ef33e9c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:58.952229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2495d47-3078-4a7a-8dc1-e9b9ef33e9c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:58.952710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2495d47-3078-4a7a-8dc1-e9b9ef33e9c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:58.953567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2495d47-3078-4a7a-8dc1-e9b9ef33e9c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:58.954013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2495d47-3078-4a7a-8dc1-e9b9ef33e9c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:58.956991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1216d7ed-81a4-4e69-bcae-1de2c898a41e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:58.957628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1216d7ed-81a4-4e69-bcae-1de2c898a41e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:58.963861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1216d7ed-81a4-4e69-bcae-1de2c898a41e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:58.964286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1216d7ed-81a4-4e69-bcae-1de2c898a41e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:58.965070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1216d7ed-81a4-4e69-bcae-1de2c898a41e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:58.965497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1216d7ed-81a4-4e69-bcae-1de2c898a41e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:58.984240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b2495d47-3078-4a7a-8dc1-e9b9ef33e9c2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046646 Jul 28 20:04:58.984827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 450/924] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:04:59.094255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1216d7ed-81a4-4e69-bcae-1de2c898a41e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:04:59.101949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1216d7ed-81a4-4e69-bcae-1de2c898a41e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149025 Jul 28 20:04:59.102499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 475/925] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:04:58 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:04:59.575697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ba16a774-63ea-46e9-94d7-608f71dc9551 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:04:59.577900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ba16a774-63ea-46e9-94d7-608f71dc9551 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:04:59.583939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba16a774-63ea-46e9-94d7-608f71dc9551 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:59.584386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba16a774-63ea-46e9-94d7-608f71dc9551 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:59.585183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba16a774-63ea-46e9-94d7-608f71dc9551 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:04:59.585614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba16a774-63ea-46e9-94d7-608f71dc9551 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:04:59.615244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ba16a774-63ea-46e9-94d7-608f71dc9551 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 Jul 28 20:04:59.615787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 451/926] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:59 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:04:59.998149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-984d2936-3b20-470b-be12-4ab98be8ca8d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:00.000326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-984d2936-3b20-470b-be12-4ab98be8ca8d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:00.007783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-984d2936-3b20-470b-be12-4ab98be8ca8d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:00.008225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-984d2936-3b20-470b-be12-4ab98be8ca8d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:00.009011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-984d2936-3b20-470b-be12-4ab98be8ca8d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:00.009438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-984d2936-3b20-470b-be12-4ab98be8ca8d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:00.039959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-984d2936-3b20-470b-be12-4ab98be8ca8d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046647 Jul 28 20:05:00.040497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 476/927] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:04:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:00.123387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-83994d18-cc72-4fd6-ad97-b66e7ccda192 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:00.124002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-83994d18-cc72-4fd6-ad97-b66e7ccda192 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:00.131210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83994d18-cc72-4fd6-ad97-b66e7ccda192 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:00.131656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83994d18-cc72-4fd6-ad97-b66e7ccda192 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:00.132410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83994d18-cc72-4fd6-ad97-b66e7ccda192 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:00.132879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83994d18-cc72-4fd6-ad97-b66e7ccda192 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:00.261476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-83994d18-cc72-4fd6-ad97-b66e7ccda192 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:00.270585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-83994d18-cc72-4fd6-ad97-b66e7ccda192 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151055 Jul 28 20:05:00.271208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 452/928] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:00 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:00.628269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bcba65eb-ece9-463c-973f-60caa3e6fc36 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:00.630412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bcba65eb-ece9-463c-973f-60caa3e6fc36 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:00.636343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcba65eb-ece9-463c-973f-60caa3e6fc36 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:00.636818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcba65eb-ece9-463c-973f-60caa3e6fc36 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:00.637576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcba65eb-ece9-463c-973f-60caa3e6fc36 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:00.638004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcba65eb-ece9-463c-973f-60caa3e6fc36 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:00.666028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bcba65eb-ece9-463c-973f-60caa3e6fc36 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042380 Jul 28 20:05:00.666562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 477/929] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:01.051390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0b059c25-baa0-463b-ab84-575a1779b0a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:01.054188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0b059c25-baa0-463b-ab84-575a1779b0a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:01.061024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b059c25-baa0-463b-ab84-575a1779b0a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:01.061463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b059c25-baa0-463b-ab84-575a1779b0a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:01.062212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b059c25-baa0-463b-ab84-575a1779b0a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:01.062639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b059c25-baa0-463b-ab84-575a1779b0a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:01.090946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0b059c25-baa0-463b-ab84-575a1779b0a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043540 Jul 28 20:05:01.091686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 453/930] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:01.292353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-08693612-7354-4825-8b39-691f4277d0c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:01.293630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-08693612-7354-4825-8b39-691f4277d0c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:01.299824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-08693612-7354-4825-8b39-691f4277d0c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:01.300274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-08693612-7354-4825-8b39-691f4277d0c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:01.301063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-08693612-7354-4825-8b39-691f4277d0c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:01.301545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-08693612-7354-4825-8b39-691f4277d0c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:01.434341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-08693612-7354-4825-8b39-691f4277d0c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:01.441789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-08693612-7354-4825-8b39-691f4277d0c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153279 Jul 28 20:05:01.442349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 478/931] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:01.679558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a59134f9-cd52-4d34-bcc2-b9b38da1e0e5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:01.681716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a59134f9-cd52-4d34-bcc2-b9b38da1e0e5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:01.688196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a59134f9-cd52-4d34-bcc2-b9b38da1e0e5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:01.688678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a59134f9-cd52-4d34-bcc2-b9b38da1e0e5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:01.689591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a59134f9-cd52-4d34-bcc2-b9b38da1e0e5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:01.690027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a59134f9-cd52-4d34-bcc2-b9b38da1e0e5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:01.718052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a59134f9-cd52-4d34-bcc2-b9b38da1e0e5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042513 Jul 28 20:05:01.718592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 454/932] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:02.103863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e4865c30-5b70-482f-a59f-ae4bac22f6a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:02.106041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e4865c30-5b70-482f-a59f-ae4bac22f6a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:02.112138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e4865c30-5b70-482f-a59f-ae4bac22f6a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:02.112615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e4865c30-5b70-482f-a59f-ae4bac22f6a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:02.113376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e4865c30-5b70-482f-a59f-ae4bac22f6a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:02.113808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e4865c30-5b70-482f-a59f-ae4bac22f6a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:02.141364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e4865c30-5b70-482f-a59f-ae4bac22f6a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041512 Jul 28 20:05:02.141897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 479/933] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:02 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:02.463971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5b1b501c-d9d8-4da5-bb2c-bcc30574dd44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:02.464492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5b1b501c-d9d8-4da5-bb2c-bcc30574dd44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:02.470731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5b1b501c-d9d8-4da5-bb2c-bcc30574dd44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:02.471283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5b1b501c-d9d8-4da5-bb2c-bcc30574dd44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:02.472036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5b1b501c-d9d8-4da5-bb2c-bcc30574dd44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:02.472465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5b1b501c-d9d8-4da5-bb2c-bcc30574dd44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:02.599486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5b1b501c-d9d8-4da5-bb2c-bcc30574dd44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:02.606933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5b1b501c-d9d8-4da5-bb2c-bcc30574dd44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.146930 Jul 28 20:05:02.607480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 455/934] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:02.731506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1a679236-4945-4af4-bd8b-55a12dcde137 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:02.733576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1a679236-4945-4af4-bd8b-55a12dcde137 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:02.740606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a679236-4945-4af4-bd8b-55a12dcde137 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:02.741047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a679236-4945-4af4-bd8b-55a12dcde137 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:02.741794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a679236-4945-4af4-bd8b-55a12dcde137 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:02.742218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a679236-4945-4af4-bd8b-55a12dcde137 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:02.771297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1a679236-4945-4af4-bd8b-55a12dcde137 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Jul 28 20:05:02.771829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 480/935] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:02 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:03.154290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d526b492-57a3-4e4b-8705-10b260131f0c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:03.156701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d526b492-57a3-4e4b-8705-10b260131f0c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:03.163369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d526b492-57a3-4e4b-8705-10b260131f0c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:03.163806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d526b492-57a3-4e4b-8705-10b260131f0c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:03.164591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d526b492-57a3-4e4b-8705-10b260131f0c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:03.165027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d526b492-57a3-4e4b-8705-10b260131f0c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:03.195017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d526b492-57a3-4e4b-8705-10b260131f0c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Jul 28 20:05:03.195560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 456/936] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:03 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:03.627170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dd0dd5c7-8b15-423c-9982-7a413484b56a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:03.627770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dd0dd5c7-8b15-423c-9982-7a413484b56a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:03.633753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd0dd5c7-8b15-423c-9982-7a413484b56a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:03.634194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd0dd5c7-8b15-423c-9982-7a413484b56a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:03.634932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd0dd5c7-8b15-423c-9982-7a413484b56a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:03.635356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd0dd5c7-8b15-423c-9982-7a413484b56a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:03.766535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd0dd5c7-8b15-423c-9982-7a413484b56a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:03.775044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dd0dd5c7-8b15-423c-9982-7a413484b56a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151700 Jul 28 20:05:03.775601 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 481/937] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:03 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:03.784465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6a368385-82a7-43fe-b895-b51fee5e2c6d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:03.786675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6a368385-82a7-43fe-b895-b51fee5e2c6d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:03.793139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a368385-82a7-43fe-b895-b51fee5e2c6d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:03.793584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a368385-82a7-43fe-b895-b51fee5e2c6d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:03.794341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a368385-82a7-43fe-b895-b51fee5e2c6d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:03.794772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a368385-82a7-43fe-b895-b51fee5e2c6d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:03.823920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6a368385-82a7-43fe-b895-b51fee5e2c6d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Jul 28 20:05:03.824471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 457/938] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:03 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:04.207375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-05559a67-63e0-4536-9268-a18a3ef155e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:04.209702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-05559a67-63e0-4536-9268-a18a3ef155e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:04.215695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05559a67-63e0-4536-9268-a18a3ef155e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:04.216139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05559a67-63e0-4536-9268-a18a3ef155e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:04.216936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05559a67-63e0-4536-9268-a18a3ef155e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:04.217373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05559a67-63e0-4536-9268-a18a3ef155e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:04.250993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-05559a67-63e0-4536-9268-a18a3ef155e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048034 Jul 28 20:05:04.252702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 482/939] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:04.797179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6daa647d-b002-4d09-8b21-11ad41cf500b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:04.797788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6daa647d-b002-4d09-8b21-11ad41cf500b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:04.805513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6daa647d-b002-4d09-8b21-11ad41cf500b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:04.805962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6daa647d-b002-4d09-8b21-11ad41cf500b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:04.806716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6daa647d-b002-4d09-8b21-11ad41cf500b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:04.807143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6daa647d-b002-4d09-8b21-11ad41cf500b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:04.835500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b50b990f-6777-499c-9949-b4b684a22173 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:04.837759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b50b990f-6777-499c-9949-b4b684a22173 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:04.844303 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b50b990f-6777-499c-9949-b4b684a22173 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:04.844853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b50b990f-6777-499c-9949-b4b684a22173 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:04.846318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b50b990f-6777-499c-9949-b4b684a22173 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:04.846748 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b50b990f-6777-499c-9949-b4b684a22173 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:04.875991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b50b990f-6777-499c-9949-b4b684a22173 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Jul 28 20:05:04.876559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 483/940] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:04 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:04.938320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6daa647d-b002-4d09-8b21-11ad41cf500b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:04.945908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6daa647d-b002-4d09-8b21-11ad41cf500b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152638 Jul 28 20:05:04.946465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 458/941] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:04 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:05.264432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7451f147-2e67-497a-8fbd-6b186bb012eb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:05.266568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7451f147-2e67-497a-8fbd-6b186bb012eb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:05.273043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7451f147-2e67-497a-8fbd-6b186bb012eb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:05.273488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7451f147-2e67-497a-8fbd-6b186bb012eb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:05.274236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7451f147-2e67-497a-8fbd-6b186bb012eb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:05.274663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7451f147-2e67-497a-8fbd-6b186bb012eb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:05.303687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7451f147-2e67-497a-8fbd-6b186bb012eb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043121 Jul 28 20:05:05.304221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 484/942] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:05 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:05.888409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d7fd0aa1-b6eb-44d9-bca5-d2691703e568 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:05.890575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d7fd0aa1-b6eb-44d9-bca5-d2691703e568 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:05.897107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7fd0aa1-b6eb-44d9-bca5-d2691703e568 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:05.897554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7fd0aa1-b6eb-44d9-bca5-d2691703e568 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:05.898308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7fd0aa1-b6eb-44d9-bca5-d2691703e568 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:05.898741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7fd0aa1-b6eb-44d9-bca5-d2691703e568 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:05.928428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d7fd0aa1-b6eb-44d9-bca5-d2691703e568 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Jul 28 20:05:05.929024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 459/943] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:05 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:05.968024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5ac75910-0c53-478a-9001-e357c1af6b41 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:05.968686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5ac75910-0c53-478a-9001-e357c1af6b41 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:05.975565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ac75910-0c53-478a-9001-e357c1af6b41 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:05.976009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ac75910-0c53-478a-9001-e357c1af6b41 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:05.976796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ac75910-0c53-478a-9001-e357c1af6b41 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:05.977227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ac75910-0c53-478a-9001-e357c1af6b41 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:06.106834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5ac75910-0c53-478a-9001-e357c1af6b41 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:06.114967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5ac75910-0c53-478a-9001-e357c1af6b41 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.150795 Jul 28 20:05:06.115512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 485/944] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:05 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:06.315531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-26951d1c-defd-451a-9852-51cf99eca497 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:06.317616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-26951d1c-defd-451a-9852-51cf99eca497 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:06.323548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26951d1c-defd-451a-9852-51cf99eca497 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:06.323990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26951d1c-defd-451a-9852-51cf99eca497 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:06.324762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26951d1c-defd-451a-9852-51cf99eca497 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:06.325190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26951d1c-defd-451a-9852-51cf99eca497 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:06.353359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-26951d1c-defd-451a-9852-51cf99eca497 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041927 Jul 28 20:05:06.353895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 460/945] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:06.941649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0dc95f49-d8a3-4985-a378-6a6aafd2d752 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:06.943796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0dc95f49-d8a3-4985-a378-6a6aafd2d752 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:06.950079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dc95f49-d8a3-4985-a378-6a6aafd2d752 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:06.950517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dc95f49-d8a3-4985-a378-6a6aafd2d752 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:06.951264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dc95f49-d8a3-4985-a378-6a6aafd2d752 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:06.951690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dc95f49-d8a3-4985-a378-6a6aafd2d752 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:06.980942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0dc95f49-d8a3-4985-a378-6a6aafd2d752 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Jul 28 20:05:06.981600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 486/946] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:06 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:07.135732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5cf098ee-b3dd-4a45-9d4c-cf0417488d7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:07.136270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5cf098ee-b3dd-4a45-9d4c-cf0417488d7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:07.143334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf098ee-b3dd-4a45-9d4c-cf0417488d7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:07.143774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf098ee-b3dd-4a45-9d4c-cf0417488d7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:07.144527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf098ee-b3dd-4a45-9d4c-cf0417488d7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:07.144980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf098ee-b3dd-4a45-9d4c-cf0417488d7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:07.279174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5cf098ee-b3dd-4a45-9d4c-cf0417488d7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:07.287047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5cf098ee-b3dd-4a45-9d4c-cf0417488d7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155231 Jul 28 20:05:07.287602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 461/947] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:07 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:07.365662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1b0a6b52-4f1a-4c37-ad21-1967905f2e1c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:07.367779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1b0a6b52-4f1a-4c37-ad21-1967905f2e1c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:07.373660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b0a6b52-4f1a-4c37-ad21-1967905f2e1c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:07.374104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b0a6b52-4f1a-4c37-ad21-1967905f2e1c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:07.374852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b0a6b52-4f1a-4c37-ad21-1967905f2e1c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:07.375281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b0a6b52-4f1a-4c37-ad21-1967905f2e1c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:07.404058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1b0a6b52-4f1a-4c37-ad21-1967905f2e1c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 Jul 28 20:05:07.404519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 487/948] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:07.993093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6a3eb3f0-26a7-43bc-a294-82b878b86027 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:07.995284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6a3eb3f0-26a7-43bc-a294-82b878b86027 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:08.002644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a3eb3f0-26a7-43bc-a294-82b878b86027 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:08.003101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a3eb3f0-26a7-43bc-a294-82b878b86027 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:08.003855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a3eb3f0-26a7-43bc-a294-82b878b86027 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:08.004288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6a3eb3f0-26a7-43bc-a294-82b878b86027 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:08.033398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6a3eb3f0-26a7-43bc-a294-82b878b86027 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043687 Jul 28 20:05:08.033875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 462/949] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:07 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:08.308728 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c34338b0-1132-4c7f-8aa8-95b46e6233c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:08.309241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c34338b0-1132-4c7f-8aa8-95b46e6233c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:08.316904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c34338b0-1132-4c7f-8aa8-95b46e6233c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:08.317352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c34338b0-1132-4c7f-8aa8-95b46e6233c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:08.318108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c34338b0-1132-4c7f-8aa8-95b46e6233c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:08.318537 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c34338b0-1132-4c7f-8aa8-95b46e6233c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:08.417202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cec5f6d1-eeef-4902-88a3-3b858b07b86f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:08.419350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cec5f6d1-eeef-4902-88a3-3b858b07b86f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:08.427272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cec5f6d1-eeef-4902-88a3-3b858b07b86f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:08.427720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cec5f6d1-eeef-4902-88a3-3b858b07b86f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:08.428483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cec5f6d1-eeef-4902-88a3-3b858b07b86f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:08.428934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cec5f6d1-eeef-4902-88a3-3b858b07b86f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:08.457007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c34338b0-1132-4c7f-8aa8-95b46e6233c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:08.459293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cec5f6d1-eeef-4902-88a3-3b858b07b86f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Jul 28 20:05:08.459867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 463/950] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:08.464605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c34338b0-1132-4c7f-8aa8-95b46e6233c9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.159785 Jul 28 20:05:08.465140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 488/951] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:08 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:09.045573 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c9531c93-e707-4ffe-9f20-ffacfa49c5d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:09.047744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c9531c93-e707-4ffe-9f20-ffacfa49c5d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:09.054292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9531c93-e707-4ffe-9f20-ffacfa49c5d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:09.054731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9531c93-e707-4ffe-9f20-ffacfa49c5d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:09.055482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9531c93-e707-4ffe-9f20-ffacfa49c5d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:09.055913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9531c93-e707-4ffe-9f20-ffacfa49c5d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:09.086255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c9531c93-e707-4ffe-9f20-ffacfa49c5d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044602 Jul 28 20:05:09.086794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 464/952] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:09 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:09.471550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ca50f2af-cdbe-4497-adfd-e4d37002ee3a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:09.473738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ca50f2af-cdbe-4497-adfd-e4d37002ee3a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:09.480152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ca50f2af-cdbe-4497-adfd-e4d37002ee3a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:09.480629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ca50f2af-cdbe-4497-adfd-e4d37002ee3a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:09.481396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ca50f2af-cdbe-4497-adfd-e4d37002ee3a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:09.481825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ca50f2af-cdbe-4497-adfd-e4d37002ee3a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:09.486973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fd03f3f2-c31d-4641-96df-a55afa236e8e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:09.487591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fd03f3f2-c31d-4641-96df-a55afa236e8e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:09.494359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd03f3f2-c31d-4641-96df-a55afa236e8e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:09.494810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd03f3f2-c31d-4641-96df-a55afa236e8e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:09.495570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd03f3f2-c31d-4641-96df-a55afa236e8e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:09.496002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd03f3f2-c31d-4641-96df-a55afa236e8e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:09.511650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ca50f2af-cdbe-4497-adfd-e4d37002ee3a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Jul 28 20:05:09.512198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 489/953] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:09 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:09.630207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fd03f3f2-c31d-4641-96df-a55afa236e8e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:09.637619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fd03f3f2-c31d-4641-96df-a55afa236e8e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155096 Jul 28 20:05:09.638169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 465/954] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:09 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:05:10.099766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-37b36b09-47a0-4fcf-9d61-54acc4545da9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:10.101938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-37b36b09-47a0-4fcf-9d61-54acc4545da9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:10.107891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37b36b09-47a0-4fcf-9d61-54acc4545da9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:10.108339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37b36b09-47a0-4fcf-9d61-54acc4545da9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:10.109134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37b36b09-47a0-4fcf-9d61-54acc4545da9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:10.109566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37b36b09-47a0-4fcf-9d61-54acc4545da9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:10.113984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:10.138583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-37b36b09-47a0-4fcf-9d61-54acc4545da9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043555 Jul 28 20:05:10.139205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 490/955] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:10 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:10.524400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-40d96043-081c-4b13-be4b-eb1c1030b2c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:10.526482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-40d96043-081c-4b13-be4b-eb1c1030b2c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:10.533879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40d96043-081c-4b13-be4b-eb1c1030b2c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:10.534320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40d96043-081c-4b13-be4b-eb1c1030b2c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:10.535064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40d96043-081c-4b13-be4b-eb1c1030b2c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:10.535484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40d96043-081c-4b13-be4b-eb1c1030b2c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:10.539113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:10.564082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-40d96043-081c-4b13-be4b-eb1c1030b2c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043145 Jul 28 20:05:10.564989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 466/956] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:10 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:10.659444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cf63bd32-eb34-4d84-9038-2beec202ea02 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:10.660059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cf63bd32-eb34-4d84-9038-2beec202ea02 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:10.666750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf63bd32-eb34-4d84-9038-2beec202ea02 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:10.667191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf63bd32-eb34-4d84-9038-2beec202ea02 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:10.667948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf63bd32-eb34-4d84-9038-2beec202ea02 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:10.668377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf63bd32-eb34-4d84-9038-2beec202ea02 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:10.800948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cf63bd32-eb34-4d84-9038-2beec202ea02 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:10.808386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cf63bd32-eb34-4d84-9038-2beec202ea02 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153214 Jul 28 20:05:10.808972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 491/957] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:10 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:11.150168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0ce2e991-c6a8-4276-9cf2-9d6975d9c5b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:11.152319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0ce2e991-c6a8-4276-9cf2-9d6975d9c5b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:11.159268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ce2e991-c6a8-4276-9cf2-9d6975d9c5b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:11.159722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ce2e991-c6a8-4276-9cf2-9d6975d9c5b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:11.160479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ce2e991-c6a8-4276-9cf2-9d6975d9c5b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:11.160938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ce2e991-c6a8-4276-9cf2-9d6975d9c5b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:11.191815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0ce2e991-c6a8-4276-9cf2-9d6975d9c5b3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Jul 28 20:05:11.192353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 467/958] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:11 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:11.576893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a0c0daf3-0412-4e3c-8780-b1558ccd9f77 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:11.579074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a0c0daf3-0412-4e3c-8780-b1558ccd9f77 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:11.585545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0c0daf3-0412-4e3c-8780-b1558ccd9f77 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:11.585993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0c0daf3-0412-4e3c-8780-b1558ccd9f77 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:11.586757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0c0daf3-0412-4e3c-8780-b1558ccd9f77 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:11.587197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0c0daf3-0412-4e3c-8780-b1558ccd9f77 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:11.616058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a0c0daf3-0412-4e3c-8780-b1558ccd9f77 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043208 Jul 28 20:05:11.616618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 492/959] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:11.830781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7fde42aa-7ab5-45fe-8bf0-85900d3e242b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:11.831350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7fde42aa-7ab5-45fe-8bf0-85900d3e242b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:11.837817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7fde42aa-7ab5-45fe-8bf0-85900d3e242b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:11.838273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7fde42aa-7ab5-45fe-8bf0-85900d3e242b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:11.839021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7fde42aa-7ab5-45fe-8bf0-85900d3e242b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:11.839451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7fde42aa-7ab5-45fe-8bf0-85900d3e242b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:11.975681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7fde42aa-7ab5-45fe-8bf0-85900d3e242b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:11.983100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7fde42aa-7ab5-45fe-8bf0-85900d3e242b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.157171 Jul 28 20:05:11.983650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 468/960] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:11 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:12.203335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-70836021-326d-4890-a103-a51ad1e06d48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:12.206194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-70836021-326d-4890-a103-a51ad1e06d48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:12.212772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-70836021-326d-4890-a103-a51ad1e06d48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:12.213221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-70836021-326d-4890-a103-a51ad1e06d48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:12.213978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-70836021-326d-4890-a103-a51ad1e06d48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:12.214410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-70836021-326d-4890-a103-a51ad1e06d48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:12.242643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-70836021-326d-4890-a103-a51ad1e06d48 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Jul 28 20:05:12.243201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 493/961] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:12 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:12.628745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aba95847-345a-4b6b-8da2-41e09f52ea38 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:12.630894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aba95847-345a-4b6b-8da2-41e09f52ea38 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:12.636874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aba95847-345a-4b6b-8da2-41e09f52ea38 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:12.638232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aba95847-345a-4b6b-8da2-41e09f52ea38 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:12.638987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aba95847-345a-4b6b-8da2-41e09f52ea38 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:12.639413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aba95847-345a-4b6b-8da2-41e09f52ea38 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:12.668265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aba95847-345a-4b6b-8da2-41e09f52ea38 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Jul 28 20:05:12.668896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 469/962] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:13.005277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-63a6d450-4c01-43cc-9986-c6bff9135488 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:13.005824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-63a6d450-4c01-43cc-9986-c6bff9135488 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:13.011850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63a6d450-4c01-43cc-9986-c6bff9135488 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:13.012293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63a6d450-4c01-43cc-9986-c6bff9135488 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:13.013068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63a6d450-4c01-43cc-9986-c6bff9135488 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:13.013499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63a6d450-4c01-43cc-9986-c6bff9135488 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:13.144684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-63a6d450-4c01-43cc-9986-c6bff9135488 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:13.152190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-63a6d450-4c01-43cc-9986-c6bff9135488 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151548 Jul 28 20:05:13.152777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 494/963] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:12 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:13.304714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-08a529aa-3517-4327-b6e4-c15860ff1c3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:13.306951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-08a529aa-3517-4327-b6e4-c15860ff1c3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:13.312939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08a529aa-3517-4327-b6e4-c15860ff1c3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:13.313385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08a529aa-3517-4327-b6e4-c15860ff1c3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:13.314932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08a529aa-3517-4327-b6e4-c15860ff1c3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:13.315363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08a529aa-3517-4327-b6e4-c15860ff1c3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:13.344120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-08a529aa-3517-4327-b6e4-c15860ff1c3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093519 Jul 28 20:05:13.344797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 470/964] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:13 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:13.680829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7b0b41a1-3997-4678-91b3-982c93c4dad4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:13.682996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7b0b41a1-3997-4678-91b3-982c93c4dad4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:13.689481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b0b41a1-3997-4678-91b3-982c93c4dad4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:13.689920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b0b41a1-3997-4678-91b3-982c93c4dad4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:13.690675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b0b41a1-3997-4678-91b3-982c93c4dad4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:13.691096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b0b41a1-3997-4678-91b3-982c93c4dad4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:13.718402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7b0b41a1-3997-4678-91b3-982c93c4dad4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041645 Jul 28 20:05:13.718929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 495/965] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:13 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:14.174299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eae7028b-ccd2-46b1-8175-73b5112928cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:14.174914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eae7028b-ccd2-46b1-8175-73b5112928cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:14.180933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eae7028b-ccd2-46b1-8175-73b5112928cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:14.181379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eae7028b-ccd2-46b1-8175-73b5112928cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:14.182131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eae7028b-ccd2-46b1-8175-73b5112928cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:14.182556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eae7028b-ccd2-46b1-8175-73b5112928cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:14.309561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eae7028b-ccd2-46b1-8175-73b5112928cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:14.317545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eae7028b-ccd2-46b1-8175-73b5112928cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.147733 Jul 28 20:05:14.318100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 471/966] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:14.355652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b44e869c-98fa-4685-932d-7c4fd8244e8e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:14.357871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b44e869c-98fa-4685-932d-7c4fd8244e8e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:14.364744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b44e869c-98fa-4685-932d-7c4fd8244e8e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:14.365186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b44e869c-98fa-4685-932d-7c4fd8244e8e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:14.365933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b44e869c-98fa-4685-932d-7c4fd8244e8e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:14.366364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b44e869c-98fa-4685-932d-7c4fd8244e8e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:14.394305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b44e869c-98fa-4685-932d-7c4fd8244e8e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042627 Jul 28 20:05:14.394842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 496/967] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:14 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:14.730931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-76b8dd35-3a71-4389-8850-95f5b8741635 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:14.733259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-76b8dd35-3a71-4389-8850-95f5b8741635 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:14.739613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76b8dd35-3a71-4389-8850-95f5b8741635 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:14.740061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76b8dd35-3a71-4389-8850-95f5b8741635 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:14.740855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76b8dd35-3a71-4389-8850-95f5b8741635 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:14.741286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76b8dd35-3a71-4389-8850-95f5b8741635 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:14.770099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-76b8dd35-3a71-4389-8850-95f5b8741635 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Jul 28 20:05:14.770718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 472/968] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:15.338528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9160be0a-e52c-49c7-89f1-92be306ce7c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:15.339145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9160be0a-e52c-49c7-89f1-92be306ce7c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:15.345579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9160be0a-e52c-49c7-89f1-92be306ce7c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:15.346021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9160be0a-e52c-49c7-89f1-92be306ce7c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:15.346775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9160be0a-e52c-49c7-89f1-92be306ce7c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:15.347221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9160be0a-e52c-49c7-89f1-92be306ce7c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:15.406865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c5bf34ef-380e-4600-a039-3e61ee91d3ba tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:15.409119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c5bf34ef-380e-4600-a039-3e61ee91d3ba tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:15.415577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5bf34ef-380e-4600-a039-3e61ee91d3ba tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:15.415956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5bf34ef-380e-4600-a039-3e61ee91d3ba tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:15.416748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5bf34ef-380e-4600-a039-3e61ee91d3ba tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:15.417180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5bf34ef-380e-4600-a039-3e61ee91d3ba tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:15.448379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c5bf34ef-380e-4600-a039-3e61ee91d3ba tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Jul 28 20:05:15.448967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 473/969] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:15 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:15.483105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9160be0a-e52c-49c7-89f1-92be306ce7c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:15.491066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9160be0a-e52c-49c7-89f1-92be306ce7c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.156495 Jul 28 20:05:15.491619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 497/970] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:15 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:15.783393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d00858b4-93ca-4a9b-97dd-3d8596e86c2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:15.785476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d00858b4-93ca-4a9b-97dd-3d8596e86c2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:15.791459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d00858b4-93ca-4a9b-97dd-3d8596e86c2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:15.791910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d00858b4-93ca-4a9b-97dd-3d8596e86c2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:15.792729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d00858b4-93ca-4a9b-97dd-3d8596e86c2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:15.793160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d00858b4-93ca-4a9b-97dd-3d8596e86c2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:15.823192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d00858b4-93ca-4a9b-97dd-3d8596e86c2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Jul 28 20:05:15.823744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 474/971] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:16.460139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3c8f3c7c-1cf1-4603-ac2d-f5bf69db3bc6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:16.462208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3c8f3c7c-1cf1-4603-ac2d-f5bf69db3bc6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:16.468685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8f3c7c-1cf1-4603-ac2d-f5bf69db3bc6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:16.469130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8f3c7c-1cf1-4603-ac2d-f5bf69db3bc6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:16.470636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8f3c7c-1cf1-4603-ac2d-f5bf69db3bc6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:16.471059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8f3c7c-1cf1-4603-ac2d-f5bf69db3bc6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:16.498966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3c8f3c7c-1cf1-4603-ac2d-f5bf69db3bc6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Jul 28 20:05:16.499494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 498/972] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:16 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:16.512902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9e4724f6-390d-4019-b933-21a8b864ac0c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:16.513571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9e4724f6-390d-4019-b933-21a8b864ac0c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:16.521343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9e4724f6-390d-4019-b933-21a8b864ac0c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:16.521792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9e4724f6-390d-4019-b933-21a8b864ac0c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:16.522585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9e4724f6-390d-4019-b933-21a8b864ac0c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:16.523021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9e4724f6-390d-4019-b933-21a8b864ac0c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:16.655052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9e4724f6-390d-4019-b933-21a8b864ac0c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:16.662751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9e4724f6-390d-4019-b933-21a8b864ac0c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153789 Jul 28 20:05:16.663306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 475/973] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:16 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:16.836038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6e612f82-5162-4a8f-8ec8-3b2b46d223d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:16.838186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6e612f82-5162-4a8f-8ec8-3b2b46d223d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:16.844085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e612f82-5162-4a8f-8ec8-3b2b46d223d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:16.844787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e612f82-5162-4a8f-8ec8-3b2b46d223d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:16.845554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e612f82-5162-4a8f-8ec8-3b2b46d223d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:16.845987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e612f82-5162-4a8f-8ec8-3b2b46d223d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:16.873588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6e612f82-5162-4a8f-8ec8-3b2b46d223d2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041461 Jul 28 20:05:16.874121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 499/974] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:16 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:17.511464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-41bc90ef-4259-4512-a21f-c10ebc2eddc1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:17.513555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-41bc90ef-4259-4512-a21f-c10ebc2eddc1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:17.519669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-41bc90ef-4259-4512-a21f-c10ebc2eddc1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:17.520103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-41bc90ef-4259-4512-a21f-c10ebc2eddc1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:17.520884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-41bc90ef-4259-4512-a21f-c10ebc2eddc1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:17.521305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-41bc90ef-4259-4512-a21f-c10ebc2eddc1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:17.550520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-41bc90ef-4259-4512-a21f-c10ebc2eddc1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043112 Jul 28 20:05:17.551086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 476/975] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:17 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:17.683760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-82725845-d996-47f5-9c79-bf18348f8a74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:17.684363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-82725845-d996-47f5-9c79-bf18348f8a74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:17.690979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82725845-d996-47f5-9c79-bf18348f8a74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:17.691417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82725845-d996-47f5-9c79-bf18348f8a74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:17.692160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82725845-d996-47f5-9c79-bf18348f8a74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:17.692608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82725845-d996-47f5-9c79-bf18348f8a74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:17.827304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-82725845-d996-47f5-9c79-bf18348f8a74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:17.835839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-82725845-d996-47f5-9c79-bf18348f8a74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155932 Jul 28 20:05:17.836390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 500/976] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:17 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:17.886454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0e30d9a8-2b5a-4800-8c6e-a465dc4b6b14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:17.888694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0e30d9a8-2b5a-4800-8c6e-a465dc4b6b14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:17.896595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e30d9a8-2b5a-4800-8c6e-a465dc4b6b14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:17.897035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e30d9a8-2b5a-4800-8c6e-a465dc4b6b14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:17.898303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e30d9a8-2b5a-4800-8c6e-a465dc4b6b14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:17.898736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e30d9a8-2b5a-4800-8c6e-a465dc4b6b14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:17.928301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0e30d9a8-2b5a-4800-8c6e-a465dc4b6b14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045796 Jul 28 20:05:17.928875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 477/977] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:18.562968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ea164268-3ce6-480d-b355-d00ded83bf83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:18.565700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ea164268-3ce6-480d-b355-d00ded83bf83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:18.579310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea164268-3ce6-480d-b355-d00ded83bf83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:18.579864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea164268-3ce6-480d-b355-d00ded83bf83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:18.580810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea164268-3ce6-480d-b355-d00ded83bf83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:18.581298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea164268-3ce6-480d-b355-d00ded83bf83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:18.610910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ea164268-3ce6-480d-b355-d00ded83bf83 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051420 Jul 28 20:05:18.611557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 501/978] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:18 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:18.857314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d58aaa38-d7d3-467c-ab09-05c8401e6222 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:18.857957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d58aaa38-d7d3-467c-ab09-05c8401e6222 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:18.865090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d58aaa38-d7d3-467c-ab09-05c8401e6222 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:18.865539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d58aaa38-d7d3-467c-ab09-05c8401e6222 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:18.866292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d58aaa38-d7d3-467c-ab09-05c8401e6222 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:18.866719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d58aaa38-d7d3-467c-ab09-05c8401e6222 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:18.943030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8066d91b-5098-4dac-8200-2fad3e84dc3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:18.945017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8066d91b-5098-4dac-8200-2fad3e84dc3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:18.951464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8066d91b-5098-4dac-8200-2fad3e84dc3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:18.951907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8066d91b-5098-4dac-8200-2fad3e84dc3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:18.952687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8066d91b-5098-4dac-8200-2fad3e84dc3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:18.953116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8066d91b-5098-4dac-8200-2fad3e84dc3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:18.982820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8066d91b-5098-4dac-8200-2fad3e84dc3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Jul 28 20:05:18.983380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 502/979] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:18.997410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d58aaa38-d7d3-467c-ab09-05c8401e6222 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:19.005034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d58aaa38-d7d3-467c-ab09-05c8401e6222 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151546 Jul 28 20:05:19.005591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 478/980] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:18 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:19.622951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-61b3cc4f-73dc-4d68-9a10-0f9353e559ff tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:19.625109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-61b3cc4f-73dc-4d68-9a10-0f9353e559ff tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:19.631159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61b3cc4f-73dc-4d68-9a10-0f9353e559ff tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:19.631603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61b3cc4f-73dc-4d68-9a10-0f9353e559ff tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:19.632355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61b3cc4f-73dc-4d68-9a10-0f9353e559ff tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:19.632814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61b3cc4f-73dc-4d68-9a10-0f9353e559ff tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:19.661436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-61b3cc4f-73dc-4d68-9a10-0f9353e559ff tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042525 Jul 28 20:05:19.661978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 503/981] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:19 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:19.995926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eb8af152-6da4-4d6e-b6cd-057f95d95267 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:19.997986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eb8af152-6da4-4d6e-b6cd-057f95d95267 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:20.004604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb8af152-6da4-4d6e-b6cd-057f95d95267 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:20.005044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb8af152-6da4-4d6e-b6cd-057f95d95267 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:20.005791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb8af152-6da4-4d6e-b6cd-057f95d95267 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:20.006218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb8af152-6da4-4d6e-b6cd-057f95d95267 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:20.025975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d906a8a7-5447-4e9e-9a22-73938be12dc3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:20.026677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d906a8a7-5447-4e9e-9a22-73938be12dc3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:20.034322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d906a8a7-5447-4e9e-9a22-73938be12dc3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:20.034766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d906a8a7-5447-4e9e-9a22-73938be12dc3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:20.035614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d906a8a7-5447-4e9e-9a22-73938be12dc3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:20.035876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eb8af152-6da4-4d6e-b6cd-057f95d95267 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Jul 28 20:05:20.036257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d906a8a7-5447-4e9e-9a22-73938be12dc3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:20.036801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 479/982] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:20.165744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d906a8a7-5447-4e9e-9a22-73938be12dc3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:20.173484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d906a8a7-5447-4e9e-9a22-73938be12dc3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151366 Jul 28 20:05:20.174039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 504/983] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:20 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:05:20.674694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6517f778-b89e-4c0c-b2f1-6b271ee5c6ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:20.676853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6517f778-b89e-4c0c-b2f1-6b271ee5c6ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:20.682834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6517f778-b89e-4c0c-b2f1-6b271ee5c6ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:20.683276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6517f778-b89e-4c0c-b2f1-6b271ee5c6ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:20.684024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6517f778-b89e-4c0c-b2f1-6b271ee5c6ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:20.684450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6517f778-b89e-4c0c-b2f1-6b271ee5c6ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:20.715142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6517f778-b89e-4c0c-b2f1-6b271ee5c6ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Jul 28 20:05:20.715703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 480/984] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:20 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:21.048845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7ea24261-3bc7-4e83-832e-8f894ed6b121 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:21.050969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7ea24261-3bc7-4e83-832e-8f894ed6b121 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:21.057394 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ea24261-3bc7-4e83-832e-8f894ed6b121 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:21.057841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ea24261-3bc7-4e83-832e-8f894ed6b121 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:21.058595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ea24261-3bc7-4e83-832e-8f894ed6b121 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:21.059024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ea24261-3bc7-4e83-832e-8f894ed6b121 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:21.087575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7ea24261-3bc7-4e83-832e-8f894ed6b121 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Jul 28 20:05:21.088119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 505/985] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:21.194596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d69f870d-3c1e-4c04-874e-09e73c5d0e8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:21.195207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d69f870d-3c1e-4c04-874e-09e73c5d0e8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:21.197563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=84 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:21.203081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d69f870d-3c1e-4c04-874e-09e73c5d0e8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:21.203526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d69f870d-3c1e-4c04-874e-09e73c5d0e8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:21.204338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d69f870d-3c1e-4c04-874e-09e73c5d0e8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:21.204795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d69f870d-3c1e-4c04-874e-09e73c5d0e8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:21.336639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d69f870d-3c1e-4c04-874e-09e73c5d0e8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:21.344094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d69f870d-3c1e-4c04-874e-09e73c5d0e8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153386 Jul 28 20:05:21.345691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 481/986] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:21 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:21.727415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dba687bf-756c-4860-864a-b65ebe7b46d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:21.729571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dba687bf-756c-4860-864a-b65ebe7b46d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:21.731420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=84 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:21.736779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dba687bf-756c-4860-864a-b65ebe7b46d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:21.737220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dba687bf-756c-4860-864a-b65ebe7b46d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:21.738000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dba687bf-756c-4860-864a-b65ebe7b46d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:21.738422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dba687bf-756c-4860-864a-b65ebe7b46d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:21.763494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:21.768987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dba687bf-756c-4860-864a-b65ebe7b46d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045544 Jul 28 20:05:21.769543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 506/987] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:21 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:22.099027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e1421045-72d3-4b66-8735-91a7bd9920f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:22.101205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e1421045-72d3-4b66-8735-91a7bd9920f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:22.107355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1421045-72d3-4b66-8735-91a7bd9920f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:22.107803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1421045-72d3-4b66-8735-91a7bd9920f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:22.108590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1421045-72d3-4b66-8735-91a7bd9920f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:22.109026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1421045-72d3-4b66-8735-91a7bd9920f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:22.133653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:22.138679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e1421045-72d3-4b66-8735-91a7bd9920f8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Jul 28 20:05:22.139225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 482/988] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:22 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:22.366797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-de4695e8-f24d-4c42-9ef8-a208065007c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:22.367374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-de4695e8-f24d-4c42-9ef8-a208065007c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:22.373866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de4695e8-f24d-4c42-9ef8-a208065007c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:22.374313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de4695e8-f24d-4c42-9ef8-a208065007c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:22.375067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de4695e8-f24d-4c42-9ef8-a208065007c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:22.376192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de4695e8-f24d-4c42-9ef8-a208065007c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:22.506758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-de4695e8-f24d-4c42-9ef8-a208065007c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:22.514253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-de4695e8-f24d-4c42-9ef8-a208065007c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151624 Jul 28 20:05:22.514804 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 507/989] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:22 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:22.781566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e3f511d0-3feb-4e4c-b5ed-6b61a699781d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:22.784171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e3f511d0-3feb-4e4c-b5ed-6b61a699781d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:22.790809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3f511d0-3feb-4e4c-b5ed-6b61a699781d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:22.791260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3f511d0-3feb-4e4c-b5ed-6b61a699781d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:22.792021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3f511d0-3feb-4e4c-b5ed-6b61a699781d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:22.792494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3f511d0-3feb-4e4c-b5ed-6b61a699781d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:22.821798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e3f511d0-3feb-4e4c-b5ed-6b61a699781d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044495 Jul 28 20:05:22.822344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 483/990] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:22 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:23.151398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d1e4df7c-5d62-4ade-8b61-3d44ee9ee90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:23.153628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d1e4df7c-5d62-4ade-8b61-3d44ee9ee90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:23.160805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d1e4df7c-5d62-4ade-8b61-3d44ee9ee90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:23.161250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d1e4df7c-5d62-4ade-8b61-3d44ee9ee90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:23.162017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d1e4df7c-5d62-4ade-8b61-3d44ee9ee90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:23.162445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d1e4df7c-5d62-4ade-8b61-3d44ee9ee90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:23.190705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d1e4df7c-5d62-4ade-8b61-3d44ee9ee90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Jul 28 20:05:23.191249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 508/991] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:23.536013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-31e72557-3706-4faa-8757-aa207b9d7be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:23.536588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-31e72557-3706-4faa-8757-aa207b9d7be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:23.542596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31e72557-3706-4faa-8757-aa207b9d7be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:23.543039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31e72557-3706-4faa-8757-aa207b9d7be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:23.543794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31e72557-3706-4faa-8757-aa207b9d7be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:23.544221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31e72557-3706-4faa-8757-aa207b9d7be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:23.677299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-31e72557-3706-4faa-8757-aa207b9d7be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:23.684618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-31e72557-3706-4faa-8757-aa207b9d7be1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152852 Jul 28 20:05:23.685198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 484/992] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:23 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:23.833114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-704c1fb9-5cbb-445d-9c25-ee5783681161 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:23.835220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-704c1fb9-5cbb-445d-9c25-ee5783681161 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:23.841576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-704c1fb9-5cbb-445d-9c25-ee5783681161 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:23.842018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-704c1fb9-5cbb-445d-9c25-ee5783681161 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:23.842765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-704c1fb9-5cbb-445d-9c25-ee5783681161 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:23.843195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-704c1fb9-5cbb-445d-9c25-ee5783681161 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:23.872624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-704c1fb9-5cbb-445d-9c25-ee5783681161 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Jul 28 20:05:23.873164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 509/993] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:23 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:24.202888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2621bab3-5957-4631-b967-2d42194331ba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:24.205268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2621bab3-5957-4631-b967-2d42194331ba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:24.211663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2621bab3-5957-4631-b967-2d42194331ba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:24.212102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2621bab3-5957-4631-b967-2d42194331ba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:24.212888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2621bab3-5957-4631-b967-2d42194331ba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:24.213313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2621bab3-5957-4631-b967-2d42194331ba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:24.242562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2621bab3-5957-4631-b967-2d42194331ba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043559 Jul 28 20:05:24.243105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 485/994] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:24.706837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eea97f74-b73e-479f-bc74-9e146ffa3746 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:24.707447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eea97f74-b73e-479f-bc74-9e146ffa3746 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:24.713451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eea97f74-b73e-479f-bc74-9e146ffa3746 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:24.713886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eea97f74-b73e-479f-bc74-9e146ffa3746 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:24.714626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eea97f74-b73e-479f-bc74-9e146ffa3746 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:24.715051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eea97f74-b73e-479f-bc74-9e146ffa3746 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:24.845635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-eea97f74-b73e-479f-bc74-9e146ffa3746 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:24.853061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eea97f74-b73e-479f-bc74-9e146ffa3746 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.150610 Jul 28 20:05:24.853610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 510/995] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:24 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:24.885339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-af9406ad-bf9c-41ae-9979-7bdb8d8d11cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:24.887484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-af9406ad-bf9c-41ae-9979-7bdb8d8d11cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:24.894366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-af9406ad-bf9c-41ae-9979-7bdb8d8d11cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:24.894793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-af9406ad-bf9c-41ae-9979-7bdb8d8d11cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:24.895537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-af9406ad-bf9c-41ae-9979-7bdb8d8d11cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:24.895962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-af9406ad-bf9c-41ae-9979-7bdb8d8d11cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:24.924705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-af9406ad-bf9c-41ae-9979-7bdb8d8d11cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Jul 28 20:05:24.925243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 486/996] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:25.255621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e2135edf-b70a-4cab-996d-3de3cadf141e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:25.257779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e2135edf-b70a-4cab-996d-3de3cadf141e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:25.263642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2135edf-b70a-4cab-996d-3de3cadf141e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:25.264085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2135edf-b70a-4cab-996d-3de3cadf141e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:25.264866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2135edf-b70a-4cab-996d-3de3cadf141e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:25.265297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2135edf-b70a-4cab-996d-3de3cadf141e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:25.293359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e2135edf-b70a-4cab-996d-3de3cadf141e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Jul 28 20:05:25.293899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 511/997] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:25.874145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9016a0f6-b17b-4d00-929c-a1126b8424c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:25.874783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9016a0f6-b17b-4d00-929c-a1126b8424c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:25.881993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9016a0f6-b17b-4d00-929c-a1126b8424c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:25.882436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9016a0f6-b17b-4d00-929c-a1126b8424c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:25.883181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9016a0f6-b17b-4d00-929c-a1126b8424c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:25.883608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9016a0f6-b17b-4d00-929c-a1126b8424c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:25.936073 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ccc3c478-6ec1-4b05-8d69-7d420a7fc65b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:25.939403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ccc3c478-6ec1-4b05-8d69-7d420a7fc65b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:25.945500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ccc3c478-6ec1-4b05-8d69-7d420a7fc65b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:25.945944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ccc3c478-6ec1-4b05-8d69-7d420a7fc65b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:25.946701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ccc3c478-6ec1-4b05-8d69-7d420a7fc65b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:25.947182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ccc3c478-6ec1-4b05-8d69-7d420a7fc65b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:25.976519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ccc3c478-6ec1-4b05-8d69-7d420a7fc65b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Jul 28 20:05:25.977364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 512/998] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:26.027072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9016a0f6-b17b-4d00-929c-a1126b8424c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:26.034810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9016a0f6-b17b-4d00-929c-a1126b8424c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.164499 Jul 28 20:05:26.035369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 487/999] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:25 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:26.306457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ff8f21d8-3470-477e-9c53-c1379428b90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:26.308613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ff8f21d8-3470-477e-9c53-c1379428b90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:26.315403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff8f21d8-3470-477e-9c53-c1379428b90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:26.315850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff8f21d8-3470-477e-9c53-c1379428b90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:26.316644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff8f21d8-3470-477e-9c53-c1379428b90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:26.317081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff8f21d8-3470-477e-9c53-c1379428b90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:26.346590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ff8f21d8-3470-477e-9c53-c1379428b90e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Jul 28 20:05:26.347133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 513/1000] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:26.990946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0192d008-4ee0-4439-94b7-9d7917b21d14 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:26.993087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0192d008-4ee0-4439-94b7-9d7917b21d14 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:26.999482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0192d008-4ee0-4439-94b7-9d7917b21d14 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:26.999926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0192d008-4ee0-4439-94b7-9d7917b21d14 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:27.002572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0192d008-4ee0-4439-94b7-9d7917b21d14 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:27.003423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0192d008-4ee0-4439-94b7-9d7917b21d14 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:27.041648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0192d008-4ee0-4439-94b7-9d7917b21d14 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054660 Jul 28 20:05:27.042206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 488/1001] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:27.055155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6d0892ac-6825-4a98-8f4c-d0513b010c2c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:27.055795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6d0892ac-6825-4a98-8f4c-d0513b010c2c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:27.062372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d0892ac-6825-4a98-8f4c-d0513b010c2c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:27.063361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d0892ac-6825-4a98-8f4c-d0513b010c2c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:27.064134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d0892ac-6825-4a98-8f4c-d0513b010c2c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:27.064592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d0892ac-6825-4a98-8f4c-d0513b010c2c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:27.193943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6d0892ac-6825-4a98-8f4c-d0513b010c2c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:27.201344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6d0892ac-6825-4a98-8f4c-d0513b010c2c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.150033 Jul 28 20:05:27.201899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 514/1002] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:27 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:27.359514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d5d8d790-1925-40df-8eb6-e112788c87c1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:27.362004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d5d8d790-1925-40df-8eb6-e112788c87c1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:27.368040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5d8d790-1925-40df-8eb6-e112788c87c1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:27.368493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5d8d790-1925-40df-8eb6-e112788c87c1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:27.369463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5d8d790-1925-40df-8eb6-e112788c87c1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:27.369888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5d8d790-1925-40df-8eb6-e112788c87c1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:27.399821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d5d8d790-1925-40df-8eb6-e112788c87c1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Jul 28 20:05:27.400297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 489/1003] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:27 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:28.054337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4ad88bb9-6637-4ea0-8005-2c1210f4c657 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:28.056408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4ad88bb9-6637-4ea0-8005-2c1210f4c657 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:28.062972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ad88bb9-6637-4ea0-8005-2c1210f4c657 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:28.063529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ad88bb9-6637-4ea0-8005-2c1210f4c657 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:28.064297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ad88bb9-6637-4ea0-8005-2c1210f4c657 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:28.064770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ad88bb9-6637-4ea0-8005-2c1210f4c657 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:28.092447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4ad88bb9-6637-4ea0-8005-2c1210f4c657 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042018 Jul 28 20:05:28.093012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 515/1004] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:28 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:28.224487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b7b0dd4b-96ce-4137-a3fd-915d23a3ba92 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:28.225120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b7b0dd4b-96ce-4137-a3fd-915d23a3ba92 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:28.231604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7b0dd4b-96ce-4137-a3fd-915d23a3ba92 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:28.232043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7b0dd4b-96ce-4137-a3fd-915d23a3ba92 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:28.232811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7b0dd4b-96ce-4137-a3fd-915d23a3ba92 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:28.233237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7b0dd4b-96ce-4137-a3fd-915d23a3ba92 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:28.366303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b7b0dd4b-96ce-4137-a3fd-915d23a3ba92 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:28.373923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b7b0dd4b-96ce-4137-a3fd-915d23a3ba92 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.154847 Jul 28 20:05:28.374478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 490/1005] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:28 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:05:28.412466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-38624dd8-6054-4c29-a908-6e3d69c7e9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:28.414663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-38624dd8-6054-4c29-a908-6e3d69c7e9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:28.420673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38624dd8-6054-4c29-a908-6e3d69c7e9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:28.421124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38624dd8-6054-4c29-a908-6e3d69c7e9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:28.421882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38624dd8-6054-4c29-a908-6e3d69c7e9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:28.422923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38624dd8-6054-4c29-a908-6e3d69c7e9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:28.451727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-38624dd8-6054-4c29-a908-6e3d69c7e9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Jul 28 20:05:28.452273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 516/1006] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:29.104557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f7876f6e-2d96-4302-b202-5528e99b06c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:29.106733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f7876f6e-2d96-4302-b202-5528e99b06c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:29.113723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f7876f6e-2d96-4302-b202-5528e99b06c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:29.114167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f7876f6e-2d96-4302-b202-5528e99b06c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:29.114922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f7876f6e-2d96-4302-b202-5528e99b06c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:29.115362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f7876f6e-2d96-4302-b202-5528e99b06c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:29.146037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f7876f6e-2d96-4302-b202-5528e99b06c4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Jul 28 20:05:29.146593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 491/1007] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:29 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:29.395640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ae7a0b9f-0b33-4ff7-a57b-bcd2c2e986c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:29.396178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ae7a0b9f-0b33-4ff7-a57b-bcd2c2e986c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:29.402648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae7a0b9f-0b33-4ff7-a57b-bcd2c2e986c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:29.403082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae7a0b9f-0b33-4ff7-a57b-bcd2c2e986c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:29.403830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae7a0b9f-0b33-4ff7-a57b-bcd2c2e986c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:29.404253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae7a0b9f-0b33-4ff7-a57b-bcd2c2e986c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:29.464479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-918065b0-800f-4961-8d16-c0042fd95956 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:29.466654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-918065b0-800f-4961-8d16-c0042fd95956 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:29.473762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-918065b0-800f-4961-8d16-c0042fd95956 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:29.474205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-918065b0-800f-4961-8d16-c0042fd95956 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:29.474958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-918065b0-800f-4961-8d16-c0042fd95956 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:29.475385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-918065b0-800f-4961-8d16-c0042fd95956 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:29.504304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-918065b0-800f-4961-8d16-c0042fd95956 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Jul 28 20:05:29.504913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 492/1008] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:29.540348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ae7a0b9f-0b33-4ff7-a57b-bcd2c2e986c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:29.547901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ae7a0b9f-0b33-4ff7-a57b-bcd2c2e986c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.156262 Jul 28 20:05:29.548447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 517/1009] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:29 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:30.159463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4100a603-4e55-4534-8619-52c2b380f840 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:30.162117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4100a603-4e55-4534-8619-52c2b380f840 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:30.168964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4100a603-4e55-4534-8619-52c2b380f840 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:30.169416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4100a603-4e55-4534-8619-52c2b380f840 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:30.170181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4100a603-4e55-4534-8619-52c2b380f840 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:30.170612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4100a603-4e55-4534-8619-52c2b380f840 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:30.199873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4100a603-4e55-4534-8619-52c2b380f840 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Jul 28 20:05:30.200418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 493/1010] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:30 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:30.517992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8216d925-c28d-4e22-8417-0d637a9fcbe9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:30.520037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8216d925-c28d-4e22-8417-0d637a9fcbe9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:30.526586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8216d925-c28d-4e22-8417-0d637a9fcbe9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:30.527029 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8216d925-c28d-4e22-8417-0d637a9fcbe9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:30.527782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8216d925-c28d-4e22-8417-0d637a9fcbe9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:30.528213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8216d925-c28d-4e22-8417-0d637a9fcbe9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:30.557687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8216d925-c28d-4e22-8417-0d637a9fcbe9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Jul 28 20:05:30.558217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 518/1011] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:30.569818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f0c216d6-4569-4b90-8016-4c0adf89e6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:30.570423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f0c216d6-4569-4b90-8016-4c0adf89e6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:30.576824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0c216d6-4569-4b90-8016-4c0adf89e6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:30.577265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0c216d6-4569-4b90-8016-4c0adf89e6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:30.578005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0c216d6-4569-4b90-8016-4c0adf89e6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:30.579116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0c216d6-4569-4b90-8016-4c0adf89e6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:30.708042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f0c216d6-4569-4b90-8016-4c0adf89e6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:30.715495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f0c216d6-4569-4b90-8016-4c0adf89e6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149506 Jul 28 20:05:30.716045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 494/1012] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:30 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:31.211968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2c4c6159-d92a-4479-a3ca-b56198a7fd57 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:31.214179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2c4c6159-d92a-4479-a3ca-b56198a7fd57 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:31.220834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c4c6159-d92a-4479-a3ca-b56198a7fd57 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:31.221280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c4c6159-d92a-4479-a3ca-b56198a7fd57 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:31.222036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c4c6159-d92a-4479-a3ca-b56198a7fd57 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:31.222479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c4c6159-d92a-4479-a3ca-b56198a7fd57 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:31.253832 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2c4c6159-d92a-4479-a3ca-b56198a7fd57 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045817 Jul 28 20:05:31.254395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 519/1013] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:31.570289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-361cd9ae-a94b-49a6-a824-f68d77dd7733 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:31.572409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-361cd9ae-a94b-49a6-a824-f68d77dd7733 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:31.578976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-361cd9ae-a94b-49a6-a824-f68d77dd7733 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:31.579425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-361cd9ae-a94b-49a6-a824-f68d77dd7733 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:31.580185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-361cd9ae-a94b-49a6-a824-f68d77dd7733 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:31.580621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-361cd9ae-a94b-49a6-a824-f68d77dd7733 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:31.608693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-361cd9ae-a94b-49a6-a824-f68d77dd7733 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Jul 28 20:05:31.609243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 495/1014] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:31.738151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5d2f918e-625e-4703-ac11-3114e64dbceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:31.738760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5d2f918e-625e-4703-ac11-3114e64dbceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:31.744731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d2f918e-625e-4703-ac11-3114e64dbceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:31.745198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d2f918e-625e-4703-ac11-3114e64dbceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:31.745931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d2f918e-625e-4703-ac11-3114e64dbceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:31.746363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d2f918e-625e-4703-ac11-3114e64dbceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:31.876746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5d2f918e-625e-4703-ac11-3114e64dbceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:31.884189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5d2f918e-625e-4703-ac11-3114e64dbceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.150477 Jul 28 20:05:31.884784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 520/1015] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:31 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:32.267095 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0c42ac45-3e38-42d5-95fc-d04d4439c18a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:32.269263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0c42ac45-3e38-42d5-95fc-d04d4439c18a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:32.275317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c42ac45-3e38-42d5-95fc-d04d4439c18a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:32.275755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c42ac45-3e38-42d5-95fc-d04d4439c18a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:32.276502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c42ac45-3e38-42d5-95fc-d04d4439c18a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:32.276951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c42ac45-3e38-42d5-95fc-d04d4439c18a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:32.306484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0c42ac45-3e38-42d5-95fc-d04d4439c18a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Jul 28 20:05:32.307036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 496/1016] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:32.621676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-52662cf2-c15b-4e8e-b572-d2225cf20ab5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:32.623793 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-52662cf2-c15b-4e8e-b572-d2225cf20ab5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:32.630989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-52662cf2-c15b-4e8e-b572-d2225cf20ab5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:32.631436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-52662cf2-c15b-4e8e-b572-d2225cf20ab5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:32.632184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-52662cf2-c15b-4e8e-b572-d2225cf20ab5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:32.632637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-52662cf2-c15b-4e8e-b572-d2225cf20ab5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:32.661269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-52662cf2-c15b-4e8e-b572-d2225cf20ab5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043547 Jul 28 20:05:32.661795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 521/1017] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:32.905444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-753a7847-c2b7-4b52-8453-0e085e401846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:32.906304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-753a7847-c2b7-4b52-8453-0e085e401846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:32.912325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-753a7847-c2b7-4b52-8453-0e085e401846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:32.912797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-753a7847-c2b7-4b52-8453-0e085e401846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:32.913552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-753a7847-c2b7-4b52-8453-0e085e401846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:32.913981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-753a7847-c2b7-4b52-8453-0e085e401846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:33.044916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-753a7847-c2b7-4b52-8453-0e085e401846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:33.052898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-753a7847-c2b7-4b52-8453-0e085e401846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151539 Jul 28 20:05:33.053451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 497/1018] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:32 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:33.318858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-139c0f84-c3db-42bf-90c9-4db8c956a1e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:33.321060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-139c0f84-c3db-42bf-90c9-4db8c956a1e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:33.327138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-139c0f84-c3db-42bf-90c9-4db8c956a1e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:33.327585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-139c0f84-c3db-42bf-90c9-4db8c956a1e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:33.328410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-139c0f84-c3db-42bf-90c9-4db8c956a1e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:33.328875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-139c0f84-c3db-42bf-90c9-4db8c956a1e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:33.357669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-139c0f84-c3db-42bf-90c9-4db8c956a1e1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042793 Jul 28 20:05:33.358219 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 522/1019] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:33.674333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-db9a9835-88c3-4ea5-acda-060d80558e4d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:33.676451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-db9a9835-88c3-4ea5-acda-060d80558e4d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:33.683116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db9a9835-88c3-4ea5-acda-060d80558e4d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:33.683558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db9a9835-88c3-4ea5-acda-060d80558e4d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:33.684342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db9a9835-88c3-4ea5-acda-060d80558e4d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:33.684858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db9a9835-88c3-4ea5-acda-060d80558e4d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:33.713609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-db9a9835-88c3-4ea5-acda-060d80558e4d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Jul 28 20:05:33.714152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 498/1020] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:34.073825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-90ebbc34-35e6-455e-ac25-d36a74e93ad1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:34.074437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-90ebbc34-35e6-455e-ac25-d36a74e93ad1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:34.080888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90ebbc34-35e6-455e-ac25-d36a74e93ad1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:34.081335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90ebbc34-35e6-455e-ac25-d36a74e93ad1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:34.082089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90ebbc34-35e6-455e-ac25-d36a74e93ad1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:34.082522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90ebbc34-35e6-455e-ac25-d36a74e93ad1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:34.100458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:34.215098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-90ebbc34-35e6-455e-ac25-d36a74e93ad1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:34.223369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-90ebbc34-35e6-455e-ac25-d36a74e93ad1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153453 Jul 28 20:05:34.223925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 523/1021] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:34 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:34.371089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-315826e3-ebf2-4694-9a9d-c9eaebe8add9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:34.373318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-315826e3-ebf2-4694-9a9d-c9eaebe8add9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:34.380472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-315826e3-ebf2-4694-9a9d-c9eaebe8add9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:34.381011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-315826e3-ebf2-4694-9a9d-c9eaebe8add9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:34.381836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-315826e3-ebf2-4694-9a9d-c9eaebe8add9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:34.382311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-315826e3-ebf2-4694-9a9d-c9eaebe8add9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:34.400257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:34.415102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-315826e3-ebf2-4694-9a9d-c9eaebe8add9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048213 Jul 28 20:05:34.415661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 499/1022] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:34 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:34.726492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9ce09b5b-3b09-4105-9c34-ccfb8c8f1599 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:34.728576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9ce09b5b-3b09-4105-9c34-ccfb8c8f1599 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:34.735107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ce09b5b-3b09-4105-9c34-ccfb8c8f1599 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:34.735557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ce09b5b-3b09-4105-9c34-ccfb8c8f1599 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:34.736304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ce09b5b-3b09-4105-9c34-ccfb8c8f1599 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:34.736757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ce09b5b-3b09-4105-9c34-ccfb8c8f1599 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:34.764386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9ce09b5b-3b09-4105-9c34-ccfb8c8f1599 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041960 Jul 28 20:05:34.764953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 524/1023] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:35.244397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aea587c1-2fbb-4db2-874e-a30737f2c8d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:35.245037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aea587c1-2fbb-4db2-874e-a30737f2c8d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:35.251768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aea587c1-2fbb-4db2-874e-a30737f2c8d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:35.252211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aea587c1-2fbb-4db2-874e-a30737f2c8d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:35.252983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aea587c1-2fbb-4db2-874e-a30737f2c8d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:35.253409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aea587c1-2fbb-4db2-874e-a30737f2c8d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:35.385492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-aea587c1-2fbb-4db2-874e-a30737f2c8d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:35.393343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aea587c1-2fbb-4db2-874e-a30737f2c8d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152783 Jul 28 20:05:35.393894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 500/1024] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:35 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:35.431700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0b6667a0-574c-4828-bb7f-c7688110c73f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:35.434495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0b6667a0-574c-4828-bb7f-c7688110c73f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:35.440864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b6667a0-574c-4828-bb7f-c7688110c73f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:35.441305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b6667a0-574c-4828-bb7f-c7688110c73f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:35.442099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b6667a0-574c-4828-bb7f-c7688110c73f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:35.442527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b6667a0-574c-4828-bb7f-c7688110c73f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:35.471017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0b6667a0-574c-4828-bb7f-c7688110c73f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Jul 28 20:05:35.471554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 525/1025] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:35 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:35.777167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ea0ae2a2-6618-4d99-99cf-c10bfab4646e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:35.779339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ea0ae2a2-6618-4d99-99cf-c10bfab4646e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:35.786537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea0ae2a2-6618-4d99-99cf-c10bfab4646e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:35.786980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea0ae2a2-6618-4d99-99cf-c10bfab4646e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:35.787736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea0ae2a2-6618-4d99-99cf-c10bfab4646e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:35.788166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea0ae2a2-6618-4d99-99cf-c10bfab4646e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:35.816494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ea0ae2a2-6618-4d99-99cf-c10bfab4646e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 Jul 28 20:05:35.817076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 501/1026] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:36.415888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f1d367f0-4b7d-4e3c-81b5-3f0841118456 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:36.416423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f1d367f0-4b7d-4e3c-81b5-3f0841118456 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:36.423551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1d367f0-4b7d-4e3c-81b5-3f0841118456 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:36.424004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1d367f0-4b7d-4e3c-81b5-3f0841118456 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:36.424799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1d367f0-4b7d-4e3c-81b5-3f0841118456 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:36.425236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1d367f0-4b7d-4e3c-81b5-3f0841118456 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:36.483234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a3ea6ce9-384f-447a-b78a-8790767a1ced tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:36.486296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a3ea6ce9-384f-447a-b78a-8790767a1ced tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:36.492790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a3ea6ce9-384f-447a-b78a-8790767a1ced tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:36.493263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a3ea6ce9-384f-447a-b78a-8790767a1ced tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:36.494002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a3ea6ce9-384f-447a-b78a-8790767a1ced tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:36.494435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a3ea6ce9-384f-447a-b78a-8790767a1ced tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:36.524004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a3ea6ce9-384f-447a-b78a-8790767a1ced tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Jul 28 20:05:36.524584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 502/1027] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:36 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:36.556069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f1d367f0-4b7d-4e3c-81b5-3f0841118456 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:36.564210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f1d367f0-4b7d-4e3c-81b5-3f0841118456 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152341 Jul 28 20:05:36.564784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 526/1028] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:36 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:36.828372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-88a3edfb-3d9b-4038-92a6-c36d14ba95d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:36.830529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-88a3edfb-3d9b-4038-92a6-c36d14ba95d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:36.836589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a3edfb-3d9b-4038-92a6-c36d14ba95d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:36.837037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a3edfb-3d9b-4038-92a6-c36d14ba95d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:36.837799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a3edfb-3d9b-4038-92a6-c36d14ba95d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:36.838229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a3edfb-3d9b-4038-92a6-c36d14ba95d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:36.867492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-88a3edfb-3d9b-4038-92a6-c36d14ba95d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 Jul 28 20:05:36.868035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 503/1029] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:36 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:37.537312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-169b7414-92cf-48e5-8136-442df3bff9a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:37.539600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-169b7414-92cf-48e5-8136-442df3bff9a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:37.545974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-169b7414-92cf-48e5-8136-442df3bff9a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:37.546411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-169b7414-92cf-48e5-8136-442df3bff9a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:37.547808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-169b7414-92cf-48e5-8136-442df3bff9a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:37.548275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-169b7414-92cf-48e5-8136-442df3bff9a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:37.577672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-169b7414-92cf-48e5-8136-442df3bff9a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Jul 28 20:05:37.578379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 527/1030] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:37 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:37.585197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-818cff03-43fa-47e8-aced-7686624740ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:37.585800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-818cff03-43fa-47e8-aced-7686624740ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:37.592227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-818cff03-43fa-47e8-aced-7686624740ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:37.592707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-818cff03-43fa-47e8-aced-7686624740ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:37.593461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-818cff03-43fa-47e8-aced-7686624740ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:37.594539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-818cff03-43fa-47e8-aced-7686624740ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:37.726830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-818cff03-43fa-47e8-aced-7686624740ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:37.735244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-818cff03-43fa-47e8-aced-7686624740ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153206 Jul 28 20:05:37.735858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 504/1031] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:37 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:37.880316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-85c8faf4-f633-43e5-89a8-dca304aa09fb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:37.882562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-85c8faf4-f633-43e5-89a8-dca304aa09fb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:37.888644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85c8faf4-f633-43e5-89a8-dca304aa09fb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:37.889098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85c8faf4-f633-43e5-89a8-dca304aa09fb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:37.889856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85c8faf4-f633-43e5-89a8-dca304aa09fb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:37.890287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-85c8faf4-f633-43e5-89a8-dca304aa09fb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:37.918492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-85c8faf4-f633-43e5-89a8-dca304aa09fb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Jul 28 20:05:37.919043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 528/1032] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:38.590128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1bbf4b33-61bf-4056-aa76-1020fad89472 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:38.592249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1bbf4b33-61bf-4056-aa76-1020fad89472 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:38.599627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bbf4b33-61bf-4056-aa76-1020fad89472 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:38.600077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bbf4b33-61bf-4056-aa76-1020fad89472 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:38.600914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bbf4b33-61bf-4056-aa76-1020fad89472 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:38.601349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bbf4b33-61bf-4056-aa76-1020fad89472 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:38.631196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1bbf4b33-61bf-4056-aa76-1020fad89472 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045006 Jul 28 20:05:38.631747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 505/1033] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:38.756241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e431bfd-c2de-488d-8f9b-19917e9d01a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:38.756882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9e431bfd-c2de-488d-8f9b-19917e9d01a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:38.763579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e431bfd-c2de-488d-8f9b-19917e9d01a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:38.764043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e431bfd-c2de-488d-8f9b-19917e9d01a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:38.764866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e431bfd-c2de-488d-8f9b-19917e9d01a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:38.765333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e431bfd-c2de-488d-8f9b-19917e9d01a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:38.897468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9e431bfd-c2de-488d-8f9b-19917e9d01a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:38.905170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e431bfd-c2de-488d-8f9b-19917e9d01a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152671 Jul 28 20:05:38.906036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 529/1034] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:38 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:38.931774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-553ad193-5ead-4fb5-a927-1d85fb04826b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:38.934011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-553ad193-5ead-4fb5-a927-1d85fb04826b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:38.941110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-553ad193-5ead-4fb5-a927-1d85fb04826b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:38.941555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-553ad193-5ead-4fb5-a927-1d85fb04826b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:38.942336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-553ad193-5ead-4fb5-a927-1d85fb04826b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:38.942764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-553ad193-5ead-4fb5-a927-1d85fb04826b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:38.976512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-553ad193-5ead-4fb5-a927-1d85fb04826b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048742 Jul 28 20:05:38.977099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 506/1035] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:39.643494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ed589ce5-9a1f-40c8-bea0-d57649b4ef66 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:39.645735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ed589ce5-9a1f-40c8-bea0-d57649b4ef66 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:39.651710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed589ce5-9a1f-40c8-bea0-d57649b4ef66 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:39.652162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed589ce5-9a1f-40c8-bea0-d57649b4ef66 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:39.652958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed589ce5-9a1f-40c8-bea0-d57649b4ef66 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:39.653395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed589ce5-9a1f-40c8-bea0-d57649b4ef66 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:39.682099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ed589ce5-9a1f-40c8-bea0-d57649b4ef66 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042619 Jul 28 20:05:39.682636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 530/1036] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:39 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:39.987550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7493c651-9b06-4a8f-8a53-37877c49c3cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:39.988069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7493c651-9b06-4a8f-8a53-37877c49c3cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:39.989045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9b5f10c9-6f42-4c54-8307-69f40786eb49 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:39.991241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9b5f10c9-6f42-4c54-8307-69f40786eb49 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:39.994652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7493c651-9b06-4a8f-8a53-37877c49c3cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:39.995119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7493c651-9b06-4a8f-8a53-37877c49c3cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:39.995875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7493c651-9b06-4a8f-8a53-37877c49c3cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:39.996303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7493c651-9b06-4a8f-8a53-37877c49c3cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:39.997617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b5f10c9-6f42-4c54-8307-69f40786eb49 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:39.998065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b5f10c9-6f42-4c54-8307-69f40786eb49 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:39.998821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b5f10c9-6f42-4c54-8307-69f40786eb49 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:39.999250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b5f10c9-6f42-4c54-8307-69f40786eb49 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:40.027904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9b5f10c9-6f42-4c54-8307-69f40786eb49 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 Jul 28 20:05:40.028458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 531/1037] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:40.127080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7493c651-9b06-4a8f-8a53-37877c49c3cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:40.134626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7493c651-9b06-4a8f-8a53-37877c49c3cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151785 Jul 28 20:05:40.135182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 507/1038] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:39 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:40.694764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-23a1ef2a-2abd-47b3-b697-8c4432adf00b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:40.697022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-23a1ef2a-2abd-47b3-b697-8c4432adf00b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:40.703253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-23a1ef2a-2abd-47b3-b697-8c4432adf00b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:40.703708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-23a1ef2a-2abd-47b3-b697-8c4432adf00b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:40.704470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-23a1ef2a-2abd-47b3-b697-8c4432adf00b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:40.704934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-23a1ef2a-2abd-47b3-b697-8c4432adf00b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:40.734946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-23a1ef2a-2abd-47b3-b697-8c4432adf00b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Jul 28 20:05:40.735380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 532/1039] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:41.041072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dd771c46-c0a9-495b-8d32-8628453212e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:41.043114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dd771c46-c0a9-495b-8d32-8628453212e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:41.049765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd771c46-c0a9-495b-8d32-8628453212e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:41.050201 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd771c46-c0a9-495b-8d32-8628453212e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:41.050949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd771c46-c0a9-495b-8d32-8628453212e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:41.051373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd771c46-c0a9-495b-8d32-8628453212e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:41.079259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dd771c46-c0a9-495b-8d32-8628453212e7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 Jul 28 20:05:41.079795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 508/1040] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:41.157260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c933fe20-1626-4a2d-a5ce-83f7b3788310 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:41.157875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c933fe20-1626-4a2d-a5ce-83f7b3788310 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:41.164413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c933fe20-1626-4a2d-a5ce-83f7b3788310 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:41.164896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c933fe20-1626-4a2d-a5ce-83f7b3788310 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:41.165654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c933fe20-1626-4a2d-a5ce-83f7b3788310 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:41.166087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c933fe20-1626-4a2d-a5ce-83f7b3788310 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:41.297415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c933fe20-1626-4a2d-a5ce-83f7b3788310 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:41.304946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c933fe20-1626-4a2d-a5ce-83f7b3788310 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152783 Jul 28 20:05:41.305500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 533/1041] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:41 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:05:41.747110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e2ecfd86-cbec-48fc-95a1-14344baea143 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:41.749262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e2ecfd86-cbec-48fc-95a1-14344baea143 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:41.755805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd86-cbec-48fc-95a1-14344baea143 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:41.756247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd86-cbec-48fc-95a1-14344baea143 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:41.757022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd86-cbec-48fc-95a1-14344baea143 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:41.757449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd86-cbec-48fc-95a1-14344baea143 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:41.785742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e2ecfd86-cbec-48fc-95a1-14344baea143 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042562 Jul 28 20:05:41.786314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 509/1042] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:41 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:42.091399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9f4ffe92-6b9d-40b7-bfb9-e413df51ffa1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:42.093669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9f4ffe92-6b9d-40b7-bfb9-e413df51ffa1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:42.099575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f4ffe92-6b9d-40b7-bfb9-e413df51ffa1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:42.100023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f4ffe92-6b9d-40b7-bfb9-e413df51ffa1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:42.100838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f4ffe92-6b9d-40b7-bfb9-e413df51ffa1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:42.101267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f4ffe92-6b9d-40b7-bfb9-e413df51ffa1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:42.129107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9f4ffe92-6b9d-40b7-bfb9-e413df51ffa1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041660 Jul 28 20:05:42.129644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 534/1043] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:42.326809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0a7eed86-4d61-4ede-8af1-7f5943bc072e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:42.327434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0a7eed86-4d61-4ede-8af1-7f5943bc072e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:42.334081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a7eed86-4d61-4ede-8af1-7f5943bc072e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:42.334521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a7eed86-4d61-4ede-8af1-7f5943bc072e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:42.335261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a7eed86-4d61-4ede-8af1-7f5943bc072e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:42.335685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a7eed86-4d61-4ede-8af1-7f5943bc072e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:42.463894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0a7eed86-4d61-4ede-8af1-7f5943bc072e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:42.471909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0a7eed86-4d61-4ede-8af1-7f5943bc072e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149037 Jul 28 20:05:42.472467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 510/1044] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:42 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:42.798258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-86a05d7d-6fab-4992-ba2e-afc7711f031b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:42.800322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-86a05d7d-6fab-4992-ba2e-afc7711f031b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:42.806871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86a05d7d-6fab-4992-ba2e-afc7711f031b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:42.807317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86a05d7d-6fab-4992-ba2e-afc7711f031b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:42.808070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86a05d7d-6fab-4992-ba2e-afc7711f031b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:42.808502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86a05d7d-6fab-4992-ba2e-afc7711f031b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:42.837653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-86a05d7d-6fab-4992-ba2e-afc7711f031b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Jul 28 20:05:42.838190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 535/1045] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:42 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:43.141461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cdc2f3bd-9c4d-457f-b696-578de92e19be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:43.143677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cdc2f3bd-9c4d-457f-b696-578de92e19be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:43.150339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc2f3bd-9c4d-457f-b696-578de92e19be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:43.150786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc2f3bd-9c4d-457f-b696-578de92e19be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:43.151546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc2f3bd-9c4d-457f-b696-578de92e19be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:43.151980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc2f3bd-9c4d-457f-b696-578de92e19be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:43.182305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cdc2f3bd-9c4d-457f-b696-578de92e19be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Jul 28 20:05:43.182855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 511/1046] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:43.492423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-45050839-9cbe-474f-a2e1-d2b992b1dfc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:43.492990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-45050839-9cbe-474f-a2e1-d2b992b1dfc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:43.498921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45050839-9cbe-474f-a2e1-d2b992b1dfc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:43.499357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45050839-9cbe-474f-a2e1-d2b992b1dfc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:43.500266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45050839-9cbe-474f-a2e1-d2b992b1dfc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:43.500731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45050839-9cbe-474f-a2e1-d2b992b1dfc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:43.632507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-45050839-9cbe-474f-a2e1-d2b992b1dfc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:43.640066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-45050839-9cbe-474f-a2e1-d2b992b1dfc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151566 Jul 28 20:05:43.640681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 536/1047] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:43 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:43.849359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bb94938f-270f-4ede-a61c-86c19c51dec6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:43.851493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bb94938f-270f-4ede-a61c-86c19c51dec6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:43.857909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb94938f-270f-4ede-a61c-86c19c51dec6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:43.858355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb94938f-270f-4ede-a61c-86c19c51dec6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:43.859194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb94938f-270f-4ede-a61c-86c19c51dec6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:43.859651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb94938f-270f-4ede-a61c-86c19c51dec6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:43.888487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bb94938f-270f-4ede-a61c-86c19c51dec6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043049 Jul 28 20:05:43.889057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 512/1048] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:43 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:44.195051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0a517fa5-b219-4d29-b156-fce3d703c2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:44.197241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0a517fa5-b219-4d29-b156-fce3d703c2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:44.203762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a517fa5-b219-4d29-b156-fce3d703c2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:44.204214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a517fa5-b219-4d29-b156-fce3d703c2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:44.205010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a517fa5-b219-4d29-b156-fce3d703c2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:44.205444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a517fa5-b219-4d29-b156-fce3d703c2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:44.234944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0a517fa5-b219-4d29-b156-fce3d703c2db tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043956 Jul 28 20:05:44.235603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 537/1049] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:44.662141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4fa869e8-0f87-4dc4-bb3d-1a447c6d3dc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:44.662752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4fa869e8-0f87-4dc4-bb3d-1a447c6d3dc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:44.668931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4fa869e8-0f87-4dc4-bb3d-1a447c6d3dc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:44.669376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4fa869e8-0f87-4dc4-bb3d-1a447c6d3dc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:44.670125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4fa869e8-0f87-4dc4-bb3d-1a447c6d3dc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:44.670584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4fa869e8-0f87-4dc4-bb3d-1a447c6d3dc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:44.800493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4fa869e8-0f87-4dc4-bb3d-1a447c6d3dc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:44.807874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4fa869e8-0f87-4dc4-bb3d-1a447c6d3dc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149567 Jul 28 20:05:44.808431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 513/1050] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:44 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:44.901535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c110a28b-f8aa-4271-b6e8-7aabf4dbabac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:44.903651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c110a28b-f8aa-4271-b6e8-7aabf4dbabac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:44.910638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c110a28b-f8aa-4271-b6e8-7aabf4dbabac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:44.911073 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c110a28b-f8aa-4271-b6e8-7aabf4dbabac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:44.911852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c110a28b-f8aa-4271-b6e8-7aabf4dbabac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:44.912327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c110a28b-f8aa-4271-b6e8-7aabf4dbabac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:44.940287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c110a28b-f8aa-4271-b6e8-7aabf4dbabac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Jul 28 20:05:44.940852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 538/1051] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:44 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:45.247522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7669d043-25aa-4a51-8152-6977f2574c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:45.249649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7669d043-25aa-4a51-8152-6977f2574c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:45.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7669d043-25aa-4a51-8152-6977f2574c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:45.256485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7669d043-25aa-4a51-8152-6977f2574c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:45.257259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7669d043-25aa-4a51-8152-6977f2574c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:45.257685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7669d043-25aa-4a51-8152-6977f2574c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:45.286063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7669d043-25aa-4a51-8152-6977f2574c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042566 Jul 28 20:05:45.286612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 514/1052] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:45.830030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2d50cb58-4cdf-40a1-84cc-4d0d80ceb51e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:45.830634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2d50cb58-4cdf-40a1-84cc-4d0d80ceb51e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:45.837023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d50cb58-4cdf-40a1-84cc-4d0d80ceb51e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:45.837468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d50cb58-4cdf-40a1-84cc-4d0d80ceb51e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:45.838214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d50cb58-4cdf-40a1-84cc-4d0d80ceb51e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:45.838693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d50cb58-4cdf-40a1-84cc-4d0d80ceb51e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:45.952491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a28c4135-9bef-45bd-ac75-f0b488d765c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:45.954813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a28c4135-9bef-45bd-ac75-f0b488d765c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:45.960733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a28c4135-9bef-45bd-ac75-f0b488d765c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:45.961177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a28c4135-9bef-45bd-ac75-f0b488d765c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:45.961978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a28c4135-9bef-45bd-ac75-f0b488d765c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:45.962406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a28c4135-9bef-45bd-ac75-f0b488d765c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:45.975221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2d50cb58-4cdf-40a1-84cc-4d0d80ceb51e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:45.982750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2d50cb58-4cdf-40a1-84cc-4d0d80ceb51e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.157549 Jul 28 20:05:45.983302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 539/1053] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:45 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:46.017988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a28c4135-9bef-45bd-ac75-f0b488d765c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068859 Jul 28 20:05:46.018895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 515/1054] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:46.299153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-46f45e1c-0ec8-452e-a52a-b9da6bf4014b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:46.301424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-46f45e1c-0ec8-452e-a52a-b9da6bf4014b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:46.309248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46f45e1c-0ec8-452e-a52a-b9da6bf4014b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:46.309248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46f45e1c-0ec8-452e-a52a-b9da6bf4014b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:46.309248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46f45e1c-0ec8-452e-a52a-b9da6bf4014b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:46.309705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46f45e1c-0ec8-452e-a52a-b9da6bf4014b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:46.313850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:46.339451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-46f45e1c-0ec8-452e-a52a-b9da6bf4014b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Jul 28 20:05:46.339986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 540/1055] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:47.006137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8a27b218-4d14-4e75-9b0f-52c4cf0318be tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:47.006747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8a27b218-4d14-4e75-9b0f-52c4cf0318be tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:47.013384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a27b218-4d14-4e75-9b0f-52c4cf0318be tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:47.013831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a27b218-4d14-4e75-9b0f-52c4cf0318be tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:47.014598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a27b218-4d14-4e75-9b0f-52c4cf0318be tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:47.015027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a27b218-4d14-4e75-9b0f-52c4cf0318be tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:47.018927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:47.030844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d1706e8c-5671-4841-b522-4b30ddb52763 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:47.035433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d1706e8c-5671-4841-b522-4b30ddb52763 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:47.041920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d1706e8c-5671-4841-b522-4b30ddb52763 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:47.042366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d1706e8c-5671-4841-b522-4b30ddb52763 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:47.043136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d1706e8c-5671-4841-b522-4b30ddb52763 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:47.043566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d1706e8c-5671-4841-b522-4b30ddb52763 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:47.076021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d1706e8c-5671-4841-b522-4b30ddb52763 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049343 Jul 28 20:05:47.076602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 541/1056] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:47.148674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8a27b218-4d14-4e75-9b0f-52c4cf0318be tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:47.156322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8a27b218-4d14-4e75-9b0f-52c4cf0318be tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.154129 Jul 28 20:05:47.156913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 516/1057] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:47.351483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cc4cbc0d-e474-45a6-83c4-3ae24235ef32 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:47.353649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cc4cbc0d-e474-45a6-83c4-3ae24235ef32 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:47.360454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc4cbc0d-e474-45a6-83c4-3ae24235ef32 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:47.360925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc4cbc0d-e474-45a6-83c4-3ae24235ef32 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:47.361713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc4cbc0d-e474-45a6-83c4-3ae24235ef32 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:47.362147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc4cbc0d-e474-45a6-83c4-3ae24235ef32 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:47.390016 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cc4cbc0d-e474-45a6-83c4-3ae24235ef32 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042490 Jul 28 20:05:47.390680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 542/1058] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:47 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:48.088834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eb701666-0b5b-4629-94c5-4adb942f3711 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:48.091009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eb701666-0b5b-4629-94c5-4adb942f3711 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:48.097877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb701666-0b5b-4629-94c5-4adb942f3711 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:48.098329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb701666-0b5b-4629-94c5-4adb942f3711 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:48.099092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb701666-0b5b-4629-94c5-4adb942f3711 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:48.099526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb701666-0b5b-4629-94c5-4adb942f3711 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:48.127896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eb701666-0b5b-4629-94c5-4adb942f3711 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043088 Jul 28 20:05:48.128442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 517/1059] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:48 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:48.177881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-41e78243-50b4-4d68-8651-9a5330a41d0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:48.178525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-41e78243-50b4-4d68-8651-9a5330a41d0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:48.184982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41e78243-50b4-4d68-8651-9a5330a41d0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:48.185431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41e78243-50b4-4d68-8651-9a5330a41d0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:48.186299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41e78243-50b4-4d68-8651-9a5330a41d0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:48.186621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41e78243-50b4-4d68-8651-9a5330a41d0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:48.313819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-41e78243-50b4-4d68-8651-9a5330a41d0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:48.321457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-41e78243-50b4-4d68-8651-9a5330a41d0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.147392 Jul 28 20:05:48.322013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 543/1060] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:48.402484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71c19c3e-d829-4c19-b8ab-db4879438644 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:48.404598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-71c19c3e-d829-4c19-b8ab-db4879438644 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:48.410788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71c19c3e-d829-4c19-b8ab-db4879438644 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:48.411231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71c19c3e-d829-4c19-b8ab-db4879438644 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:48.411984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71c19c3e-d829-4c19-b8ab-db4879438644 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:48.412418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71c19c3e-d829-4c19-b8ab-db4879438644 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:48.441243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-71c19c3e-d829-4c19-b8ab-db4879438644 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 Jul 28 20:05:48.441795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 518/1061] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:49.139715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ec1d4c56-49d4-4dad-b07c-b37ffa6533ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:49.141960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ec1d4c56-49d4-4dad-b07c-b37ffa6533ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:49.147863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec1d4c56-49d4-4dad-b07c-b37ffa6533ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:49.148307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec1d4c56-49d4-4dad-b07c-b37ffa6533ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:49.149121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec1d4c56-49d4-4dad-b07c-b37ffa6533ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:49.149550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec1d4c56-49d4-4dad-b07c-b37ffa6533ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:49.179973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ec1d4c56-49d4-4dad-b07c-b37ffa6533ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044320 Jul 28 20:05:49.180617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 544/1062] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:49 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:49.343781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5db7bbcc-5cdc-4ec3-b6e0-22538265392f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:49.344424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5db7bbcc-5cdc-4ec3-b6e0-22538265392f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:49.350854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5db7bbcc-5cdc-4ec3-b6e0-22538265392f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:49.351293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5db7bbcc-5cdc-4ec3-b6e0-22538265392f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:49.352039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5db7bbcc-5cdc-4ec3-b6e0-22538265392f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:49.352462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5db7bbcc-5cdc-4ec3-b6e0-22538265392f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:49.454325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-72db6c21-2292-4585-b79d-6b10e6a59fd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:49.456581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-72db6c21-2292-4585-b79d-6b10e6a59fd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:49.462646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-72db6c21-2292-4585-b79d-6b10e6a59fd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:49.463087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-72db6c21-2292-4585-b79d-6b10e6a59fd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:49.463840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-72db6c21-2292-4585-b79d-6b10e6a59fd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:49.464269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-72db6c21-2292-4585-b79d-6b10e6a59fd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:49.484910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5db7bbcc-5cdc-4ec3-b6e0-22538265392f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:49.492332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5db7bbcc-5cdc-4ec3-b6e0-22538265392f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152928 Jul 28 20:05:49.492918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 519/1063] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:49 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:49.494795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-72db6c21-2292-4585-b79d-6b10e6a59fd8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Jul 28 20:05:49.495524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 545/1064] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:50.192130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7ab629d8-f21d-470e-9ad5-58d2f2f6d9aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:50.194284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7ab629d8-f21d-470e-9ad5-58d2f2f6d9aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:50.200325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ab629d8-f21d-470e-9ad5-58d2f2f6d9aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.200810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ab629d8-f21d-470e-9ad5-58d2f2f6d9aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.201564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ab629d8-f21d-470e-9ad5-58d2f2f6d9aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.201995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ab629d8-f21d-470e-9ad5-58d2f2f6d9aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.230355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7ab629d8-f21d-470e-9ad5-58d2f2f6d9aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042335 Jul 28 20:05:50.230895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 520/1065] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:50 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:50.432288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-efa0849a-eb2b-4bce-92f4-d703636e87e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:50.432838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-efa0849a-eb2b-4bce-92f4-d703636e87e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:50.439089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-efa0849a-eb2b-4bce-92f4-d703636e87e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.439531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-efa0849a-eb2b-4bce-92f4-d703636e87e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.440284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-efa0849a-eb2b-4bce-92f4-d703636e87e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.440747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-efa0849a-eb2b-4bce-92f4-d703636e87e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.465557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-efa0849a-eb2b-4bce-92f4-d703636e87e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:05:50.509962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1f3f89c5-d789-4bd3-ac6a-df0261991864 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:50.512239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1f3f89c5-d789-4bd3-ac6a-df0261991864 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:50.518887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1f3f89c5-d789-4bd3-ac6a-df0261991864 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.519334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1f3f89c5-d789-4bd3-ac6a-df0261991864 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.520252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1f3f89c5-d789-4bd3-ac6a-df0261991864 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.520875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1f3f89c5-d789-4bd3-ac6a-df0261991864 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.548037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-efa0849a-eb2b-4bce-92f4-d703636e87e2 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "DELETE /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 204 len: 0 microversion: 2.20 time: 0.118049 Jul 28 20:05:50.549148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 546/1066] 10.222.0.67 () {60 vars in 1280 bytes} [Thu Jul 28 20:05:50 2022] DELETE /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 20:05:50.555616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1f3f89c5-d789-4bd3-ac6a-df0261991864 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050094 Jul 28 20:05:50.556569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 521/1067] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:50.557484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5a8173e7-8bfc-4d88-ad0d-3eea79366695 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:50.557907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5a8173e7-8bfc-4d88-ad0d-3eea79366695 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:50.561075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:50.561696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:50.564293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a8173e7-8bfc-4d88-ad0d-3eea79366695 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.564825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a8173e7-8bfc-4d88-ad0d-3eea79366695 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.565588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a8173e7-8bfc-4d88-ad0d-3eea79366695 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.566015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a8173e7-8bfc-4d88-ad0d-3eea79366695 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.567819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.568266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.569086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:50.569521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:50.762094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5a8173e7-8bfc-4d88-ad0d-3eea79366695 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:50.770063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:50.770226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5a8173e7-8bfc-4d88-ad0d-3eea79366695 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.219764 Jul 28 20:05:50.770669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 547/1068] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:50.778151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:50.779723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:50.781306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a41d5939-85c1-48af-9f4c-a488dc790e62 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1722 microversion: 2.20 time: 0.223735 Jul 28 20:05:50.781852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 522/1069] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:05:50 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:05:51.244083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f7fb2cb6-8115-4489-be5b-327390732bc4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:51.246386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f7fb2cb6-8115-4489-be5b-327390732bc4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:51.252855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f7fb2cb6-8115-4489-be5b-327390732bc4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:51.253413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f7fb2cb6-8115-4489-be5b-327390732bc4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:51.254164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f7fb2cb6-8115-4489-be5b-327390732bc4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:51.254592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f7fb2cb6-8115-4489-be5b-327390732bc4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:51.283570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f7fb2cb6-8115-4489-be5b-327390732bc4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Jul 28 20:05:51.284107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 548/1070] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:51.568418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-768f65dc-179b-41e9-82ee-9595ea3abcfd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:51.570609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-768f65dc-179b-41e9-82ee-9595ea3abcfd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:51.572954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=84 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:51.578757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-768f65dc-179b-41e9-82ee-9595ea3abcfd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:51.579198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-768f65dc-179b-41e9-82ee-9595ea3abcfd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:51.579956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-768f65dc-179b-41e9-82ee-9595ea3abcfd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:51.580416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-768f65dc-179b-41e9-82ee-9595ea3abcfd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:51.609247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-768f65dc-179b-41e9-82ee-9595ea3abcfd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044791 Jul 28 20:05:51.609733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 523/1071] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:51.791581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b522b7ad-0394-4712-a80c-0d07309f57df tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:51.792195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b522b7ad-0394-4712-a80c-0d07309f57df tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:51.794588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:51.800266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b522b7ad-0394-4712-a80c-0d07309f57df tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:51.800749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b522b7ad-0394-4712-a80c-0d07309f57df tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:51.801517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b522b7ad-0394-4712-a80c-0d07309f57df tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:51.801952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b522b7ad-0394-4712-a80c-0d07309f57df tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:51.805412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:51.806168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:51.813347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:51.813802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:51.814571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:51.815003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:52.002638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b522b7ad-0394-4712-a80c-0d07309f57df tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:52.006074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:52.011229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b522b7ad-0394-4712-a80c-0d07309f57df tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.223430 Jul 28 20:05:52.011924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 549/1072] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:51 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:52.015782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:52.017508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:52.018696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-10ffacda-5565-4a42-a84c-07752a7eedfa tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1722 microversion: 2.20 time: 0.217960 Jul 28 20:05:52.019258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 524/1073] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:05:51 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 20:05:52.295552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-45fae801-b5e1-4efb-80ed-f9dcca3ae698 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:52.298033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-45fae801-b5e1-4efb-80ed-f9dcca3ae698 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:52.304226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45fae801-b5e1-4efb-80ed-f9dcca3ae698 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:52.304702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45fae801-b5e1-4efb-80ed-f9dcca3ae698 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:52.305469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45fae801-b5e1-4efb-80ed-f9dcca3ae698 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:52.305903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45fae801-b5e1-4efb-80ed-f9dcca3ae698 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:52.335208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-45fae801-b5e1-4efb-80ed-f9dcca3ae698 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Jul 28 20:05:52.335773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 550/1074] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:52 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:52.620513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cdc63642-71d2-4398-bdc9-ea79fd94bb6c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:52.622685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cdc63642-71d2-4398-bdc9-ea79fd94bb6c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:52.630532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc63642-71d2-4398-bdc9-ea79fd94bb6c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:52.630903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc63642-71d2-4398-bdc9-ea79fd94bb6c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:52.631665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc63642-71d2-4398-bdc9-ea79fd94bb6c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:52.632093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc63642-71d2-4398-bdc9-ea79fd94bb6c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:52.662435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cdc63642-71d2-4398-bdc9-ea79fd94bb6c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045806 Jul 28 20:05:52.662995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 525/1075] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:53.035428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c60dacf8-2bf9-4917-97fe-273c1eb9972a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:53.038348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c60dacf8-2bf9-4917-97fe-273c1eb9972a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:53.043374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:53.044143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:53.046409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c60dacf8-2bf9-4917-97fe-273c1eb9972a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:53.047209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c60dacf8-2bf9-4917-97fe-273c1eb9972a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:53.048528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c60dacf8-2bf9-4917-97fe-273c1eb9972a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:53.049312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c60dacf8-2bf9-4917-97fe-273c1eb9972a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:53.051817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:53.056857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:53.057649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:53.058090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:53.184429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:53.198594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:53.200091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e0e1988c7f44d5198811aca33e1345e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cb4fda232e46b6842f8aa7840e48a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:53.204347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8e6ec99f-2516-4ed8-a261-e82ac77ccbca tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 200 len: 1654 microversion: 2.20 time: 0.162466 Jul 28 20:05:53.206040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 526/1076] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:05:53 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 1654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 20:05:53.210798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-6456e04e-1c53-4ead-89c6-5feb2e634cac req-278d4100-02f1-430f-87bd-bd336dc584c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21f3dc00-9675-4747-97b5-ef6c45f6f2c2", "name": "network-vif-deleted", "tag": "a128fb35-f85e-4481-9721-b707261faadd"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:05:53.244311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-6456e04e-1c53-4ead-89c6-5feb2e634cac req-278d4100-02f1-430f-87bd-bd336dc584c8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:53.245576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-6456e04e-1c53-4ead-89c6-5feb2e634cac req-278d4100-02f1-430f-87bd-bd336dc584c8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:53.262760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-6456e04e-1c53-4ead-89c6-5feb2e634cac req-278d4100-02f1-430f-87bd-bd336dc584c8 service nova] Creating event network-vif-deleted:a128fb35-f85e-4481-9721-b707261faadd for instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 on hv-cinder-85144 Jul 28 20:05:53.270697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-6456e04e-1c53-4ead-89c6-5feb2e634cac req-278d4100-02f1-430f-87bd-bd336dc584c8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063293 Jul 28 20:05:53.271772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 527/1077] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:53.321471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c60dacf8-2bf9-4917-97fe-273c1eb9972a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:53.330173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c60dacf8-2bf9-4917-97fe-273c1eb9972a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.300248 Jul 28 20:05:53.331273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 551/1078] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:53 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:53.350947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-de86b738-6bf7-4a87-83e9-176a3d998dd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:53.353621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-de86b738-6bf7-4a87-83e9-176a3d998dd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:53.374404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de86b738-6bf7-4a87-83e9-176a3d998dd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:53.381327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de86b738-6bf7-4a87-83e9-176a3d998dd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:53.382550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de86b738-6bf7-4a87-83e9-176a3d998dd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:53.383072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de86b738-6bf7-4a87-83e9-176a3d998dd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:53.425808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-de86b738-6bf7-4a87-83e9-176a3d998dd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080832 Jul 28 20:05:53.426564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 528/1079] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:53.675451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e98a79e9-83dc-429c-a9e2-4b59ec24515f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:53.677882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e98a79e9-83dc-429c-a9e2-4b59ec24515f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:53.683992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e98a79e9-83dc-429c-a9e2-4b59ec24515f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:53.684447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e98a79e9-83dc-429c-a9e2-4b59ec24515f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:53.685266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e98a79e9-83dc-429c-a9e2-4b59ec24515f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:53.685704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e98a79e9-83dc-429c-a9e2-4b59ec24515f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:53.718872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e98a79e9-83dc-429c-a9e2-4b59ec24515f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047825 Jul 28 20:05:53.719451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 552/1080] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:54.229162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:54.229837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:54.236957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:54.237404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:54.238156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:54.238588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:54.251973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] HTTP exception thrown: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Request method failure captured: Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 HTTP/1.1 Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upjl8cyhU1Y-w0-xb4Q0VeT6_hQY1Tv0LbmZX-xo3Dkz5AfzsYkSINiJAmdRwJGkFLNDTbXBxqHZbHCk9D2iaP0GLbmd9kw4moiYSBLcfjh22aCpFNERVOvLSrUi_nx2W0Y0UmNcKbFaCPafVRcE7IjtIBs8VezAHDf7jHyDrP2OYk Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:05:54.253615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70cb4fda232e46b6842f8aa7840e48a7"}]}] Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 4e0e1988c7f44d5198811aca33e1345e Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:54.255138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '21f3dc00-9675-4747-97b5-ef6c45f6f2c2'} Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:05:54.256047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:54.257796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:54.259240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Returning 404 to user: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:05:54.259240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fd6b297e-6904-4367-8a5d-5450fa9cd13a tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 404 len: 111 microversion: 2.20 time: 0.029716 Jul 28 20:05:54.259240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 529/1081] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:05:54 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:05:54.263882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8b219ff0-605f-4af4-9144-9f76cf96aee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '.version_select at 0x7f5036feba60>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:54.282403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8b219ff0-605f-4af4-9144-9f76cf96aee8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448301370" status: 204 len: 0 microversion: 2.20 time: 0.022284 Jul 28 20:05:54.282972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 553/1082] 10.222.0.67 () {60 vars in 1259 bytes} [Thu Jul 28 20:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448301370 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 20:05:54.353813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e8de51de-f685-4b38-9a4a-43f332176be3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:54.354427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e8de51de-f685-4b38-9a4a-43f332176be3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:54.361478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8de51de-f685-4b38-9a4a-43f332176be3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:54.361947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8de51de-f685-4b38-9a4a-43f332176be3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:54.362723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8de51de-f685-4b38-9a4a-43f332176be3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:54.363137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8de51de-f685-4b38-9a4a-43f332176be3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:54.439575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6d74a491-8237-4378-b251-39186c25de38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:54.442230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6d74a491-8237-4378-b251-39186c25de38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:54.463347 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d74a491-8237-4378-b251-39186c25de38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:54.463792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d74a491-8237-4378-b251-39186c25de38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:54.464592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d74a491-8237-4378-b251-39186c25de38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:54.465024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d74a491-8237-4378-b251-39186c25de38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:54.506405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6d74a491-8237-4378-b251-39186c25de38 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071858 Jul 28 20:05:54.508096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 554/1083] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:54.524814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e8de51de-f685-4b38-9a4a-43f332176be3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:54.533789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e8de51de-f685-4b38-9a4a-43f332176be3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.183916 Jul 28 20:05:54.534354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 530/1084] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:54.731806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-57c77478-4129-4647-9105-f9268f56dca1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:54.734164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-57c77478-4129-4647-9105-f9268f56dca1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:54.740453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57c77478-4129-4647-9105-f9268f56dca1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:54.740940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57c77478-4129-4647-9105-f9268f56dca1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:54.741727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57c77478-4129-4647-9105-f9268f56dca1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:54.742164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57c77478-4129-4647-9105-f9268f56dca1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:54.775072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-57c77478-4129-4647-9105-f9268f56dca1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047373 Jul 28 20:05:54.775719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 555/1085] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:55.158464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:55.158963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:55.165306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.165753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.166575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.166929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.181146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] HTTP exception thrown: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Request method failure captured: Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 HTTP/1.1 Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upjl8cyhU1Y-w0-xb4Q0VeT6_hQY1Tv0LbmZX-xo3Dkz5AfzsYkSINiJAmdRwJGkFLNDTbXBxqHZbHCk9D2iaP0GLbmd9kw4moiYSBLcfjh22aCpFNERVOvLSrUi_nx2W0Y0UmNcKbFaCPafVRcE7IjtIBs8VezAHDf7jHyDrP2OYk Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:05:55.182677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70cb4fda232e46b6842f8aa7840e48a7"}]}] Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 4e0e1988c7f44d5198811aca33e1345e Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.184265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '21f3dc00-9675-4747-97b5-ef6c45f6f2c2'} Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:05:55.185118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.186521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.188368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Returning 404 to user: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:05:55.188368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-68003f2b-6b11-4d11-95b7-a229a51c4ae4 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "DELETE /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 404 len: 111 microversion: 2.20 time: 0.030717 Jul 28 20:05:55.188368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 531/1086] 10.222.0.67 () {60 vars in 1280 bytes} [Thu Jul 28 20:05:55 2022] DELETE /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:05:55.192806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:55.193414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 21f3dc00-9675-4747-97b5-ef6c45f6f2c2] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:55.199280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.199718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.200458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.200918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.205564 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:55.216228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] HTTP exception thrown: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Request method failure captured: Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 HTTP/1.1 Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4upjl8cyhU1Y-w0-xb4Q0VeT6_hQY1Tv0LbmZX-xo3Dkz5AfzsYkSINiJAmdRwJGkFLNDTbXBxqHZbHCk9D2iaP0GLbmd9kw4moiYSBLcfjh22aCpFNERVOvLSrUi_nx2W0Y0UmNcKbFaCPafVRcE7IjtIBs8VezAHDf7jHyDrP2OYk Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:05:55.218738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70cb4fda232e46b6842f8aa7840e48a7"}]}] Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 4e0e1988c7f44d5198811aca33e1345e Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': '21f3dc00-9675-4747-97b5-ef6c45f6f2c2'} Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:05:55.221594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. Jul 28 20:05:55.223033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:05:55.224224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Returning 404 to user: Instance 21f3dc00-9675-4747-97b5-ef6c45f6f2c2 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:05:55.224224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f7aa42ce-20a7-4baf-80de-b109c9e2fc04 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2" status: 404 len: 111 microversion: 2.20 time: 0.031204 Jul 28 20:05:55.224224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 556/1087] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:05:55 2022] GET /compute/v2.1/servers/21f3dc00-9675-4747-97b5-ef6c45f6f2c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:05:55.520047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6addc870-0c25-4418-8a88-8e3ddba2030e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:55.522199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6addc870-0c25-4418-8a88-8e3ddba2030e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:55.528607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6addc870-0c25-4418-8a88-8e3ddba2030e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.529052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6addc870-0c25-4418-8a88-8e3ddba2030e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.529796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6addc870-0c25-4418-8a88-8e3ddba2030e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.530222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6addc870-0c25-4418-8a88-8e3ddba2030e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.554897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e4c08f15-4358-44e0-b216-b3fdf63f7d27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:55.555530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e4c08f15-4358-44e0-b216-b3fdf63f7d27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:55.562135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6addc870-0c25-4418-8a88-8e3ddba2030e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045363 Jul 28 20:05:55.563113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 532/1088] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:55 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:55.564053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e4c08f15-4358-44e0-b216-b3fdf63f7d27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.564501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e4c08f15-4358-44e0-b216-b3fdf63f7d27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.565291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e4c08f15-4358-44e0-b216-b3fdf63f7d27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.565722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e4c08f15-4358-44e0-b216-b3fdf63f7d27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.711690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e4c08f15-4358-44e0-b216-b3fdf63f7d27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:55.719981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e4c08f15-4358-44e0-b216-b3fdf63f7d27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.168980 Jul 28 20:05:55.720560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 557/1089] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:05:55.788181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9cf6c290-c92f-4071-8ec5-941458752f70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:55.790327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9cf6c290-c92f-4071-8ec5-941458752f70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:55.796960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9cf6c290-c92f-4071-8ec5-941458752f70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.797446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9cf6c290-c92f-4071-8ec5-941458752f70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.798204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9cf6c290-c92f-4071-8ec5-941458752f70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:55.798637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9cf6c290-c92f-4071-8ec5-941458752f70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:55.828354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9cf6c290-c92f-4071-8ec5-941458752f70 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044140 Jul 28 20:05:55.828941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 533/1090] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:56.574246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5d997135-e609-481d-a75d-4f0fbbe1955d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:56.576433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5d997135-e609-481d-a75d-4f0fbbe1955d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:56.583503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d997135-e609-481d-a75d-4f0fbbe1955d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:56.583948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d997135-e609-481d-a75d-4f0fbbe1955d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:56.584749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d997135-e609-481d-a75d-4f0fbbe1955d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:56.585182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5d997135-e609-481d-a75d-4f0fbbe1955d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:56.613141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5d997135-e609-481d-a75d-4f0fbbe1955d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042920 Jul 28 20:05:56.613680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 558/1091] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:56.742083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cb39adb0-f548-4abd-9543-23506a12ec9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:56.742655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cb39adb0-f548-4abd-9543-23506a12ec9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:56.749288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cb39adb0-f548-4abd-9543-23506a12ec9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:56.749734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cb39adb0-f548-4abd-9543-23506a12ec9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:56.750490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cb39adb0-f548-4abd-9543-23506a12ec9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:56.750919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cb39adb0-f548-4abd-9543-23506a12ec9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:56.840677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e6fd2d09-ee66-4c80-9044-f76e0eee7e5f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:56.843612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e6fd2d09-ee66-4c80-9044-f76e0eee7e5f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:56.849636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6fd2d09-ee66-4c80-9044-f76e0eee7e5f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:56.850090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6fd2d09-ee66-4c80-9044-f76e0eee7e5f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:56.850847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6fd2d09-ee66-4c80-9044-f76e0eee7e5f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:56.851281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6fd2d09-ee66-4c80-9044-f76e0eee7e5f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:56.880659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e6fd2d09-ee66-4c80-9044-f76e0eee7e5f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Jul 28 20:05:56.881077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cb39adb0-f548-4abd-9543-23506a12ec9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:56.881445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 559/1092] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:56 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:05:56.884999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:05:56.891103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cb39adb0-f548-4abd-9543-23506a12ec9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152841 Jul 28 20:05:56.891711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 534/1093] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:56 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:57.625141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a498964e-d1d6-4031-ada6-2e5c78ebb641 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:57.627276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a498964e-d1d6-4031-ada6-2e5c78ebb641 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:57.633771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a498964e-d1d6-4031-ada6-2e5c78ebb641 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:57.634254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a498964e-d1d6-4031-ada6-2e5c78ebb641 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:57.635036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a498964e-d1d6-4031-ada6-2e5c78ebb641 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:57.635496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a498964e-d1d6-4031-ada6-2e5c78ebb641 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:57.671580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a498964e-d1d6-4031-ada6-2e5c78ebb641 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049944 Jul 28 20:05:57.672117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 560/1094] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:57 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:57.893689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c08728bb-ca06-48f4-ac64-38673eda48a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:57.895744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c08728bb-ca06-48f4-ac64-38673eda48a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:57.902428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c08728bb-ca06-48f4-ac64-38673eda48a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:57.902869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c08728bb-ca06-48f4-ac64-38673eda48a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:57.903617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c08728bb-ca06-48f4-ac64-38673eda48a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:57.904047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c08728bb-ca06-48f4-ac64-38673eda48a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:57.911964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ed562608-4d04-4351-8e28-016ec0ce84c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:57.912631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ed562608-4d04-4351-8e28-016ec0ce84c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:57.918940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed562608-4d04-4351-8e28-016ec0ce84c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:57.919390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed562608-4d04-4351-8e28-016ec0ce84c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:57.920165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed562608-4d04-4351-8e28-016ec0ce84c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:57.920651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed562608-4d04-4351-8e28-016ec0ce84c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:57.933992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c08728bb-ca06-48f4-ac64-38673eda48a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Jul 28 20:05:57.934548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 535/1095] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:58.056570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ed562608-4d04-4351-8e28-016ec0ce84c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:58.064036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ed562608-4d04-4351-8e28-016ec0ce84c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.156020 Jul 28 20:05:58.064608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 561/1096] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:05:58.684031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-97d0b656-cd41-4f71-89a1-ea67802d29e3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:58.686211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-97d0b656-cd41-4f71-89a1-ea67802d29e3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:58.693176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-97d0b656-cd41-4f71-89a1-ea67802d29e3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:58.693638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-97d0b656-cd41-4f71-89a1-ea67802d29e3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:58.694397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-97d0b656-cd41-4f71-89a1-ea67802d29e3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:58.694836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-97d0b656-cd41-4f71-89a1-ea67802d29e3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:58.723961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-97d0b656-cd41-4f71-89a1-ea67802d29e3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Jul 28 20:05:58.724503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 536/1097] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:58.946376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-33a738a6-405a-48b9-90a9-2b0066c9dcf2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:58.948454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-33a738a6-405a-48b9-90a9-2b0066c9dcf2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:58.955558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-33a738a6-405a-48b9-90a9-2b0066c9dcf2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:58.956007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-33a738a6-405a-48b9-90a9-2b0066c9dcf2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:58.956796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-33a738a6-405a-48b9-90a9-2b0066c9dcf2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:58.957231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-33a738a6-405a-48b9-90a9-2b0066c9dcf2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:58.986092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-33a738a6-405a-48b9-90a9-2b0066c9dcf2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Jul 28 20:05:58.986634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 562/1098] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:59.085176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2bd2d62e-4d42-42f1-a207-307dbf7d062d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:59.085798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2bd2d62e-4d42-42f1-a207-307dbf7d062d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:59.092207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2bd2d62e-4d42-42f1-a207-307dbf7d062d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:59.093088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2bd2d62e-4d42-42f1-a207-307dbf7d062d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:59.093944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2bd2d62e-4d42-42f1-a207-307dbf7d062d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:59.094380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2bd2d62e-4d42-42f1-a207-307dbf7d062d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:59.225442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2bd2d62e-4d42-42f1-a207-307dbf7d062d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:05:59.232911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2bd2d62e-4d42-42f1-a207-307dbf7d062d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151588 Jul 28 20:05:59.234002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 537/1099] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:05:59 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:05:59.735499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4a9231e5-b214-4155-8be5-771dd1d7ed53 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:05:59.737670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4a9231e5-b214-4155-8be5-771dd1d7ed53 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:05:59.743878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a9231e5-b214-4155-8be5-771dd1d7ed53 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:59.744332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a9231e5-b214-4155-8be5-771dd1d7ed53 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:59.745148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a9231e5-b214-4155-8be5-771dd1d7ed53 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:05:59.745586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a9231e5-b214-4155-8be5-771dd1d7ed53 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:05:59.776854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4a9231e5-b214-4155-8be5-771dd1d7ed53 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045328 Jul 28 20:05:59.777409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 563/1100] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:59 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:05:59.998439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eddf4640-f2b2-4a35-a9dc-bbc2c3a004fe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:00.001008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eddf4640-f2b2-4a35-a9dc-bbc2c3a004fe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:00.007025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eddf4640-f2b2-4a35-a9dc-bbc2c3a004fe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:00.007475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eddf4640-f2b2-4a35-a9dc-bbc2c3a004fe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:00.008229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eddf4640-f2b2-4a35-a9dc-bbc2c3a004fe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:00.008684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eddf4640-f2b2-4a35-a9dc-bbc2c3a004fe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:00.038538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eddf4640-f2b2-4a35-a9dc-bbc2c3a004fe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Jul 28 20:06:00.039080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 538/1101] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:05:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:00.254945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a5d213bc-9ed4-4633-b6c3-1c34d988015f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:00.255518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a5d213bc-9ed4-4633-b6c3-1c34d988015f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:00.261946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5d213bc-9ed4-4633-b6c3-1c34d988015f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:00.262383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5d213bc-9ed4-4633-b6c3-1c34d988015f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:00.263129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5d213bc-9ed4-4633-b6c3-1c34d988015f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:00.263555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5d213bc-9ed4-4633-b6c3-1c34d988015f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:00.396293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a5d213bc-9ed4-4633-b6c3-1c34d988015f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:00.403844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a5d213bc-9ed4-4633-b6c3-1c34d988015f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152895 Jul 28 20:06:00.404397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 564/1102] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:00 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:06:00.789542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2175beb3-68f5-49eb-af4b-38e7f542c7a9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:00.791795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2175beb3-68f5-49eb-af4b-38e7f542c7a9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:00.799318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2175beb3-68f5-49eb-af4b-38e7f542c7a9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:00.799793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2175beb3-68f5-49eb-af4b-38e7f542c7a9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:00.800668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2175beb3-68f5-49eb-af4b-38e7f542c7a9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:00.801111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2175beb3-68f5-49eb-af4b-38e7f542c7a9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:00.831823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2175beb3-68f5-49eb-af4b-38e7f542c7a9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 Jul 28 20:06:00.832380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 539/1103] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:01.044104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5af585f9-2f98-4f13-83c0-4cc19de880fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:01.044659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5af585f9-2f98-4f13-83c0-4cc19de880fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:01.051816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5af585f9-2f98-4f13-83c0-4cc19de880fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:01.052280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5af585f9-2f98-4f13-83c0-4cc19de880fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:01.052676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c63f686d-7a98-4fef-93a9-bf1d0d8cd63b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:01.053088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5af585f9-2f98-4f13-83c0-4cc19de880fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:01.053527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5af585f9-2f98-4f13-83c0-4cc19de880fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:01.054966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c63f686d-7a98-4fef-93a9-bf1d0d8cd63b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:01.061101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c63f686d-7a98-4fef-93a9-bf1d0d8cd63b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:01.061755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c63f686d-7a98-4fef-93a9-bf1d0d8cd63b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:01.063227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c63f686d-7a98-4fef-93a9-bf1d0d8cd63b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:01.063652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c63f686d-7a98-4fef-93a9-bf1d0d8cd63b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:01.098254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c63f686d-7a98-4fef-93a9-bf1d0d8cd63b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049600 Jul 28 20:06:01.098984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 540/1104] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:01.425615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-08de8ee3-cb9b-4c53-8e00-8907a4645ea9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:01.426168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-08de8ee3-cb9b-4c53-8e00-8907a4645ea9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:01.432131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08de8ee3-cb9b-4c53-8e00-8907a4645ea9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:01.432598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08de8ee3-cb9b-4c53-8e00-8907a4645ea9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:01.433354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08de8ee3-cb9b-4c53-8e00-8907a4645ea9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:01.433783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08de8ee3-cb9b-4c53-8e00-8907a4645ea9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:01.566804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-08de8ee3-cb9b-4c53-8e00-8907a4645ea9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:01.574169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-08de8ee3-cb9b-4c53-8e00-8907a4645ea9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152414 Jul 28 20:06:01.574719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 541/1105] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:01.844511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e7163686-cc7e-4826-ab2e-32bebd7e97bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:01.846691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e7163686-cc7e-4826-ab2e-32bebd7e97bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:01.853225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7163686-cc7e-4826-ab2e-32bebd7e97bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:01.853673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7163686-cc7e-4826-ab2e-32bebd7e97bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:01.854426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7163686-cc7e-4826-ab2e-32bebd7e97bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:01.854858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e7163686-cc7e-4826-ab2e-32bebd7e97bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:01.883445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e7163686-cc7e-4826-ab2e-32bebd7e97bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Jul 28 20:06:01.883985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 542/1106] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:06:02.111250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3f41f0ea-d5a3-4f9d-8464-8025338ccd9e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:02.113433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3f41f0ea-d5a3-4f9d-8464-8025338ccd9e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:02.119427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f41f0ea-d5a3-4f9d-8464-8025338ccd9e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:02.119871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f41f0ea-d5a3-4f9d-8464-8025338ccd9e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:02.120645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f41f0ea-d5a3-4f9d-8464-8025338ccd9e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:02.121069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f41f0ea-d5a3-4f9d-8464-8025338ccd9e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:02.149383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3f41f0ea-d5a3-4f9d-8464-8025338ccd9e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042695 Jul 28 20:06:02.149934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 543/1107] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:02 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:06:02.595608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-892dee0c-2004-4d3f-bfe8-354f6464c1cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:02.596219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-892dee0c-2004-4d3f-bfe8-354f6464c1cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:02.602392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-892dee0c-2004-4d3f-bfe8-354f6464c1cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:02.602836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-892dee0c-2004-4d3f-bfe8-354f6464c1cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:02.603586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-892dee0c-2004-4d3f-bfe8-354f6464c1cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:02.604044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-892dee0c-2004-4d3f-bfe8-354f6464c1cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:02.735858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-892dee0c-2004-4d3f-bfe8-354f6464c1cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:02.743418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-892dee0c-2004-4d3f-bfe8-354f6464c1cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152067 Jul 28 20:06:02.743979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 544/1108] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:02.895495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c555915f-eb21-4115-b518-dacee60745d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:02.897594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c555915f-eb21-4115-b518-dacee60745d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:02.903551 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c555915f-eb21-4115-b518-dacee60745d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:02.903968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c555915f-eb21-4115-b518-dacee60745d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:02.904740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c555915f-eb21-4115-b518-dacee60745d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:02.905166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c555915f-eb21-4115-b518-dacee60745d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:02.934271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c555915f-eb21-4115-b518-dacee60745d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042820 Jul 28 20:06:02.934812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 545/1109] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:02 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:06:03.162792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-23347e94-898b-4740-b7d6-90dddf98cec8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:03.164978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-23347e94-898b-4740-b7d6-90dddf98cec8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:03.171078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23347e94-898b-4740-b7d6-90dddf98cec8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:03.172136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23347e94-898b-4740-b7d6-90dddf98cec8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:03.172959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23347e94-898b-4740-b7d6-90dddf98cec8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:03.173417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23347e94-898b-4740-b7d6-90dddf98cec8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:03.201262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-23347e94-898b-4740-b7d6-90dddf98cec8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042561 Jul 28 20:06:03.201804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 546/1110] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:03 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:06:03.766183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-81809ae5-fa51-43e8-a6d0-26df696fb4ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:03.767332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-81809ae5-fa51-43e8-a6d0-26df696fb4ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:03.773989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81809ae5-fa51-43e8-a6d0-26df696fb4ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:03.774550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81809ae5-fa51-43e8-a6d0-26df696fb4ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:03.775377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81809ae5-fa51-43e8-a6d0-26df696fb4ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:03.775804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81809ae5-fa51-43e8-a6d0-26df696fb4ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:03.906944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-81809ae5-fa51-43e8-a6d0-26df696fb4ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:03.914569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-81809ae5-fa51-43e8-a6d0-26df696fb4ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153233 Jul 28 20:06:03.915133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 547/1111] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:03 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:03.946778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b452434f-f43f-47bb-8fce-e31e453e4ba7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:03.948978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b452434f-f43f-47bb-8fce-e31e453e4ba7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:03.955928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b452434f-f43f-47bb-8fce-e31e453e4ba7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:03.956418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b452434f-f43f-47bb-8fce-e31e453e4ba7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:03.957530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b452434f-f43f-47bb-8fce-e31e453e4ba7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:03.957968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b452434f-f43f-47bb-8fce-e31e453e4ba7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:03.987148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b452434f-f43f-47bb-8fce-e31e453e4ba7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Jul 28 20:06:03.987618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 548/1112] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:03 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:06:04.213659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b7452671-98be-4ad7-aba7-a9d76d738576 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:04.215818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b7452671-98be-4ad7-aba7-a9d76d738576 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:04.221825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7452671-98be-4ad7-aba7-a9d76d738576 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:04.222268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7452671-98be-4ad7-aba7-a9d76d738576 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:04.223011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7452671-98be-4ad7-aba7-a9d76d738576 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:04.223439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7452671-98be-4ad7-aba7-a9d76d738576 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:04.252480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b7452671-98be-4ad7-aba7-a9d76d738576 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042680 Jul 28 20:06:04.252989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 549/1113] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:06:04.935163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-98fb60ae-378f-436d-8840-412848349c4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:04.935785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-98fb60ae-378f-436d-8840-412848349c4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:04.942867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98fb60ae-378f-436d-8840-412848349c4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:04.943303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98fb60ae-378f-436d-8840-412848349c4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:04.944074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98fb60ae-378f-436d-8840-412848349c4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:04.944477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98fb60ae-378f-436d-8840-412848349c4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:05.073429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-98fb60ae-378f-436d-8840-412848349c4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:05.081732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-98fb60ae-378f-436d-8840-412848349c4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.150399 Jul 28 20:06:05.082297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 550/1114] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:04 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:05.087126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-06227f48-6c82-4f78-9d76-9a49bc79d69a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:05.090600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-06227f48-6c82-4f78-9d76-9a49bc79d69a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:05.100370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06227f48-6c82-4f78-9d76-9a49bc79d69a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:05.100854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06227f48-6c82-4f78-9d76-9a49bc79d69a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:05.101625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06227f48-6c82-4f78-9d76-9a49bc79d69a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:05.102065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06227f48-6c82-4f78-9d76-9a49bc79d69a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:05.120268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:05.133884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-06227f48-6c82-4f78-9d76-9a49bc79d69a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050609 Jul 28 20:06:05.134439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 551/1115] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:05 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:05.264762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-77f633d8-e258-40ad-9305-bbfbcd09c820 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:05.266998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-77f633d8-e258-40ad-9305-bbfbcd09c820 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:05.272935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77f633d8-e258-40ad-9305-bbfbcd09c820 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:05.273380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77f633d8-e258-40ad-9305-bbfbcd09c820 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:05.274131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77f633d8-e258-40ad-9305-bbfbcd09c820 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:05.274559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77f633d8-e258-40ad-9305-bbfbcd09c820 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:05.303788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-77f633d8-e258-40ad-9305-bbfbcd09c820 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Jul 28 20:06:05.304333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 552/1116] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:05 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:06:06.109248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-216d56ca-5b68-49c9-98e4-84c26c183922 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:06.109882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-216d56ca-5b68-49c9-98e4-84c26c183922 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:06.116308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-216d56ca-5b68-49c9-98e4-84c26c183922 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:06.116798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-216d56ca-5b68-49c9-98e4-84c26c183922 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:06.117541 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-216d56ca-5b68-49c9-98e4-84c26c183922 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:06.117970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-216d56ca-5b68-49c9-98e4-84c26c183922 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:06.251171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-216d56ca-5b68-49c9-98e4-84c26c183922 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:06.258764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-216d56ca-5b68-49c9-98e4-84c26c183922 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153323 Jul 28 20:06:06.259324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 553/1117] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:06 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:06.263865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f157c384-ee5f-4d02-8059-fb11c4096dd7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:06.266079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f157c384-ee5f-4d02-8059-fb11c4096dd7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:06.271765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f157c384-ee5f-4d02-8059-fb11c4096dd7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:06.272206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f157c384-ee5f-4d02-8059-fb11c4096dd7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:06.272998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f157c384-ee5f-4d02-8059-fb11c4096dd7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:06.273428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f157c384-ee5f-4d02-8059-fb11c4096dd7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:06.302542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f157c384-ee5f-4d02-8059-fb11c4096dd7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042207 Jul 28 20:06:06.303080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 554/1118] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:06 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:06.315258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-28b63789-a1c3-44b9-8da1-a99c74a5f16d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:06.317377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-28b63789-a1c3-44b9-8da1-a99c74a5f16d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:06.323115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b63789-a1c3-44b9-8da1-a99c74a5f16d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:06.323559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b63789-a1c3-44b9-8da1-a99c74a5f16d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:06.324308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b63789-a1c3-44b9-8da1-a99c74a5f16d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:06.324777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b63789-a1c3-44b9-8da1-a99c74a5f16d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:06.353152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-28b63789-a1c3-44b9-8da1-a99c74a5f16d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041890 Jul 28 20:06:06.353696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 555/1119] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:06:07.279764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d3fb4491-f504-4679-bdf9-359209de5a31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:07.280682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d3fb4491-f504-4679-bdf9-359209de5a31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:07.287890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3fb4491-f504-4679-bdf9-359209de5a31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:07.288367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3fb4491-f504-4679-bdf9-359209de5a31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:07.289153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3fb4491-f504-4679-bdf9-359209de5a31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:07.289585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3fb4491-f504-4679-bdf9-359209de5a31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:07.417507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d3fb4491-f504-4679-bdf9-359209de5a31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:07.425570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d3fb4491-f504-4679-bdf9-359209de5a31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149644 Jul 28 20:06:07.426122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 556/1120] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:07 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:07.430825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c9eba41-8af5-40a1-807f-eaff63547f62 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:07.432947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3c9eba41-8af5-40a1-807f-eaff63547f62 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:07.439199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c9eba41-8af5-40a1-807f-eaff63547f62 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:07.439635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c9eba41-8af5-40a1-807f-eaff63547f62 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:07.440381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c9eba41-8af5-40a1-807f-eaff63547f62 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:07.440831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c9eba41-8af5-40a1-807f-eaff63547f62 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:07.468430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3c9eba41-8af5-40a1-807f-eaff63547f62 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 Jul 28 20:06:07.469516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 557/1121] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:07 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:07.473879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-051ad03e-940b-4fff-8307-ad6d98ff7322 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:07.475922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-051ad03e-940b-4fff-8307-ad6d98ff7322 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:07.481478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-051ad03e-940b-4fff-8307-ad6d98ff7322 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:07.481919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-051ad03e-940b-4fff-8307-ad6d98ff7322 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:07.482751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-051ad03e-940b-4fff-8307-ad6d98ff7322 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:07.483177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-051ad03e-940b-4fff-8307-ad6d98ff7322 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:07.511112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-051ad03e-940b-4fff-8307-ad6d98ff7322 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040647 Jul 28 20:06:07.511646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 558/1122] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:08.544266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-93e3c4ec-fa90-485f-8aee-b27ae6a8731e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:08.544906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-93e3c4ec-fa90-485f-8aee-b27ae6a8731e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:08.551001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93e3c4ec-fa90-485f-8aee-b27ae6a8731e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:08.551438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93e3c4ec-fa90-485f-8aee-b27ae6a8731e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:08.552178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93e3c4ec-fa90-485f-8aee-b27ae6a8731e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:08.552634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93e3c4ec-fa90-485f-8aee-b27ae6a8731e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:08.683087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-93e3c4ec-fa90-485f-8aee-b27ae6a8731e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:08.691668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-93e3c4ec-fa90-485f-8aee-b27ae6a8731e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.248215 Jul 28 20:06:08.692233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 559/1123] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:08 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:08.696848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e68b5ad8-9bae-45ea-90c1-12d0d8335767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:08.699047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e68b5ad8-9bae-45ea-90c1-12d0d8335767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:08.705222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e68b5ad8-9bae-45ea-90c1-12d0d8335767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:08.705606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e68b5ad8-9bae-45ea-90c1-12d0d8335767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:08.706356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e68b5ad8-9bae-45ea-90c1-12d0d8335767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:08.706787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e68b5ad8-9bae-45ea-90c1-12d0d8335767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:08.737132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e68b5ad8-9bae-45ea-90c1-12d0d8335767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043875 Jul 28 20:06:08.737684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 560/1124] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:08 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:08.742217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d872bb57-22e8-4043-899f-e72ae2b8de6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:08.744355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d872bb57-22e8-4043-899f-e72ae2b8de6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:08.749877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d872bb57-22e8-4043-899f-e72ae2b8de6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:08.750319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d872bb57-22e8-4043-899f-e72ae2b8de6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:08.752093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d872bb57-22e8-4043-899f-e72ae2b8de6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:08.752522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d872bb57-22e8-4043-899f-e72ae2b8de6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:08.931882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d872bb57-22e8-4043-899f-e72ae2b8de6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193171 Jul 28 20:06:08.932429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 561/1125] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:09.712445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-805dc6c5-e07e-4724-856a-f15839d37123 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:09.713143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-805dc6c5-e07e-4724-856a-f15839d37123 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:09.720306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-805dc6c5-e07e-4724-856a-f15839d37123 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:09.720768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-805dc6c5-e07e-4724-856a-f15839d37123 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:09.721519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-805dc6c5-e07e-4724-856a-f15839d37123 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:09.721934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-805dc6c5-e07e-4724-856a-f15839d37123 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:09.861293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-805dc6c5-e07e-4724-856a-f15839d37123 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:09.868714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-805dc6c5-e07e-4724-856a-f15839d37123 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.160023 Jul 28 20:06:09.869262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 562/1126] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:09 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:09.873898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c2eda5d3-9761-4fb0-904f-cb036bfb2e2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:09.876021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c2eda5d3-9761-4fb0-904f-cb036bfb2e2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:09.881657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2eda5d3-9761-4fb0-904f-cb036bfb2e2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:09.882163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2eda5d3-9761-4fb0-904f-cb036bfb2e2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:09.883043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2eda5d3-9761-4fb0-904f-cb036bfb2e2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:09.883698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2eda5d3-9761-4fb0-904f-cb036bfb2e2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:09.913152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c2eda5d3-9761-4fb0-904f-cb036bfb2e2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 Jul 28 20:06:09.913687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 563/1127] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:09 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:09.943351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f6066d62-58ed-42d3-9eb7-3c7d30d5fa18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:09.945471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f6066d62-58ed-42d3-9eb7-3c7d30d5fa18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:09.951433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6066d62-58ed-42d3-9eb7-3c7d30d5fa18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:09.951873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6066d62-58ed-42d3-9eb7-3c7d30d5fa18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:09.952648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6066d62-58ed-42d3-9eb7-3c7d30d5fa18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:09.953071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6066d62-58ed-42d3-9eb7-3c7d30d5fa18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:09.981746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f6066d62-58ed-42d3-9eb7-3c7d30d5fa18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042162 Jul 28 20:06:09.982212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 564/1128] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:09 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:06:10.890104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8fe172f1-370e-460d-a000-ed8aa20597d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:10.890789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8fe172f1-370e-460d-a000-ed8aa20597d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:10.897925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8fe172f1-370e-460d-a000-ed8aa20597d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:10.898370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8fe172f1-370e-460d-a000-ed8aa20597d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:10.899125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8fe172f1-370e-460d-a000-ed8aa20597d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:10.899559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8fe172f1-370e-460d-a000-ed8aa20597d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:11.028345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8fe172f1-370e-460d-a000-ed8aa20597d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:11.037211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8fe172f1-370e-460d-a000-ed8aa20597d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151034 Jul 28 20:06:11.037766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 565/1129] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:10 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:11.042269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3924aa23-9aa5-4295-a2f8-c18129f9b995 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:11.044353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3924aa23-9aa5-4295-a2f8-c18129f9b995 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:11.049676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:11.050518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3924aa23-9aa5-4295-a2f8-c18129f9b995 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:11.050967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3924aa23-9aa5-4295-a2f8-c18129f9b995 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:11.051761 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3924aa23-9aa5-4295-a2f8-c18129f9b995 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:11.052189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3924aa23-9aa5-4295-a2f8-c18129f9b995 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:11.080930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3924aa23-9aa5-4295-a2f8-c18129f9b995 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Jul 28 20:06:11.081493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 566/1130] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:11 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:11.082456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=52 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:11.085883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-65ee75d3-b423-4917-aae5-ea92ef7a0817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:11.087935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-65ee75d3-b423-4917-aae5-ea92ef7a0817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:11.093487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65ee75d3-b423-4917-aae5-ea92ef7a0817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:11.093922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65ee75d3-b423-4917-aae5-ea92ef7a0817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:11.095251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65ee75d3-b423-4917-aae5-ea92ef7a0817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:11.095675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65ee75d3-b423-4917-aae5-ea92ef7a0817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:11.124144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-65ee75d3-b423-4917-aae5-ea92ef7a0817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041683 Jul 28 20:06:11.124709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 567/1131] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:12.058493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dfa4147e-c26b-4673-8954-31382478d92b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:12.059119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dfa4147e-c26b-4673-8954-31382478d92b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:12.065781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dfa4147e-c26b-4673-8954-31382478d92b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:12.066167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dfa4147e-c26b-4673-8954-31382478d92b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:12.066920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dfa4147e-c26b-4673-8954-31382478d92b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:12.067353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dfa4147e-c26b-4673-8954-31382478d92b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:12.071319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:12.399644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dfa4147e-c26b-4673-8954-31382478d92b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:12.407401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dfa4147e-c26b-4673-8954-31382478d92b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.352772 Jul 28 20:06:12.407942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 568/1132] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:12 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:12.412423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-809ff99d-1de4-4ae5-bfe4-f034dcde5224 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:12.414583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-809ff99d-1de4-4ae5-bfe4-f034dcde5224 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:12.420134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-809ff99d-1de4-4ae5-bfe4-f034dcde5224 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:12.420611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-809ff99d-1de4-4ae5-bfe4-f034dcde5224 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:12.421373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-809ff99d-1de4-4ae5-bfe4-f034dcde5224 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:12.421806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-809ff99d-1de4-4ae5-bfe4-f034dcde5224 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:12.451053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-809ff99d-1de4-4ae5-bfe4-f034dcde5224 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042140 Jul 28 20:06:12.451591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 569/1133] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:12 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:12.456152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5db4933a-5d17-4ba2-833e-d2a46ef96b61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:12.458204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5db4933a-5d17-4ba2-833e-d2a46ef96b61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:12.463756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5db4933a-5d17-4ba2-833e-d2a46ef96b61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:12.464205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5db4933a-5d17-4ba2-833e-d2a46ef96b61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:12.465022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5db4933a-5d17-4ba2-833e-d2a46ef96b61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:12.465454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5db4933a-5d17-4ba2-833e-d2a46ef96b61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:12.493754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5db4933a-5d17-4ba2-833e-d2a46ef96b61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 Jul 28 20:06:12.494309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 570/1134] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:13.429398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d37264d7-dfa2-4789-9781-caa2db856211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:13.430024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d37264d7-dfa2-4789-9781-caa2db856211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:13.436366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d37264d7-dfa2-4789-9781-caa2db856211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:13.436829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d37264d7-dfa2-4789-9781-caa2db856211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:13.437586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d37264d7-dfa2-4789-9781-caa2db856211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:13.438873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d37264d7-dfa2-4789-9781-caa2db856211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:13.575209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d37264d7-dfa2-4789-9781-caa2db856211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:13.582665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d37264d7-dfa2-4789-9781-caa2db856211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.157263 Jul 28 20:06:13.583208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 571/1135] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:13 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:13.587624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4f39e366-b3e3-46d5-a3f3-eb3b96f8ee1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:13.589750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4f39e366-b3e3-46d5-a3f3-eb3b96f8ee1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:13.596048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f39e366-b3e3-46d5-a3f3-eb3b96f8ee1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:13.596490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f39e366-b3e3-46d5-a3f3-eb3b96f8ee1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:13.597265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f39e366-b3e3-46d5-a3f3-eb3b96f8ee1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:13.597693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f39e366-b3e3-46d5-a3f3-eb3b96f8ee1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:13.627348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4f39e366-b3e3-46d5-a3f3-eb3b96f8ee1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043155 Jul 28 20:06:13.627876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 572/1136] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:13 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:13.632250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1b31546b-2cde-4109-a03c-eabc6e602f1d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:13.634324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1b31546b-2cde-4109-a03c-eabc6e602f1d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:13.635933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:13.640985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b31546b-2cde-4109-a03c-eabc6e602f1d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:13.641428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b31546b-2cde-4109-a03c-eabc6e602f1d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:13.642275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b31546b-2cde-4109-a03c-eabc6e602f1d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:13.642703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b31546b-2cde-4109-a03c-eabc6e602f1d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:13.670769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1b31546b-2cde-4109-a03c-eabc6e602f1d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041947 Jul 28 20:06:13.671301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 573/1137] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:13 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:14.603225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ca69ab60-773d-4fd3-83c1-d83a6bc7bef1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:14.603858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ca69ab60-773d-4fd3-83c1-d83a6bc7bef1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:14.611280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca69ab60-773d-4fd3-83c1-d83a6bc7bef1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:14.611749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca69ab60-773d-4fd3-83c1-d83a6bc7bef1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:14.612496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca69ab60-773d-4fd3-83c1-d83a6bc7bef1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:14.612950 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca69ab60-773d-4fd3-83c1-d83a6bc7bef1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:14.746818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ca69ab60-773d-4fd3-83c1-d83a6bc7bef1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:14.754961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ca69ab60-773d-4fd3-83c1-d83a6bc7bef1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155606 Jul 28 20:06:14.755517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 574/1138] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:14.760025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fdab7167-4753-4993-9370-c05b58d2eb30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:14.762161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fdab7167-4753-4993-9370-c05b58d2eb30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:14.768182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdab7167-4753-4993-9370-c05b58d2eb30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:14.768665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdab7167-4753-4993-9370-c05b58d2eb30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:14.769423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdab7167-4753-4993-9370-c05b58d2eb30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:14.769856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdab7167-4753-4993-9370-c05b58d2eb30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:14.799145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fdab7167-4753-4993-9370-c05b58d2eb30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042621 Jul 28 20:06:14.799680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 575/1139] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:14 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:14.804067 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f9c84f6e-525d-41f4-a32b-2c34f280793f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:14.806152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f9c84f6e-525d-41f4-a32b-2c34f280793f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:14.811629 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9c84f6e-525d-41f4-a32b-2c34f280793f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:14.812072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9c84f6e-525d-41f4-a32b-2c34f280793f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:14.813552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9c84f6e-525d-41f4-a32b-2c34f280793f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:14.813973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9c84f6e-525d-41f4-a32b-2c34f280793f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:14.843230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f9c84f6e-525d-41f4-a32b-2c34f280793f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042570 Jul 28 20:06:14.843761 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 576/1140] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:15.775043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-84933364-e379-4084-9b98-23d8183a96da tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:15.775691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-84933364-e379-4084-9b98-23d8183a96da tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:15.784450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84933364-e379-4084-9b98-23d8183a96da tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:15.784926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84933364-e379-4084-9b98-23d8183a96da tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:15.785675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84933364-e379-4084-9b98-23d8183a96da tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:15.786103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84933364-e379-4084-9b98-23d8183a96da tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:15.916004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-84933364-e379-4084-9b98-23d8183a96da tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:15.924282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-84933364-e379-4084-9b98-23d8183a96da tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153115 Jul 28 20:06:15.924869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 577/1141] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:15 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:15.929360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-238344e1-f539-442b-8faa-d08890d6c8b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:15.931470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-238344e1-f539-442b-8faa-d08890d6c8b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:15.937445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-238344e1-f539-442b-8faa-d08890d6c8b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:15.938473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-238344e1-f539-442b-8faa-d08890d6c8b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:15.939257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-238344e1-f539-442b-8faa-d08890d6c8b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:15.939681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-238344e1-f539-442b-8faa-d08890d6c8b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:15.968457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-238344e1-f539-442b-8faa-d08890d6c8b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 Jul 28 20:06:15.969280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 578/1142] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:15 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:15.973651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c48092b5-bd68-4049-800c-dd3138287719 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:15.975718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c48092b5-bd68-4049-800c-dd3138287719 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:15.981321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c48092b5-bd68-4049-800c-dd3138287719 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:15.981768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c48092b5-bd68-4049-800c-dd3138287719 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:15.982558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c48092b5-bd68-4049-800c-dd3138287719 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:15.982982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c48092b5-bd68-4049-800c-dd3138287719 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:16.010790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c48092b5-bd68-4049-800c-dd3138287719 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040468 Jul 28 20:06:16.011247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 579/1143] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:16.946422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-04e123e9-0dc1-43a9-80af-8df4cc05bb3a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:16.947077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-04e123e9-0dc1-43a9-80af-8df4cc05bb3a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:16.954527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04e123e9-0dc1-43a9-80af-8df4cc05bb3a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:16.954981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04e123e9-0dc1-43a9-80af-8df4cc05bb3a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:16.955739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04e123e9-0dc1-43a9-80af-8df4cc05bb3a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:16.956171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04e123e9-0dc1-43a9-80af-8df4cc05bb3a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:17.088009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-04e123e9-0dc1-43a9-80af-8df4cc05bb3a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:17.095492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-04e123e9-0dc1-43a9-80af-8df4cc05bb3a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152975 Jul 28 20:06:17.096049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 580/1144] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:16 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:17.100489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eb0b2385-5568-4bf6-8b75-4d5ebcfbdb61 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:17.102604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eb0b2385-5568-4bf6-8b75-4d5ebcfbdb61 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:17.108434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb0b2385-5568-4bf6-8b75-4d5ebcfbdb61 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:17.108945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb0b2385-5568-4bf6-8b75-4d5ebcfbdb61 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:17.110438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb0b2385-5568-4bf6-8b75-4d5ebcfbdb61 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:17.111084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb0b2385-5568-4bf6-8b75-4d5ebcfbdb61 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:17.139445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eb0b2385-5568-4bf6-8b75-4d5ebcfbdb61 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042428 Jul 28 20:06:17.139975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 581/1145] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:17 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:17.144398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e334bd6e-c439-47cf-a897-e89ba71bff14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:17.146452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e334bd6e-c439-47cf-a897-e89ba71bff14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:17.152228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e334bd6e-c439-47cf-a897-e89ba71bff14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:17.152710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e334bd6e-c439-47cf-a897-e89ba71bff14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:17.153467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e334bd6e-c439-47cf-a897-e89ba71bff14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:17.153893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e334bd6e-c439-47cf-a897-e89ba71bff14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:17.182983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e334bd6e-c439-47cf-a897-e89ba71bff14 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042010 Jul 28 20:06:17.183517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 582/1146] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:18.116640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fb134233-e019-424c-b869-94096fb3bb39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:18.117303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fb134233-e019-424c-b869-94096fb3bb39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:18.123612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb134233-e019-424c-b869-94096fb3bb39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:18.124047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb134233-e019-424c-b869-94096fb3bb39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:18.124811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb134233-e019-424c-b869-94096fb3bb39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:18.125777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb134233-e019-424c-b869-94096fb3bb39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:18.255117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fb134233-e019-424c-b869-94096fb3bb39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:18.264218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fb134233-e019-424c-b869-94096fb3bb39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151357 Jul 28 20:06:18.264838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 583/1147] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:18 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:18.270103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8d398774-b32b-4008-a348-7b664ee153ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:18.272210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8d398774-b32b-4008-a348-7b664ee153ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:18.277999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d398774-b32b-4008-a348-7b664ee153ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:18.278446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d398774-b32b-4008-a348-7b664ee153ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:18.279218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d398774-b32b-4008-a348-7b664ee153ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:18.279633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d398774-b32b-4008-a348-7b664ee153ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:18.303743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:18.308623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8d398774-b32b-4008-a348-7b664ee153ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042799 Jul 28 20:06:18.309169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 584/1148] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:18 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:18.314594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6ee1b4a8-98ef-4a39-bce6-f11d41397a0a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:18.316721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6ee1b4a8-98ef-4a39-bce6-f11d41397a0a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:18.322363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ee1b4a8-98ef-4a39-bce6-f11d41397a0a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:18.322807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ee1b4a8-98ef-4a39-bce6-f11d41397a0a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:18.323561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ee1b4a8-98ef-4a39-bce6-f11d41397a0a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:18.323992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ee1b4a8-98ef-4a39-bce6-f11d41397a0a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:18.353697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6ee1b4a8-98ef-4a39-bce6-f11d41397a0a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 Jul 28 20:06:18.354248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 585/1149] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:19.290614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5c76bb9f-2364-45fa-bfc2-4e88a633bc0f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:19.291406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5c76bb9f-2364-45fa-bfc2-4e88a633bc0f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:19.298356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c76bb9f-2364-45fa-bfc2-4e88a633bc0f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:19.298804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c76bb9f-2364-45fa-bfc2-4e88a633bc0f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:19.299559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c76bb9f-2364-45fa-bfc2-4e88a633bc0f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:19.299989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c76bb9f-2364-45fa-bfc2-4e88a633bc0f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:19.433746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5c76bb9f-2364-45fa-bfc2-4e88a633bc0f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:19.442054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5c76bb9f-2364-45fa-bfc2-4e88a633bc0f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155333 Jul 28 20:06:19.442599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 586/1150] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:19 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:19.447039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2ac03bc4-eb5e-4d5c-b68f-d8ec51270e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:19.449164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2ac03bc4-eb5e-4d5c-b68f-d8ec51270e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:19.455011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2ac03bc4-eb5e-4d5c-b68f-d8ec51270e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:19.455450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2ac03bc4-eb5e-4d5c-b68f-d8ec51270e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:19.456197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2ac03bc4-eb5e-4d5c-b68f-d8ec51270e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:19.456653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2ac03bc4-eb5e-4d5c-b68f-d8ec51270e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:19.484042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2ac03bc4-eb5e-4d5c-b68f-d8ec51270e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040468 Jul 28 20:06:19.485117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 587/1151] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:19 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:19.489462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-17b78514-afc1-4139-a067-f87885bc19aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:19.491490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-17b78514-afc1-4139-a067-f87885bc19aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:19.497003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17b78514-afc1-4139-a067-f87885bc19aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:19.497458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17b78514-afc1-4139-a067-f87885bc19aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:19.498272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17b78514-afc1-4139-a067-f87885bc19aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:19.498697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17b78514-afc1-4139-a067-f87885bc19aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:19.525900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-17b78514-afc1-4139-a067-f87885bc19aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039842 Jul 28 20:06:19.526432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 588/1152] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:20.463311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cafe3daa-e2cc-48d2-85e9-fccc03e88506 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:20.463978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cafe3daa-e2cc-48d2-85e9-fccc03e88506 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:20.471652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cafe3daa-e2cc-48d2-85e9-fccc03e88506 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:20.472100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cafe3daa-e2cc-48d2-85e9-fccc03e88506 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:20.472900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cafe3daa-e2cc-48d2-85e9-fccc03e88506 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:20.473329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cafe3daa-e2cc-48d2-85e9-fccc03e88506 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:20.606502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cafe3daa-e2cc-48d2-85e9-fccc03e88506 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:20.614600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cafe3daa-e2cc-48d2-85e9-fccc03e88506 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155182 Jul 28 20:06:20.615146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 589/1153] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:20 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:20.619591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fd0bb529-bf9b-4efa-80b7-055acacbd0ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:20.621692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fd0bb529-bf9b-4efa-80b7-055acacbd0ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:20.627448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd0bb529-bf9b-4efa-80b7-055acacbd0ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:20.627888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd0bb529-bf9b-4efa-80b7-055acacbd0ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:20.628663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd0bb529-bf9b-4efa-80b7-055acacbd0ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:20.629088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd0bb529-bf9b-4efa-80b7-055acacbd0ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:20.658120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fd0bb529-bf9b-4efa-80b7-055acacbd0ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042002 Jul 28 20:06:20.658652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 590/1154] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:20 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:20.663086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a524367f-cf8d-406f-85d4-c5314ef58cc9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:20.665153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a524367f-cf8d-406f-85d4-c5314ef58cc9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:20.670604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a524367f-cf8d-406f-85d4-c5314ef58cc9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:20.671043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a524367f-cf8d-406f-85d4-c5314ef58cc9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:20.671959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a524367f-cf8d-406f-85d4-c5314ef58cc9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:20.672402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a524367f-cf8d-406f-85d4-c5314ef58cc9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:20.699601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a524367f-cf8d-406f-85d4-c5314ef58cc9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040000 Jul 28 20:06:20.700136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 591/1155] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:20 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:21.635829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-12c10e74-a272-45f0-8f5e-5a240b6a79a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:21.636510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-12c10e74-a272-45f0-8f5e-5a240b6a79a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:21.643520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12c10e74-a272-45f0-8f5e-5a240b6a79a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:21.643961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12c10e74-a272-45f0-8f5e-5a240b6a79a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:21.645073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12c10e74-a272-45f0-8f5e-5a240b6a79a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:21.645509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12c10e74-a272-45f0-8f5e-5a240b6a79a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:21.782961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-12c10e74-a272-45f0-8f5e-5a240b6a79a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:21.790365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-12c10e74-a272-45f0-8f5e-5a240b6a79a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.158523 Jul 28 20:06:21.790909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 592/1156] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:21 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:21.795342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5642772b-78e8-4a2b-9196-ac1ed2333932 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:21.798260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5642772b-78e8-4a2b-9196-ac1ed2333932 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:21.804066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5642772b-78e8-4a2b-9196-ac1ed2333932 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:21.804508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5642772b-78e8-4a2b-9196-ac1ed2333932 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:21.805277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5642772b-78e8-4a2b-9196-ac1ed2333932 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:21.805701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5642772b-78e8-4a2b-9196-ac1ed2333932 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:21.834534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5642772b-78e8-4a2b-9196-ac1ed2333932 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042631 Jul 28 20:06:21.835072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 593/1157] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:21 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:21.839421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d626782e-eea2-468d-8f0a-f74651802f1f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:21.841547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d626782e-eea2-468d-8f0a-f74651802f1f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:21.847691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d626782e-eea2-468d-8f0a-f74651802f1f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:21.848129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d626782e-eea2-468d-8f0a-f74651802f1f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:21.848901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d626782e-eea2-468d-8f0a-f74651802f1f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:21.849328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d626782e-eea2-468d-8f0a-f74651802f1f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:21.878054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d626782e-eea2-468d-8f0a-f74651802f1f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042017 Jul 28 20:06:21.878581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 594/1158] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:22.812178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-767c1acb-3207-4a45-b51f-8692b457a06e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:22.813540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-767c1acb-3207-4a45-b51f-8692b457a06e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:22.820088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-767c1acb-3207-4a45-b51f-8692b457a06e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:22.820563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-767c1acb-3207-4a45-b51f-8692b457a06e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:22.821324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-767c1acb-3207-4a45-b51f-8692b457a06e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:22.821758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-767c1acb-3207-4a45-b51f-8692b457a06e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:22.954544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-767c1acb-3207-4a45-b51f-8692b457a06e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:22.962044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-767c1acb-3207-4a45-b51f-8692b457a06e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153779 Jul 28 20:06:22.962609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 595/1159] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:22 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:22.967088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-88db3edf-a508-46c4-a328-ee244f051a93 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:22.969261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-88db3edf-a508-46c4-a328-ee244f051a93 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:22.974972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88db3edf-a508-46c4-a328-ee244f051a93 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:22.975423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88db3edf-a508-46c4-a328-ee244f051a93 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:22.976435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88db3edf-a508-46c4-a328-ee244f051a93 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:22.976901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88db3edf-a508-46c4-a328-ee244f051a93 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:23.010573 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-88db3edf-a508-46c4-a328-ee244f051a93 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046970 Jul 28 20:06:23.011111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 596/1160] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:22 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:23.015489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dba2580d-a5f2-4db1-acdb-69f01865f759 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:23.017579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dba2580d-a5f2-4db1-acdb-69f01865f759 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:23.023094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dba2580d-a5f2-4db1-acdb-69f01865f759 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:23.023543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dba2580d-a5f2-4db1-acdb-69f01865f759 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:23.024291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dba2580d-a5f2-4db1-acdb-69f01865f759 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:23.024775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dba2580d-a5f2-4db1-acdb-69f01865f759 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:23.052478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dba2580d-a5f2-4db1-acdb-69f01865f759 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040407 Jul 28 20:06:23.053044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 597/1161] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:23.983144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-65b956ce-6149-4ed7-b987-23f34fe3cea6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:23.983774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-65b956ce-6149-4ed7-b987-23f34fe3cea6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:23.991263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65b956ce-6149-4ed7-b987-23f34fe3cea6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:23.991711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65b956ce-6149-4ed7-b987-23f34fe3cea6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:23.992470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65b956ce-6149-4ed7-b987-23f34fe3cea6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:23.992926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65b956ce-6149-4ed7-b987-23f34fe3cea6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:24.121725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-65b956ce-6149-4ed7-b987-23f34fe3cea6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:24.129678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-65b956ce-6149-4ed7-b987-23f34fe3cea6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.150400 Jul 28 20:06:24.130220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 598/1162] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:23 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:24.134640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f193aa12-541b-40d9-833f-5cb07472b4f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:24.136754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f193aa12-541b-40d9-833f-5cb07472b4f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:24.143065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f193aa12-541b-40d9-833f-5cb07472b4f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:24.143504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f193aa12-541b-40d9-833f-5cb07472b4f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:24.144250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f193aa12-541b-40d9-833f-5cb07472b4f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:24.144714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f193aa12-541b-40d9-833f-5cb07472b4f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:24.174291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f193aa12-541b-40d9-833f-5cb07472b4f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043019 Jul 28 20:06:24.174862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 599/1163] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:24.179472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7548cdab-2329-4b99-88c3-8eb754cddd72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:24.181749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7548cdab-2329-4b99-88c3-8eb754cddd72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:24.188630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7548cdab-2329-4b99-88c3-8eb754cddd72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:24.189084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7548cdab-2329-4b99-88c3-8eb754cddd72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:24.189896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7548cdab-2329-4b99-88c3-8eb754cddd72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:24.190814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7548cdab-2329-4b99-88c3-8eb754cddd72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:24.219257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7548cdab-2329-4b99-88c3-8eb754cddd72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 Jul 28 20:06:24.219803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 600/1164] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:25.151449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-49a479a3-11f7-48fd-8dda-84826717da52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:25.152158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-49a479a3-11f7-48fd-8dda-84826717da52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:25.159952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49a479a3-11f7-48fd-8dda-84826717da52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:25.160842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49a479a3-11f7-48fd-8dda-84826717da52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:25.161618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49a479a3-11f7-48fd-8dda-84826717da52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:25.162050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49a479a3-11f7-48fd-8dda-84826717da52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:25.180266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:25.295794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-49a479a3-11f7-48fd-8dda-84826717da52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:25.303821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-49a479a3-11f7-48fd-8dda-84826717da52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.156440 Jul 28 20:06:25.304370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 601/1165] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:25 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:25.309030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c8b1b70e-4ba5-4bca-a94f-826902dffdbd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:25.311134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c8b1b70e-4ba5-4bca-a94f-826902dffdbd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:25.317361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8b1b70e-4ba5-4bca-a94f-826902dffdbd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:25.317807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8b1b70e-4ba5-4bca-a94f-826902dffdbd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:25.318594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8b1b70e-4ba5-4bca-a94f-826902dffdbd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:25.319053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8b1b70e-4ba5-4bca-a94f-826902dffdbd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:25.351539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c8b1b70e-4ba5-4bca-a94f-826902dffdbd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046065 Jul 28 20:06:25.352079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 602/1166] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:25.356689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3ddb9d25-37e9-41fa-ab02-eedae3ceac3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:25.358836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3ddb9d25-37e9-41fa-ab02-eedae3ceac3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:25.365283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ddb9d25-37e9-41fa-ab02-eedae3ceac3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:25.365710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ddb9d25-37e9-41fa-ab02-eedae3ceac3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:25.366467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ddb9d25-37e9-41fa-ab02-eedae3ceac3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:25.367118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ddb9d25-37e9-41fa-ab02-eedae3ceac3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:25.397063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3ddb9d25-37e9-41fa-ab02-eedae3ceac3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Jul 28 20:06:25.397611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 603/1167] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:26.325037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a9b219a3-82c0-4e83-8ada-6d71752b5a3b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:26.325669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a9b219a3-82c0-4e83-8ada-6d71752b5a3b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:26.332262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9b219a3-82c0-4e83-8ada-6d71752b5a3b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:26.332748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9b219a3-82c0-4e83-8ada-6d71752b5a3b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:26.333500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9b219a3-82c0-4e83-8ada-6d71752b5a3b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:26.333923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9b219a3-82c0-4e83-8ada-6d71752b5a3b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:26.460237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a9b219a3-82c0-4e83-8ada-6d71752b5a3b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:26.467564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a9b219a3-82c0-4e83-8ada-6d71752b5a3b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.146420 Jul 28 20:06:26.468112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 604/1168] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:26 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:26.473144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0597c424-ac3d-45c3-a9b6-18b4a3f9f71e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:26.475275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0597c424-ac3d-45c3-a9b6-18b4a3f9f71e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:26.480815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0597c424-ac3d-45c3-a9b6-18b4a3f9f71e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:26.481262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0597c424-ac3d-45c3-a9b6-18b4a3f9f71e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:26.482005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0597c424-ac3d-45c3-a9b6-18b4a3f9f71e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:26.482429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0597c424-ac3d-45c3-a9b6-18b4a3f9f71e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:26.510794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0597c424-ac3d-45c3-a9b6-18b4a3f9f71e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041109 Jul 28 20:06:26.511331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 605/1169] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:26.515651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a095b9fd-f240-493c-813e-70e6e069d52f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:26.517716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a095b9fd-f240-493c-813e-70e6e069d52f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:26.523102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a095b9fd-f240-493c-813e-70e6e069d52f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:26.523543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a095b9fd-f240-493c-813e-70e6e069d52f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:26.524282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a095b9fd-f240-493c-813e-70e6e069d52f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:26.524747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a095b9fd-f240-493c-813e-70e6e069d52f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:26.554184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a095b9fd-f240-493c-813e-70e6e069d52f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041904 Jul 28 20:06:26.554707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 606/1170] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:27.490030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1372d467-8eb3-4f82-a463-e761ec5c0108 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:27.490679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1372d467-8eb3-4f82-a463-e761ec5c0108 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:27.496994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1372d467-8eb3-4f82-a463-e761ec5c0108 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:27.497435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1372d467-8eb3-4f82-a463-e761ec5c0108 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:27.498176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1372d467-8eb3-4f82-a463-e761ec5c0108 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:27.498604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1372d467-8eb3-4f82-a463-e761ec5c0108 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:27.636581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1372d467-8eb3-4f82-a463-e761ec5c0108 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:27.644017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1372d467-8eb3-4f82-a463-e761ec5c0108 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.157877 Jul 28 20:06:27.644608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 607/1171] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:27 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:27.649322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2d07b9a6-5923-436b-bad6-d9efe4809d30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:27.651462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2d07b9a6-5923-436b-bad6-d9efe4809d30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:27.657425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d07b9a6-5923-436b-bad6-d9efe4809d30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:27.657871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d07b9a6-5923-436b-bad6-d9efe4809d30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:27.658627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d07b9a6-5923-436b-bad6-d9efe4809d30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:27.659054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d07b9a6-5923-436b-bad6-d9efe4809d30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:27.687997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2d07b9a6-5923-436b-bad6-d9efe4809d30 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041737 Jul 28 20:06:27.688665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 608/1172] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:27 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:27.693232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d7823283-22a8-44d7-a85d-bbccaaa9d139 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:27.695272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d7823283-22a8-44d7-a85d-bbccaaa9d139 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:27.700809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7823283-22a8-44d7-a85d-bbccaaa9d139 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:27.701255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7823283-22a8-44d7-a85d-bbccaaa9d139 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:27.702007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7823283-22a8-44d7-a85d-bbccaaa9d139 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:27.702437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7823283-22a8-44d7-a85d-bbccaaa9d139 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:27.730882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d7823283-22a8-44d7-a85d-bbccaaa9d139 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041191 Jul 28 20:06:27.731428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 609/1173] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:27 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:28.666013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f2f1a8d4-8075-49c3-9b7e-20c7df085976 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:28.666695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f2f1a8d4-8075-49c3-9b7e-20c7df085976 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:28.674233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2f1a8d4-8075-49c3-9b7e-20c7df085976 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:28.674680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2f1a8d4-8075-49c3-9b7e-20c7df085976 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:28.675430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2f1a8d4-8075-49c3-9b7e-20c7df085976 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:28.675860 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2f1a8d4-8075-49c3-9b7e-20c7df085976 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:28.813441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f2f1a8d4-8075-49c3-9b7e-20c7df085976 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:28.820798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f2f1a8d4-8075-49c3-9b7e-20c7df085976 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.158635 Jul 28 20:06:28.821405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 610/1174] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:28 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:28.825854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ff1b25ee-a8a2-47f6-9343-2f10b18ddc23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:28.828530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ff1b25ee-a8a2-47f6-9343-2f10b18ddc23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:28.834417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff1b25ee-a8a2-47f6-9343-2f10b18ddc23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:28.834857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff1b25ee-a8a2-47f6-9343-2f10b18ddc23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:28.835601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff1b25ee-a8a2-47f6-9343-2f10b18ddc23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:28.836024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff1b25ee-a8a2-47f6-9343-2f10b18ddc23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:28.864646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ff1b25ee-a8a2-47f6-9343-2f10b18ddc23 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042227 Jul 28 20:06:28.865183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 611/1175] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:28 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:28.869519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f641382a-3065-464c-98fc-7f457e9ae3aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:28.871552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f641382a-3065-464c-98fc-7f457e9ae3aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:28.877746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f641382a-3065-464c-98fc-7f457e9ae3aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:28.878180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f641382a-3065-464c-98fc-7f457e9ae3aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:28.878920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f641382a-3065-464c-98fc-7f457e9ae3aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:28.879346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f641382a-3065-464c-98fc-7f457e9ae3aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:28.907768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f641382a-3065-464c-98fc-7f457e9ae3aa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 Jul 28 20:06:28.908299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 612/1176] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:29.842662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f3655e1-8fea-4718-bb9a-10c8dd0f12e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:29.844444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f3655e1-8fea-4718-bb9a-10c8dd0f12e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:29.850966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f3655e1-8fea-4718-bb9a-10c8dd0f12e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:29.851407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f3655e1-8fea-4718-bb9a-10c8dd0f12e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:29.852285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f3655e1-8fea-4718-bb9a-10c8dd0f12e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:29.852738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f3655e1-8fea-4718-bb9a-10c8dd0f12e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:29.984471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2f3655e1-8fea-4718-bb9a-10c8dd0f12e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:29.991908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f3655e1-8fea-4718-bb9a-10c8dd0f12e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153118 Jul 28 20:06:29.992496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 613/1177] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:29 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:29.996942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-84f0f0c6-c63b-4b0f-8859-9012271adb6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:29.999062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-84f0f0c6-c63b-4b0f-8859-9012271adb6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:30.005290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84f0f0c6-c63b-4b0f-8859-9012271adb6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:30.005726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84f0f0c6-c63b-4b0f-8859-9012271adb6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:30.006468 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84f0f0c6-c63b-4b0f-8859-9012271adb6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:30.006892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84f0f0c6-c63b-4b0f-8859-9012271adb6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:30.035492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-84f0f0c6-c63b-4b0f-8859-9012271adb6c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Jul 28 20:06:30.035943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 614/1178] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:29 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:30.040275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1464253b-da52-454b-810f-e3aa03688474 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:30.042322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1464253b-da52-454b-810f-e3aa03688474 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:30.048600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1464253b-da52-454b-810f-e3aa03688474 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:30.049048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1464253b-da52-454b-810f-e3aa03688474 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:30.049794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1464253b-da52-454b-810f-e3aa03688474 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:30.050215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1464253b-da52-454b-810f-e3aa03688474 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:30.077253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1464253b-da52-454b-810f-e3aa03688474 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040367 Jul 28 20:06:30.077811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 615/1179] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:31.013907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b49d779a-c704-4c1c-95f2-323f4f1e8bf7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:31.014570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b49d779a-c704-4c1c-95f2-323f4f1e8bf7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:31.022150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b49d779a-c704-4c1c-95f2-323f4f1e8bf7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:31.022597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b49d779a-c704-4c1c-95f2-323f4f1e8bf7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:31.023350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b49d779a-c704-4c1c-95f2-323f4f1e8bf7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:31.023781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b49d779a-c704-4c1c-95f2-323f4f1e8bf7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:31.170198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b49d779a-c704-4c1c-95f2-323f4f1e8bf7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:31.179160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b49d779a-c704-4c1c-95f2-323f4f1e8bf7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.168992 Jul 28 20:06:31.179773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 616/1180] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:31 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:31.184562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ef433a34-182d-4a48-8b32-b11ccae971fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:31.186739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ef433a34-182d-4a48-8b32-b11ccae971fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:31.193239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef433a34-182d-4a48-8b32-b11ccae971fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:31.193737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef433a34-182d-4a48-8b32-b11ccae971fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:31.194506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef433a34-182d-4a48-8b32-b11ccae971fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:31.194942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef433a34-182d-4a48-8b32-b11ccae971fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:31.225456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ef433a34-182d-4a48-8b32-b11ccae971fc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Jul 28 20:06:31.226006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 617/1181] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:31.230554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2eb2acc9-4cc8-4988-9c6d-b9d194591583 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:31.232726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2eb2acc9-4cc8-4988-9c6d-b9d194591583 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:31.238666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2eb2acc9-4cc8-4988-9c6d-b9d194591583 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:31.239115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2eb2acc9-4cc8-4988-9c6d-b9d194591583 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:31.239870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2eb2acc9-4cc8-4988-9c6d-b9d194591583 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:31.240305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2eb2acc9-4cc8-4988-9c6d-b9d194591583 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:31.243996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:31.270713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2eb2acc9-4cc8-4988-9c6d-b9d194591583 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Jul 28 20:06:31.271193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 618/1182] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:32.204888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f098b6e4-421a-4918-acb7-802bfdc8ef9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:32.205496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f098b6e4-421a-4918-acb7-802bfdc8ef9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:32.211934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f098b6e4-421a-4918-acb7-802bfdc8ef9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:32.212371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f098b6e4-421a-4918-acb7-802bfdc8ef9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:32.213151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f098b6e4-421a-4918-acb7-802bfdc8ef9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:32.213579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f098b6e4-421a-4918-acb7-802bfdc8ef9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:32.345628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f098b6e4-421a-4918-acb7-802bfdc8ef9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:32.353037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f098b6e4-421a-4918-acb7-802bfdc8ef9a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152061 Jul 28 20:06:32.353585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 619/1183] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:32 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:32.358193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cfd84039-d16f-449a-8c40-2746b5e50eef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:32.360905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cfd84039-d16f-449a-8c40-2746b5e50eef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:32.366738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfd84039-d16f-449a-8c40-2746b5e50eef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:32.367175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfd84039-d16f-449a-8c40-2746b5e50eef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:32.367951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfd84039-d16f-449a-8c40-2746b5e50eef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:32.368375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfd84039-d16f-449a-8c40-2746b5e50eef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:32.396236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cfd84039-d16f-449a-8c40-2746b5e50eef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 Jul 28 20:06:32.396803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 620/1184] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:32.401173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2d6cf3ad-ebcc-4c03-b615-ede6f96928e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:32.403233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2d6cf3ad-ebcc-4c03-b615-ede6f96928e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:32.409639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d6cf3ad-ebcc-4c03-b615-ede6f96928e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:32.410081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d6cf3ad-ebcc-4c03-b615-ede6f96928e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:32.410823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d6cf3ad-ebcc-4c03-b615-ede6f96928e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:32.411247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d6cf3ad-ebcc-4c03-b615-ede6f96928e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:32.438829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2d6cf3ad-ebcc-4c03-b615-ede6f96928e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 Jul 28 20:06:32.439298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 621/1185] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:33.376347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-06392405-98be-441d-b95e-fc5060202e22 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:33.377089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-06392405-98be-441d-b95e-fc5060202e22 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:33.383440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06392405-98be-441d-b95e-fc5060202e22 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:33.383892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06392405-98be-441d-b95e-fc5060202e22 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:33.384690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06392405-98be-441d-b95e-fc5060202e22 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:33.385161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06392405-98be-441d-b95e-fc5060202e22 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:33.523076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-06392405-98be-441d-b95e-fc5060202e22 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:33.531521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-06392405-98be-441d-b95e-fc5060202e22 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.159356 Jul 28 20:06:33.532089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 622/1186] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:33 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:33.536748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-206b617b-dc19-44ff-84a7-1b4029f8b55e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:33.538874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-206b617b-dc19-44ff-84a7-1b4029f8b55e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:33.540622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:33.545805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-206b617b-dc19-44ff-84a7-1b4029f8b55e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:33.546254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-206b617b-dc19-44ff-84a7-1b4029f8b55e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:33.547136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-206b617b-dc19-44ff-84a7-1b4029f8b55e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:33.547581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-206b617b-dc19-44ff-84a7-1b4029f8b55e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:33.576010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-206b617b-dc19-44ff-84a7-1b4029f8b55e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042811 Jul 28 20:06:33.576580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 623/1187] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:33.581554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e5a9addc-a5cb-45e0-9719-ab2d8f8b527f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:33.583615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e5a9addc-a5cb-45e0-9719-ab2d8f8b527f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:33.589222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a9addc-a5cb-45e0-9719-ab2d8f8b527f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:33.589675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a9addc-a5cb-45e0-9719-ab2d8f8b527f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:33.590429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a9addc-a5cb-45e0-9719-ab2d8f8b527f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:33.590875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a9addc-a5cb-45e0-9719-ab2d8f8b527f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:33.618866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e5a9addc-a5cb-45e0-9719-ab2d8f8b527f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Jul 28 20:06:33.619404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 624/1188] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:34.553353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9302c807-3be3-4a21-af82-1cf1fe34f31c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:34.554032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9302c807-3be3-4a21-af82-1cf1fe34f31c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:34.560422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9302c807-3be3-4a21-af82-1cf1fe34f31c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:34.560899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9302c807-3be3-4a21-af82-1cf1fe34f31c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:34.561650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9302c807-3be3-4a21-af82-1cf1fe34f31c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:34.562599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9302c807-3be3-4a21-af82-1cf1fe34f31c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:34.695178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9302c807-3be3-4a21-af82-1cf1fe34f31c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:34.703077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9302c807-3be3-4a21-af82-1cf1fe34f31c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153542 Jul 28 20:06:34.703675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 625/1189] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:34 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:34.708120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b5bdd159-6bce-4029-bb42-3e40948e2ac8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:34.710234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b5bdd159-6bce-4029-bb42-3e40948e2ac8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:34.715837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5bdd159-6bce-4029-bb42-3e40948e2ac8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:34.716273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5bdd159-6bce-4029-bb42-3e40948e2ac8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:34.717054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5bdd159-6bce-4029-bb42-3e40948e2ac8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:34.717475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5bdd159-6bce-4029-bb42-3e40948e2ac8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:34.746567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b5bdd159-6bce-4029-bb42-3e40948e2ac8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Jul 28 20:06:34.747104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 626/1190] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:34 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:34.752021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-29c2a546-01a5-458f-b86e-d989e77279ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:34.754195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-29c2a546-01a5-458f-b86e-d989e77279ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:34.759787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29c2a546-01a5-458f-b86e-d989e77279ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:34.760227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29c2a546-01a5-458f-b86e-d989e77279ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:34.761016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29c2a546-01a5-458f-b86e-d989e77279ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:34.761436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29c2a546-01a5-458f-b86e-d989e77279ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:34.789898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-29c2a546-01a5-458f-b86e-d989e77279ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 Jul 28 20:06:34.790424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 627/1191] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:35.724643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-28f2b46c-0905-45e5-b9df-77a44d56d7fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:35.725325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-28f2b46c-0905-45e5-b9df-77a44d56d7fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:35.732574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28f2b46c-0905-45e5-b9df-77a44d56d7fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:35.733027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28f2b46c-0905-45e5-b9df-77a44d56d7fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:35.733830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28f2b46c-0905-45e5-b9df-77a44d56d7fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:35.734368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28f2b46c-0905-45e5-b9df-77a44d56d7fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:35.866423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-28f2b46c-0905-45e5-b9df-77a44d56d7fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:35.873905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-28f2b46c-0905-45e5-b9df-77a44d56d7fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153156 Jul 28 20:06:35.875269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 628/1192] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:35 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:35.879672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b0cfd8a3-90fb-4f1b-89fe-fb36492222cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:35.881819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b0cfd8a3-90fb-4f1b-89fe-fb36492222cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:35.887443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b0cfd8a3-90fb-4f1b-89fe-fb36492222cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:35.887889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b0cfd8a3-90fb-4f1b-89fe-fb36492222cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:35.888683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b0cfd8a3-90fb-4f1b-89fe-fb36492222cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:35.889122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b0cfd8a3-90fb-4f1b-89fe-fb36492222cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:35.919307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b0cfd8a3-90fb-4f1b-89fe-fb36492222cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043259 Jul 28 20:06:35.919853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 629/1193] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:35 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:35.924418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f1de95f0-70cd-4496-a509-08019c00e4ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:35.926514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f1de95f0-70cd-4496-a509-08019c00e4ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:35.932109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f1de95f0-70cd-4496-a509-08019c00e4ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:35.932580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f1de95f0-70cd-4496-a509-08019c00e4ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:35.933343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f1de95f0-70cd-4496-a509-08019c00e4ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:35.933795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f1de95f0-70cd-4496-a509-08019c00e4ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:35.963603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f1de95f0-70cd-4496-a509-08019c00e4ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042758 Jul 28 20:06:35.964150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 630/1194] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:36.895769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-59dd8b66-dfae-4112-9b15-5df7aa92a376 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:36.896404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-59dd8b66-dfae-4112-9b15-5df7aa92a376 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:36.902859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-59dd8b66-dfae-4112-9b15-5df7aa92a376 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:36.903300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-59dd8b66-dfae-4112-9b15-5df7aa92a376 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:36.904042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-59dd8b66-dfae-4112-9b15-5df7aa92a376 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:36.904469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-59dd8b66-dfae-4112-9b15-5df7aa92a376 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:37.041581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-59dd8b66-dfae-4112-9b15-5df7aa92a376 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:37.049608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-59dd8b66-dfae-4112-9b15-5df7aa92a376 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.157684 Jul 28 20:06:37.050163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 631/1195] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:36 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:37.054650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6bea9a63-0fbe-4e10-a65d-b702078c3a0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:37.056765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6bea9a63-0fbe-4e10-a65d-b702078c3a0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:37.062922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6bea9a63-0fbe-4e10-a65d-b702078c3a0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:37.063356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6bea9a63-0fbe-4e10-a65d-b702078c3a0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:37.064104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6bea9a63-0fbe-4e10-a65d-b702078c3a0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:37.064522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6bea9a63-0fbe-4e10-a65d-b702078c3a0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:37.092997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6bea9a63-0fbe-4e10-a65d-b702078c3a0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041800 Jul 28 20:06:37.093756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 632/1196] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:37 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:37.098171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1de1b5fc-fa49-4ebf-ae9d-3f14e0c3e713 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:37.100231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1de1b5fc-fa49-4ebf-ae9d-3f14e0c3e713 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:37.105807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1de1b5fc-fa49-4ebf-ae9d-3f14e0c3e713 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:37.106260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1de1b5fc-fa49-4ebf-ae9d-3f14e0c3e713 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:37.107009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1de1b5fc-fa49-4ebf-ae9d-3f14e0c3e713 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:37.107442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1de1b5fc-fa49-4ebf-ae9d-3f14e0c3e713 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:37.135472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1de1b5fc-fa49-4ebf-ae9d-3f14e0c3e713 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 Jul 28 20:06:37.136010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 633/1197] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:38.071101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-37d9d276-3798-4c47-94dd-497e6a450142 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:38.071744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-37d9d276-3798-4c47-94dd-497e6a450142 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:38.079327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-37d9d276-3798-4c47-94dd-497e6a450142 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:38.079773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-37d9d276-3798-4c47-94dd-497e6a450142 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:38.080527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-37d9d276-3798-4c47-94dd-497e6a450142 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:38.080980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-37d9d276-3798-4c47-94dd-497e6a450142 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:38.213095 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-37d9d276-3798-4c47-94dd-497e6a450142 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:38.216460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:38.221691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-37d9d276-3798-4c47-94dd-497e6a450142 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.154387 Jul 28 20:06:38.222246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 634/1198] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:38 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:38.226770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c54c4fb3-27dc-4cee-bde9-793b9119b1ce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:38.228905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c54c4fb3-27dc-4cee-bde9-793b9119b1ce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:38.235472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c54c4fb3-27dc-4cee-bde9-793b9119b1ce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:38.235919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c54c4fb3-27dc-4cee-bde9-793b9119b1ce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:38.236722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c54c4fb3-27dc-4cee-bde9-793b9119b1ce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:38.237147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c54c4fb3-27dc-4cee-bde9-793b9119b1ce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:38.265598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c54c4fb3-27dc-4cee-bde9-793b9119b1ce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042368 Jul 28 20:06:38.266142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 635/1199] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:38.270517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aedd4787-9d17-4eed-9db4-efee9f97267d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:38.272620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aedd4787-9d17-4eed-9db4-efee9f97267d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:38.278410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aedd4787-9d17-4eed-9db4-efee9f97267d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:38.278863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aedd4787-9d17-4eed-9db4-efee9f97267d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:38.279621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aedd4787-9d17-4eed-9db4-efee9f97267d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:38.280322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aedd4787-9d17-4eed-9db4-efee9f97267d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:38.308896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aedd4787-9d17-4eed-9db4-efee9f97267d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041735 Jul 28 20:06:38.309459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 636/1200] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:39.243150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-514aa202-64a6-4a72-8fb1-60bd8a3ed62b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:39.243794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-514aa202-64a6-4a72-8fb1-60bd8a3ed62b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:39.251985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-514aa202-64a6-4a72-8fb1-60bd8a3ed62b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:39.252430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-514aa202-64a6-4a72-8fb1-60bd8a3ed62b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:39.253239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-514aa202-64a6-4a72-8fb1-60bd8a3ed62b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:39.253676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-514aa202-64a6-4a72-8fb1-60bd8a3ed62b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:39.387457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-514aa202-64a6-4a72-8fb1-60bd8a3ed62b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:39.394916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-514aa202-64a6-4a72-8fb1-60bd8a3ed62b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155659 Jul 28 20:06:39.395470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 637/1201] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:39 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:39.400033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ab99de67-f108-4c45-9c7c-894481a52655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:39.402183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ab99de67-f108-4c45-9c7c-894481a52655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:39.408122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab99de67-f108-4c45-9c7c-894481a52655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:39.408560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab99de67-f108-4c45-9c7c-894481a52655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:39.409312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab99de67-f108-4c45-9c7c-894481a52655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:39.409741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab99de67-f108-4c45-9c7c-894481a52655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:39.439356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ab99de67-f108-4c45-9c7c-894481a52655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042809 Jul 28 20:06:39.439824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 638/1202] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:39 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:39.444314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7ac840a5-0491-4705-981b-bee5d727c879 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:39.446383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7ac840a5-0491-4705-981b-bee5d727c879 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:39.451932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ac840a5-0491-4705-981b-bee5d727c879 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:39.452373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ac840a5-0491-4705-981b-bee5d727c879 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:39.453156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ac840a5-0491-4705-981b-bee5d727c879 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:39.453572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ac840a5-0491-4705-981b-bee5d727c879 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:39.480645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7ac840a5-0491-4705-981b-bee5d727c879 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039845 Jul 28 20:06:39.481262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 639/1203] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:40.416638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fe15e2e9-5690-47ca-8111-b0e7804bbe69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:40.417295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fe15e2e9-5690-47ca-8111-b0e7804bbe69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:40.423838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe15e2e9-5690-47ca-8111-b0e7804bbe69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:40.424283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe15e2e9-5690-47ca-8111-b0e7804bbe69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:40.425063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe15e2e9-5690-47ca-8111-b0e7804bbe69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:40.425492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe15e2e9-5690-47ca-8111-b0e7804bbe69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:40.554818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fe15e2e9-5690-47ca-8111-b0e7804bbe69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:40.562456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fe15e2e9-5690-47ca-8111-b0e7804bbe69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149633 Jul 28 20:06:40.563021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 640/1204] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:40 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:40.567708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aa8d1670-3db7-4468-b954-f51aa3dd2786 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:40.569838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aa8d1670-3db7-4468-b954-f51aa3dd2786 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:40.575438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aa8d1670-3db7-4468-b954-f51aa3dd2786 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:40.575877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aa8d1670-3db7-4468-b954-f51aa3dd2786 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:40.576669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aa8d1670-3db7-4468-b954-f51aa3dd2786 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:40.577098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aa8d1670-3db7-4468-b954-f51aa3dd2786 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:40.605303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aa8d1670-3db7-4468-b954-f51aa3dd2786 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041311 Jul 28 20:06:40.605848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 641/1205] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:40.611067 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-be153f3d-7dcd-4c66-bca8-7ee5a6e377ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:40.613168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-be153f3d-7dcd-4c66-bca8-7ee5a6e377ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:40.618781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be153f3d-7dcd-4c66-bca8-7ee5a6e377ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:40.619225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be153f3d-7dcd-4c66-bca8-7ee5a6e377ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:40.619975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be153f3d-7dcd-4c66-bca8-7ee5a6e377ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:40.620404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be153f3d-7dcd-4c66-bca8-7ee5a6e377ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:40.647921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-be153f3d-7dcd-4c66-bca8-7ee5a6e377ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041057 Jul 28 20:06:40.648478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 642/1206] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:41.584301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2d777824-683b-4096-8529-d3b6af293b80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:41.585010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2d777824-683b-4096-8529-d3b6af293b80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:41.591840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d777824-683b-4096-8529-d3b6af293b80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:41.592283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d777824-683b-4096-8529-d3b6af293b80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:41.593087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d777824-683b-4096-8529-d3b6af293b80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:41.594191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d777824-683b-4096-8529-d3b6af293b80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:41.724838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2d777824-683b-4096-8529-d3b6af293b80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:41.732590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2d777824-683b-4096-8529-d3b6af293b80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152140 Jul 28 20:06:41.733187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 643/1207] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:41 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:41.738560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2892bce0-6e00-4fbc-93f8-38b320a821fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:41.740689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2892bce0-6e00-4fbc-93f8-38b320a821fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:41.746385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2892bce0-6e00-4fbc-93f8-38b320a821fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:41.746831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2892bce0-6e00-4fbc-93f8-38b320a821fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:41.747584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2892bce0-6e00-4fbc-93f8-38b320a821fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:41.748012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2892bce0-6e00-4fbc-93f8-38b320a821fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:41.776832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2892bce0-6e00-4fbc-93f8-38b320a821fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041743 Jul 28 20:06:41.777376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 644/1208] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:41 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:41.782469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-250815cb-c1e5-4d56-ac3b-50318df252e8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:41.784523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-250815cb-c1e5-4d56-ac3b-50318df252e8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:41.790099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-250815cb-c1e5-4d56-ac3b-50318df252e8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:41.790539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-250815cb-c1e5-4d56-ac3b-50318df252e8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:41.791283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-250815cb-c1e5-4d56-ac3b-50318df252e8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:41.791708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-250815cb-c1e5-4d56-ac3b-50318df252e8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:41.820354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-250815cb-c1e5-4d56-ac3b-50318df252e8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041890 Jul 28 20:06:41.820930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 645/1209] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:42.755008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-84038a83-2477-4fce-a7ff-94ac75924268 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:42.755692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-84038a83-2477-4fce-a7ff-94ac75924268 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:42.762117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84038a83-2477-4fce-a7ff-94ac75924268 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:42.762556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84038a83-2477-4fce-a7ff-94ac75924268 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:42.763302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84038a83-2477-4fce-a7ff-94ac75924268 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:42.763725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84038a83-2477-4fce-a7ff-94ac75924268 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:42.896104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-84038a83-2477-4fce-a7ff-94ac75924268 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:42.903514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-84038a83-2477-4fce-a7ff-94ac75924268 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152318 Jul 28 20:06:42.904070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 646/1210] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:42 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:42.908794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-91dc44a5-82a3-42cf-b2c8-a5851106d436 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:42.910889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-91dc44a5-82a3-42cf-b2c8-a5851106d436 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:42.916451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91dc44a5-82a3-42cf-b2c8-a5851106d436 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:42.916920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91dc44a5-82a3-42cf-b2c8-a5851106d436 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:42.917667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91dc44a5-82a3-42cf-b2c8-a5851106d436 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:42.918088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91dc44a5-82a3-42cf-b2c8-a5851106d436 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:42.947448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-91dc44a5-82a3-42cf-b2c8-a5851106d436 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042354 Jul 28 20:06:42.947988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 647/1211] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:42 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:42.952399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-767171ee-1aff-4c6f-9098-20a4520983cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:42.955022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-767171ee-1aff-4c6f-9098-20a4520983cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:42.960526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-767171ee-1aff-4c6f-9098-20a4520983cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:42.960990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-767171ee-1aff-4c6f-9098-20a4520983cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:42.961755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-767171ee-1aff-4c6f-9098-20a4520983cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:42.962179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-767171ee-1aff-4c6f-9098-20a4520983cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:42.989507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-767171ee-1aff-4c6f-9098-20a4520983cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040570 Jul 28 20:06:42.990033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 648/1212] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:43.924958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-135644c9-0720-4114-9815-364a8b09e6cf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:43.925608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-135644c9-0720-4114-9815-364a8b09e6cf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:43.931997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-135644c9-0720-4114-9815-364a8b09e6cf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:43.932431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-135644c9-0720-4114-9815-364a8b09e6cf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:43.933273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-135644c9-0720-4114-9815-364a8b09e6cf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:43.933698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-135644c9-0720-4114-9815-364a8b09e6cf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:44.063171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-135644c9-0720-4114-9815-364a8b09e6cf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:44.070513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-135644c9-0720-4114-9815-364a8b09e6cf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149512 Jul 28 20:06:44.071064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 649/1213] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:43 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:44.075551 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c0b13be5-f6af-4d5b-a037-88972790de16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:44.077932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c0b13be5-f6af-4d5b-a037-88972790de16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:44.083351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0b13be5-f6af-4d5b-a037-88972790de16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:44.083842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0b13be5-f6af-4d5b-a037-88972790de16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:44.084560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0b13be5-f6af-4d5b-a037-88972790de16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:44.084990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0b13be5-f6af-4d5b-a037-88972790de16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:44.113645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c0b13be5-f6af-4d5b-a037-88972790de16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041544 Jul 28 20:06:44.114183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 650/1214] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:44 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:44.118563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e01b9e9a-b0d1-470b-b833-7a90f0e26858 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:44.120617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e01b9e9a-b0d1-470b-b833-7a90f0e26858 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:44.126947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e01b9e9a-b0d1-470b-b833-7a90f0e26858 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:44.127382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e01b9e9a-b0d1-470b-b833-7a90f0e26858 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:44.128119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e01b9e9a-b0d1-470b-b833-7a90f0e26858 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:44.128571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e01b9e9a-b0d1-470b-b833-7a90f0e26858 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:44.144344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:44.156668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e01b9e9a-b0d1-470b-b833-7a90f0e26858 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041497 Jul 28 20:06:44.157211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 651/1215] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:45.091557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-edf20ca8-4b4e-4524-abd9-0e2dd03ece9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:45.092252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-edf20ca8-4b4e-4524-abd9-0e2dd03ece9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:45.099149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edf20ca8-4b4e-4524-abd9-0e2dd03ece9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:45.099598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edf20ca8-4b4e-4524-abd9-0e2dd03ece9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:45.100357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edf20ca8-4b4e-4524-abd9-0e2dd03ece9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:45.100816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edf20ca8-4b4e-4524-abd9-0e2dd03ece9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:45.236595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-edf20ca8-4b4e-4524-abd9-0e2dd03ece9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:45.244049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-edf20ca8-4b4e-4524-abd9-0e2dd03ece9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.156394 Jul 28 20:06:45.244629 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 652/1216] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:45 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:45.249092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-55670458-b83c-417a-8a18-b92b4674a307 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:45.251417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-55670458-b83c-417a-8a18-b92b4674a307 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:45.257081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55670458-b83c-417a-8a18-b92b4674a307 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:45.257529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55670458-b83c-417a-8a18-b92b4674a307 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:45.258293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55670458-b83c-417a-8a18-b92b4674a307 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:45.258724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55670458-b83c-417a-8a18-b92b4674a307 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:45.287557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-55670458-b83c-417a-8a18-b92b4674a307 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041932 Jul 28 20:06:45.288105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 653/1217] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:45.292529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-82b9c89b-41ef-48b6-9807-0090705ce731 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:45.294629 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-82b9c89b-41ef-48b6-9807-0090705ce731 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:45.300874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82b9c89b-41ef-48b6-9807-0090705ce731 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:45.301324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82b9c89b-41ef-48b6-9807-0090705ce731 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:45.302078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82b9c89b-41ef-48b6-9807-0090705ce731 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:45.302517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82b9c89b-41ef-48b6-9807-0090705ce731 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:45.331673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-82b9c89b-41ef-48b6-9807-0090705ce731 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042500 Jul 28 20:06:45.334163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 654/1218] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:45.633884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-5af585f9-2f98-4f13-83c0-4cc19de880fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'services' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:06:46.266032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f499ffc-988a-44fc-8bf7-7266e81421ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:46.266647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f499ffc-988a-44fc-8bf7-7266e81421ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:46.273336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f499ffc-988a-44fc-8bf7-7266e81421ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:46.273806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f499ffc-988a-44fc-8bf7-7266e81421ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:46.274553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f499ffc-988a-44fc-8bf7-7266e81421ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:46.274986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f499ffc-988a-44fc-8bf7-7266e81421ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:46.408946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2f499ffc-988a-44fc-8bf7-7266e81421ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:46.416417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f499ffc-988a-44fc-8bf7-7266e81421ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.154920 Jul 28 20:06:46.416949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 655/1219] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:46 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:46.421812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2a9ad9df-0a39-434b-bc14-4ed9bd1a96c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:46.423919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2a9ad9df-0a39-434b-bc14-4ed9bd1a96c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:46.429657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a9ad9df-0a39-434b-bc14-4ed9bd1a96c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:46.430107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a9ad9df-0a39-434b-bc14-4ed9bd1a96c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:46.430865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a9ad9df-0a39-434b-bc14-4ed9bd1a96c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:46.431294 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a9ad9df-0a39-434b-bc14-4ed9bd1a96c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:46.459677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2a9ad9df-0a39-434b-bc14-4ed9bd1a96c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041738 Jul 28 20:06:46.460219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 656/1220] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:46.464814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-32629532-1f73-451e-ac0a-02fef973bb05 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:46.466864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-32629532-1f73-451e-ac0a-02fef973bb05 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:46.473194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32629532-1f73-451e-ac0a-02fef973bb05 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:46.473667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32629532-1f73-451e-ac0a-02fef973bb05 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:46.474417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32629532-1f73-451e-ac0a-02fef973bb05 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:46.474849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32629532-1f73-451e-ac0a-02fef973bb05 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:46.503471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-32629532-1f73-451e-ac0a-02fef973bb05 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042248 Jul 28 20:06:46.504009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 657/1221] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:47.438721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-df231e9b-d5e9-49e8-a659-f1597272ceea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:47.439402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-df231e9b-d5e9-49e8-a659-f1597272ceea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:47.446442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df231e9b-d5e9-49e8-a659-f1597272ceea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:47.446876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df231e9b-d5e9-49e8-a659-f1597272ceea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:47.447627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df231e9b-d5e9-49e8-a659-f1597272ceea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:47.448369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df231e9b-d5e9-49e8-a659-f1597272ceea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:47.586386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-df231e9b-d5e9-49e8-a659-f1597272ceea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:47.594368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-df231e9b-d5e9-49e8-a659-f1597272ceea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.160120 Jul 28 20:06:47.594930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 658/1222] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:47.599728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b17e5b97-e32c-41ec-a9db-8b07724680c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:47.602690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b17e5b97-e32c-41ec-a9db-8b07724680c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:47.609479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b17e5b97-e32c-41ec-a9db-8b07724680c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:47.610264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b17e5b97-e32c-41ec-a9db-8b07724680c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:47.611535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b17e5b97-e32c-41ec-a9db-8b07724680c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:47.611983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b17e5b97-e32c-41ec-a9db-8b07724680c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:47.648030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b17e5b97-e32c-41ec-a9db-8b07724680c5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052046 Jul 28 20:06:47.648612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 659/1223] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:47.653365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a986a1bc-623e-499b-8bd3-bc2207d3cafe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:47.655876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a986a1bc-623e-499b-8bd3-bc2207d3cafe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:47.662559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a986a1bc-623e-499b-8bd3-bc2207d3cafe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:47.663009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a986a1bc-623e-499b-8bd3-bc2207d3cafe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:47.663782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a986a1bc-623e-499b-8bd3-bc2207d3cafe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:47.664218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a986a1bc-623e-499b-8bd3-bc2207d3cafe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:47.699626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a986a1bc-623e-499b-8bd3-bc2207d3cafe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049793 Jul 28 20:06:47.700397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 660/1224] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:47 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:48.617028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-86e61e9f-f07e-4b78-9c1d-eed71bc9eecf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:48.617677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-86e61e9f-f07e-4b78-9c1d-eed71bc9eecf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:48.624089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86e61e9f-f07e-4b78-9c1d-eed71bc9eecf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:48.624683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86e61e9f-f07e-4b78-9c1d-eed71bc9eecf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:48.625441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86e61e9f-f07e-4b78-9c1d-eed71bc9eecf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:48.625876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86e61e9f-f07e-4b78-9c1d-eed71bc9eecf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:48.756485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-86e61e9f-f07e-4b78-9c1d-eed71bc9eecf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:48.763972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-86e61e9f-f07e-4b78-9c1d-eed71bc9eecf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.150787 Jul 28 20:06:48.764524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 661/1225] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:48.770171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3cd7c67d-3f55-408e-9d57-30ed4ce0fb60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:48.772304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3cd7c67d-3f55-408e-9d57-30ed4ce0fb60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:48.777965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cd7c67d-3f55-408e-9d57-30ed4ce0fb60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:48.778402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cd7c67d-3f55-408e-9d57-30ed4ce0fb60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:48.779147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cd7c67d-3f55-408e-9d57-30ed4ce0fb60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:48.779569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cd7c67d-3f55-408e-9d57-30ed4ce0fb60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:48.807521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3cd7c67d-3f55-408e-9d57-30ed4ce0fb60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041428 Jul 28 20:06:48.808064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 662/1226] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:48 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:48.813191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8f256221-0e99-4060-99a4-2f41a20cc1e2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:48.815250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8f256221-0e99-4060-99a4-2f41a20cc1e2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:48.820766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f256221-0e99-4060-99a4-2f41a20cc1e2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:48.821206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f256221-0e99-4060-99a4-2f41a20cc1e2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:48.821976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f256221-0e99-4060-99a4-2f41a20cc1e2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:48.822406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f256221-0e99-4060-99a4-2f41a20cc1e2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:48.850845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8f256221-0e99-4060-99a4-2f41a20cc1e2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041770 Jul 28 20:06:48.851373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 663/1227] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:49.785969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bede967a-125f-42e8-a046-a4d2a69508e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:49.787291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bede967a-125f-42e8-a046-a4d2a69508e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:49.794662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bede967a-125f-42e8-a046-a4d2a69508e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:49.795134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bede967a-125f-42e8-a046-a4d2a69508e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:49.795925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bede967a-125f-42e8-a046-a4d2a69508e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:49.796967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bede967a-125f-42e8-a046-a4d2a69508e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:49.935714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bede967a-125f-42e8-a046-a4d2a69508e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:49.944621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bede967a-125f-42e8-a046-a4d2a69508e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.162456 Jul 28 20:06:49.945188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 664/1228] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:49 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:49.949776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b3d75afe-615f-49a7-a88a-7fc3731ef24f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:49.952036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b3d75afe-615f-49a7-a88a-7fc3731ef24f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:49.958395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3d75afe-615f-49a7-a88a-7fc3731ef24f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:49.958838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3d75afe-615f-49a7-a88a-7fc3731ef24f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:49.959599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3d75afe-615f-49a7-a88a-7fc3731ef24f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:49.960032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3d75afe-615f-49a7-a88a-7fc3731ef24f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:49.988428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b3d75afe-615f-49a7-a88a-7fc3731ef24f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042245 Jul 28 20:06:49.989002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 665/1229] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:49 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:49.993399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-60b09b56-418a-4366-bcc3-34153d9cd392 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:49.995453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-60b09b56-418a-4366-bcc3-34153d9cd392 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:50.001014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-60b09b56-418a-4366-bcc3-34153d9cd392 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:50.001461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-60b09b56-418a-4366-bcc3-34153d9cd392 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:50.002222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-60b09b56-418a-4366-bcc3-34153d9cd392 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:50.002753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-60b09b56-418a-4366-bcc3-34153d9cd392 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:50.031310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-60b09b56-418a-4366-bcc3-34153d9cd392 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040397 Jul 28 20:06:50.032038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 666/1230] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:50.966001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4797503d-1bfa-49e1-8efe-9dbc0cf4a84e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:50.966675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4797503d-1bfa-49e1-8efe-9dbc0cf4a84e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:50.974451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4797503d-1bfa-49e1-8efe-9dbc0cf4a84e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:50.974894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4797503d-1bfa-49e1-8efe-9dbc0cf4a84e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:50.975641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4797503d-1bfa-49e1-8efe-9dbc0cf4a84e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:50.976070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4797503d-1bfa-49e1-8efe-9dbc0cf4a84e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:51.114466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4797503d-1bfa-49e1-8efe-9dbc0cf4a84e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:51.121926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4797503d-1bfa-49e1-8efe-9dbc0cf4a84e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.159768 Jul 28 20:06:51.122478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 667/1231] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:51.126937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-deb33d9e-5988-4dbc-a8d2-db265cf51720 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:51.129054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-deb33d9e-5988-4dbc-a8d2-db265cf51720 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:51.134660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-deb33d9e-5988-4dbc-a8d2-db265cf51720 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:51.135100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-deb33d9e-5988-4dbc-a8d2-db265cf51720 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:51.135845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-deb33d9e-5988-4dbc-a8d2-db265cf51720 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:51.136271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-deb33d9e-5988-4dbc-a8d2-db265cf51720 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:51.139785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:51.165616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-deb33d9e-5988-4dbc-a8d2-db265cf51720 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042127 Jul 28 20:06:51.166190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 668/1232] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:51.170677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-584dde04-69bb-4c92-aa01-a963e75db3c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:51.173476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-584dde04-69bb-4c92-aa01-a963e75db3c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:51.179427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-584dde04-69bb-4c92-aa01-a963e75db3c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:51.179865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-584dde04-69bb-4c92-aa01-a963e75db3c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:51.180640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-584dde04-69bb-4c92-aa01-a963e75db3c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:51.181069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-584dde04-69bb-4c92-aa01-a963e75db3c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:51.209556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-584dde04-69bb-4c92-aa01-a963e75db3c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 Jul 28 20:06:51.210104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 669/1233] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:52.143493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-31db953c-7385-4a50-a502-3594f693354b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:52.144147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-31db953c-7385-4a50-a502-3594f693354b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:52.150684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31db953c-7385-4a50-a502-3594f693354b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:52.151129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31db953c-7385-4a50-a502-3594f693354b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:52.151877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31db953c-7385-4a50-a502-3594f693354b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:52.152300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31db953c-7385-4a50-a502-3594f693354b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:52.284004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-31db953c-7385-4a50-a502-3594f693354b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:52.291406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-31db953c-7385-4a50-a502-3594f693354b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152268 Jul 28 20:06:52.291961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 670/1234] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:52 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:52.296814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5e792102-6774-4aaa-8bce-7661dae17f5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:52.298596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5e792102-6774-4aaa-8bce-7661dae17f5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:52.304186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e792102-6774-4aaa-8bce-7661dae17f5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:52.304661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e792102-6774-4aaa-8bce-7661dae17f5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:52.305407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e792102-6774-4aaa-8bce-7661dae17f5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:52.305833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e792102-6774-4aaa-8bce-7661dae17f5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:52.334147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5e792102-6774-4aaa-8bce-7661dae17f5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041203 Jul 28 20:06:52.334675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 671/1235] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:52 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:52.339022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aebbc727-814f-49f3-b9d0-71cc5b0d1b47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:52.341087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aebbc727-814f-49f3-b9d0-71cc5b0d1b47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:52.347305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aebbc727-814f-49f3-b9d0-71cc5b0d1b47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:52.347747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aebbc727-814f-49f3-b9d0-71cc5b0d1b47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:52.348486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aebbc727-814f-49f3-b9d0-71cc5b0d1b47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:52.349009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aebbc727-814f-49f3-b9d0-71cc5b0d1b47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:52.376042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aebbc727-814f-49f3-b9d0-71cc5b0d1b47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040420 Jul 28 20:06:52.376592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 672/1236] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:53.312090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-857c68c5-0afd-4da5-9f84-610167292085 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:53.313351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-857c68c5-0afd-4da5-9f84-610167292085 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:53.315605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:53.321034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-857c68c5-0afd-4da5-9f84-610167292085 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:53.321486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-857c68c5-0afd-4da5-9f84-610167292085 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:53.322249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-857c68c5-0afd-4da5-9f84-610167292085 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:53.322683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-857c68c5-0afd-4da5-9f84-610167292085 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:53.457701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-857c68c5-0afd-4da5-9f84-610167292085 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:53.465167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-857c68c5-0afd-4da5-9f84-610167292085 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.156929 Jul 28 20:06:53.465714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 673/1237] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:53 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:53.470321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-50b005ac-ea21-4c6f-bf02-34e10a1387fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:53.472453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-50b005ac-ea21-4c6f-bf02-34e10a1387fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:53.478381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50b005ac-ea21-4c6f-bf02-34e10a1387fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:53.478820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50b005ac-ea21-4c6f-bf02-34e10a1387fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:53.479572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50b005ac-ea21-4c6f-bf02-34e10a1387fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:53.479997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50b005ac-ea21-4c6f-bf02-34e10a1387fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:53.510782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-50b005ac-ea21-4c6f-bf02-34e10a1387fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044029 Jul 28 20:06:53.511518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 674/1238] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:53.516298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-596a1b20-dd56-40a8-9a75-3cc1e8e75eaa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:53.518602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-596a1b20-dd56-40a8-9a75-3cc1e8e75eaa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:53.524316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-596a1b20-dd56-40a8-9a75-3cc1e8e75eaa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:53.524791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-596a1b20-dd56-40a8-9a75-3cc1e8e75eaa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:53.525543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-596a1b20-dd56-40a8-9a75-3cc1e8e75eaa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:53.525968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-596a1b20-dd56-40a8-9a75-3cc1e8e75eaa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:53.559170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-596a1b20-dd56-40a8-9a75-3cc1e8e75eaa tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046821 Jul 28 20:06:53.560105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 675/1239] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:54.487665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-990c862a-e690-46bb-9ab4-85e63af6490b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:54.489025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-990c862a-e690-46bb-9ab4-85e63af6490b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:54.495689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-990c862a-e690-46bb-9ab4-85e63af6490b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:54.496141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-990c862a-e690-46bb-9ab4-85e63af6490b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:54.496954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-990c862a-e690-46bb-9ab4-85e63af6490b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:54.497388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-990c862a-e690-46bb-9ab4-85e63af6490b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:54.627214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-990c862a-e690-46bb-9ab4-85e63af6490b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:54.634740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-990c862a-e690-46bb-9ab4-85e63af6490b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151825 Jul 28 20:06:54.635319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 676/1240] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:06:54.640343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f645e685-1165-4847-a914-2557c9a36d3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:54.642641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f645e685-1165-4847-a914-2557c9a36d3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:54.648824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f645e685-1165-4847-a914-2557c9a36d3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:54.649277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f645e685-1165-4847-a914-2557c9a36d3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:54.650050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f645e685-1165-4847-a914-2557c9a36d3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:54.650486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f645e685-1165-4847-a914-2557c9a36d3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:54.680423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f645e685-1165-4847-a914-2557c9a36d3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Jul 28 20:06:54.681030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 677/1241] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:54.685448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-04f52b50-63ea-4e70-a24f-65414b9b4a5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:54.688201 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-04f52b50-63ea-4e70-a24f-65414b9b4a5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:54.694344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04f52b50-63ea-4e70-a24f-65414b9b4a5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:54.694783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04f52b50-63ea-4e70-a24f-65414b9b4a5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:54.695563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04f52b50-63ea-4e70-a24f-65414b9b4a5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:54.695991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04f52b50-63ea-4e70-a24f-65414b9b4a5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:54.725876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-04f52b50-63ea-4e70-a24f-65414b9b4a5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Jul 28 20:06:54.726413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 678/1242] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:55.638494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:55.657625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-256ce54c-fe04-44b8-ac8a-f5a175322196 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:55.658239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-256ce54c-fe04-44b8-ac8a-f5a175322196 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:55.664774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-256ce54c-fe04-44b8-ac8a-f5a175322196 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:55.665224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-256ce54c-fe04-44b8-ac8a-f5a175322196 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:55.665977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-256ce54c-fe04-44b8-ac8a-f5a175322196 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:55.666411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-256ce54c-fe04-44b8-ac8a-f5a175322196 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:55.801058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-256ce54c-fe04-44b8-ac8a-f5a175322196 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:55.808390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-256ce54c-fe04-44b8-ac8a-f5a175322196 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155450 Jul 28 20:06:55.808974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 679/1243] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:55.814149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f2e7bfec-3a37-4652-8eb7-05d1ad483ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:55.816259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f2e7bfec-3a37-4652-8eb7-05d1ad483ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:55.821947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2e7bfec-3a37-4652-8eb7-05d1ad483ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:55.822386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2e7bfec-3a37-4652-8eb7-05d1ad483ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:55.823137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2e7bfec-3a37-4652-8eb7-05d1ad483ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:55.823648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2e7bfec-3a37-4652-8eb7-05d1ad483ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:55.853907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f2e7bfec-3a37-4652-8eb7-05d1ad483ac3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Jul 28 20:06:55.854449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 680/1244] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:55 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:55.858817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c15df570-3ec3-4021-be3a-fcee72cade68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:55.861523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c15df570-3ec3-4021-be3a-fcee72cade68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:55.867064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c15df570-3ec3-4021-be3a-fcee72cade68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:55.867504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c15df570-3ec3-4021-be3a-fcee72cade68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:55.868251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c15df570-3ec3-4021-be3a-fcee72cade68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:55.868709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c15df570-3ec3-4021-be3a-fcee72cade68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:55.896164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c15df570-3ec3-4021-be3a-fcee72cade68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040754 Jul 28 20:06:55.896724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 681/1245] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:56.829638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5c217094-f72a-4c7a-9c36-e468c62d8e5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:56.830263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5c217094-f72a-4c7a-9c36-e468c62d8e5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:56.836814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c217094-f72a-4c7a-9c36-e468c62d8e5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:56.837262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c217094-f72a-4c7a-9c36-e468c62d8e5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:56.838016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c217094-f72a-4c7a-9c36-e468c62d8e5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:56.838457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c217094-f72a-4c7a-9c36-e468c62d8e5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:56.973605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5c217094-f72a-4c7a-9c36-e468c62d8e5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:56.980960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5c217094-f72a-4c7a-9c36-e468c62d8e5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155771 Jul 28 20:06:56.981509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 682/1246] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:56 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:56.986081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c0019201-df4d-4490-b2a9-4c9e8a1c0c99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:56.988171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c0019201-df4d-4490-b2a9-4c9e8a1c0c99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:56.993708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0019201-df4d-4490-b2a9-4c9e8a1c0c99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:56.994145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0019201-df4d-4490-b2a9-4c9e8a1c0c99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:56.994892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0019201-df4d-4490-b2a9-4c9e8a1c0c99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:56.995316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c0019201-df4d-4490-b2a9-4c9e8a1c0c99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:57.023718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c0019201-df4d-4490-b2a9-4c9e8a1c0c99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041222 Jul 28 20:06:57.024245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 683/1247] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:57.028625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bad6294c-3b60-49d9-9280-f958070282ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:57.030908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bad6294c-3b60-49d9-9280-f958070282ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:57.036752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bad6294c-3b60-49d9-9280-f958070282ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:57.037192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bad6294c-3b60-49d9-9280-f958070282ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:57.037945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bad6294c-3b60-49d9-9280-f958070282ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:57.038368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bad6294c-3b60-49d9-9280-f958070282ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:57.061374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:06:57.066729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bad6294c-3b60-49d9-9280-f958070282ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Jul 28 20:06:57.067268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 684/1248] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:58.002973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-661268e5-b9d3-45ff-8b6a-c16a1211519d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:58.003638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-661268e5-b9d3-45ff-8b6a-c16a1211519d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:58.009984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-661268e5-b9d3-45ff-8b6a-c16a1211519d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:58.010426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-661268e5-b9d3-45ff-8b6a-c16a1211519d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:58.011171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-661268e5-b9d3-45ff-8b6a-c16a1211519d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:58.011604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-661268e5-b9d3-45ff-8b6a-c16a1211519d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:58.148952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-661268e5-b9d3-45ff-8b6a-c16a1211519d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:58.157205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-661268e5-b9d3-45ff-8b6a-c16a1211519d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.158440 Jul 28 20:06:58.157756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 685/1249] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:58.162475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1015090d-a4b9-456a-8444-819b88e4fa85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:58.164632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1015090d-a4b9-456a-8444-819b88e4fa85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:58.170532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1015090d-a4b9-456a-8444-819b88e4fa85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:58.170967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1015090d-a4b9-456a-8444-819b88e4fa85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:58.171722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1015090d-a4b9-456a-8444-819b88e4fa85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:58.172310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1015090d-a4b9-456a-8444-819b88e4fa85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:58.201069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1015090d-a4b9-456a-8444-819b88e4fa85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042286 Jul 28 20:06:58.201607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 686/1250] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:58.206727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4f5e4f07-1952-4ae8-aa71-b899aef8f6ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:58.208810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4f5e4f07-1952-4ae8-aa71-b899aef8f6ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:58.214318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f5e4f07-1952-4ae8-aa71-b899aef8f6ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:58.214759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f5e4f07-1952-4ae8-aa71-b899aef8f6ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:58.215496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f5e4f07-1952-4ae8-aa71-b899aef8f6ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:58.215921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f5e4f07-1952-4ae8-aa71-b899aef8f6ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:58.243401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4f5e4f07-1952-4ae8-aa71-b899aef8f6ad tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040838 Jul 28 20:06:58.243931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 687/1251] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:58.556308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:06:58.556523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:06:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:06:59.179217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b3a1144a-b75d-4ca2-8ef3-22aa240a452f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:59.179822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b3a1144a-b75d-4ca2-8ef3-22aa240a452f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:59.186618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3a1144a-b75d-4ca2-8ef3-22aa240a452f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:59.187292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3a1144a-b75d-4ca2-8ef3-22aa240a452f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:59.188889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3a1144a-b75d-4ca2-8ef3-22aa240a452f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:59.189325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3a1144a-b75d-4ca2-8ef3-22aa240a452f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:59.323309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b3a1144a-b75d-4ca2-8ef3-22aa240a452f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:06:59.330741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b3a1144a-b75d-4ca2-8ef3-22aa240a452f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155493 Jul 28 20:06:59.331287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 688/1252] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:06:59 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:06:59.335744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6f8c4f1d-9a5e-4c0e-b026-845517f2ffa6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:59.337900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6f8c4f1d-9a5e-4c0e-b026-845517f2ffa6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:59.343470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f8c4f1d-9a5e-4c0e-b026-845517f2ffa6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:59.344476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f8c4f1d-9a5e-4c0e-b026-845517f2ffa6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:59.345260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f8c4f1d-9a5e-4c0e-b026-845517f2ffa6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:59.345690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f8c4f1d-9a5e-4c0e-b026-845517f2ffa6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:59.374109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6f8c4f1d-9a5e-4c0e-b026-845517f2ffa6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041839 Jul 28 20:06:59.374640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 689/1253] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:59 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:06:59.379122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-48c73b6b-62a8-451b-8dae-9f1e82cf17cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:06:59.381228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-48c73b6b-62a8-451b-8dae-9f1e82cf17cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:06:59.386902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-48c73b6b-62a8-451b-8dae-9f1e82cf17cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:59.387344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-48c73b6b-62a8-451b-8dae-9f1e82cf17cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:59.388096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-48c73b6b-62a8-451b-8dae-9f1e82cf17cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:06:59.388526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-48c73b6b-62a8-451b-8dae-9f1e82cf17cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:06:59.417406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-48c73b6b-62a8-451b-8dae-9f1e82cf17cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 Jul 28 20:06:59.417865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 690/1254] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:06:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:07:00.353033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8af5ce3e-b6d9-4f11-b9f7-f491ad8e69a2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:07:00.353733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8af5ce3e-b6d9-4f11-b9f7-f491ad8e69a2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:07:00.360672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8af5ce3e-b6d9-4f11-b9f7-f491ad8e69a2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:07:00.361126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8af5ce3e-b6d9-4f11-b9f7-f491ad8e69a2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:07:00.361883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8af5ce3e-b6d9-4f11-b9f7-f491ad8e69a2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:07:00.362308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8af5ce3e-b6d9-4f11-b9f7-f491ad8e69a2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:07:00.496690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8af5ce3e-b6d9-4f11-b9f7-f491ad8e69a2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:07:00.505070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8af5ce3e-b6d9-4f11-b9f7-f491ad8e69a2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155875 Jul 28 20:07:00.505628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 691/1255] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:07:00 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:07:00.510082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-12380796-02aa-4974-a276-e4a91fe5d1a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:07:00.512227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-12380796-02aa-4974-a276-e4a91fe5d1a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:07:00.518275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12380796-02aa-4974-a276-e4a91fe5d1a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:07:00.518719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12380796-02aa-4974-a276-e4a91fe5d1a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:07:00.519473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12380796-02aa-4974-a276-e4a91fe5d1a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:07:00.519903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12380796-02aa-4974-a276-e4a91fe5d1a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:07:00.549289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-12380796-02aa-4974-a276-e4a91fe5d1a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042685 Jul 28 20:07:00.549998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 692/1256] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:07:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:07:00.554206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f1e21134-c5b6-493c-ad31-367e7acab582 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:07:00.556225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f1e21134-c5b6-493c-ad31-367e7acab582 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:07:00.562051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f1e21134-c5b6-493c-ad31-367e7acab582 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:07:00.562575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f1e21134-c5b6-493c-ad31-367e7acab582 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:07:00.564340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f1e21134-c5b6-493c-ad31-367e7acab582 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:07:00.564796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f1e21134-c5b6-493c-ad31-367e7acab582 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:07:00.592335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f1e21134-c5b6-493c-ad31-367e7acab582 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041571 Jul 28 20:07:00.592892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 693/1257] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:07:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:07:01.104479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:07:01.104989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:07:01.111748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:07:01.112182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:07:01.112968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:07:01.113396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:07:11.108735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=43 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:07:11.131765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=58 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:01.181609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5af585f9-2f98-4f13-83c0-4cc19de880fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 202 len: 0 microversion: 2.1 time: 120.141160 Jul 28 20:08:01.182223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 565/1258] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:06:01 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 0 bytes in 120143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:08:01.188022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aef52b10-f88b-4787-a182-21958255723d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:01.188747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aef52b10-f88b-4787-a182-21958255723d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:01.195952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aef52b10-f88b-4787-a182-21958255723d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:01.196355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aef52b10-f88b-4787-a182-21958255723d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:01.196997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aef52b10-f88b-4787-a182-21958255723d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:01.197432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aef52b10-f88b-4787-a182-21958255723d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:01.282250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'services' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:08:01.357518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aef52b10-f88b-4787-a182-21958255723d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:01.367229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aef52b10-f88b-4787-a182-21958255723d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.183676 Jul 28 20:08:01.367805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 566/1259] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:08:01.372702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8962c43c-92fa-4549-998e-2a6b41b1fbdd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:01.374974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8962c43c-92fa-4549-998e-2a6b41b1fbdd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:01.380957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8962c43c-92fa-4549-998e-2a6b41b1fbdd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:01.381400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8962c43c-92fa-4549-998e-2a6b41b1fbdd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:01.382205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8962c43c-92fa-4549-998e-2a6b41b1fbdd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:01.382621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8962c43c-92fa-4549-998e-2a6b41b1fbdd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:01.421506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8962c43c-92fa-4549-998e-2a6b41b1fbdd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052651 Jul 28 20:08:01.422060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 567/1260] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:01.427598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f64709a0-ef21-4c6b-bf8d-803283e9d3c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:01.429750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f64709a0-ef21-4c6b-bf8d-803283e9d3c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:01.435469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f64709a0-ef21-4c6b-bf8d-803283e9d3c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:01.435917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f64709a0-ef21-4c6b-bf8d-803283e9d3c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:01.436732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f64709a0-ef21-4c6b-bf8d-803283e9d3c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:01.437172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f64709a0-ef21-4c6b-bf8d-803283e9d3c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:01.465598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f64709a0-ef21-4c6b-bf8d-803283e9d3c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Jul 28 20:08:01.466142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 568/1261] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:01.470620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:01.471100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:01.477155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:01.477607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:01.478366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:01.478803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:05.786525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:08:05.787185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 (ip 10.222.0.67) !!! Jul 28 20:08:11.286570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=4 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:11.475374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=8 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:11.497534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:28.277205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:08:28.277729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:08:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 (ip 10.222.0.67) !!! Jul 28 20:08:31.992898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:08:31.993387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:08:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 (ip 10.222.0.67) !!! Jul 28 20:08:45.886974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a99b4041-8d64-4e0f-8a63-3196ec98771d) Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 HTTP/1.1 Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:08:45.889173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:08:45.890572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a99b4041-8d64-4e0f-8a63-3196ec98771d) Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': '0038fe10-b9ea-4fe0-a220-9c2ab37f67ed', 'id': 'ead09975-af7f-40eb-ae0c-70936b340da0'} Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:08:45.891205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a99b4041-8d64-4e0f-8a63-3196ec98771d) Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:08:45.892334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a99b4041-8d64-4e0f-8a63-3196ec98771d) Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:08:45.893690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a99b4041-8d64-4e0f-8a63-3196ec98771d) Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:08:45.894759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a99b4041-8d64-4e0f-8a63-3196ec98771d) Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a99b4041-8d64-4e0f-8a63-3196ec98771d) Jul 28 20:08:45.898862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:08:45.902312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a99b4041-8d64-4e0f-8a63-3196ec98771d) {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:08:45.902312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0aa397b9-15ce-43ae-a3e5-ffae0158be16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 400 len: 269 microversion: 2.1 time: 104.790148 Jul 28 20:08:45.902312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 694/1262] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:07:01 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 269 bytes in 104791 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 20:08:45.902312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3b557cb2-afd7-498d-ac54-ecb94c7f369a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:45.903008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3b557cb2-afd7-498d-ac54-ecb94c7f369a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:45.903901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b557cb2-afd7-498d-ac54-ecb94c7f369a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:45.904347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b557cb2-afd7-498d-ac54-ecb94c7f369a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:45.905267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b557cb2-afd7-498d-ac54-ecb94c7f369a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:45.905745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b557cb2-afd7-498d-ac54-ecb94c7f369a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:45.982582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'services' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:08:46.045040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3b557cb2-afd7-498d-ac54-ecb94c7f369a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:46.053211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3b557cb2-afd7-498d-ac54-ecb94c7f369a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.161197 Jul 28 20:08:46.060584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 695/1263] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:45 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:08:46.060584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f8d910c2-4438-40f9-951b-b2d46db2fc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:46.060584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f8d910c2-4438-40f9-951b-b2d46db2fc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:46.066218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8d910c2-4438-40f9-951b-b2d46db2fc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:46.066743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8d910c2-4438-40f9-951b-b2d46db2fc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:46.067994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8d910c2-4438-40f9-951b-b2d46db2fc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:46.068411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8d910c2-4438-40f9-951b-b2d46db2fc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:46.100782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f8d910c2-4438-40f9-951b-b2d46db2fc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Jul 28 20:08:46.101447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 696/1264] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:46.105980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-feb9e241-5465-424b-99b2-742cff8671e3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:46.108184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-feb9e241-5465-424b-99b2-742cff8671e3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:46.114224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-feb9e241-5465-424b-99b2-742cff8671e3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:46.114766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-feb9e241-5465-424b-99b2-742cff8671e3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:46.115527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-feb9e241-5465-424b-99b2-742cff8671e3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:46.115953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-feb9e241-5465-424b-99b2-742cff8671e3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:46.146940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-feb9e241-5465-424b-99b2-742cff8671e3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Jul 28 20:08:46.147493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 697/1265] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:47.074465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a9080455-28f1-450c-8545-fd83f4c18edd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:47.075171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a9080455-28f1-450c-8545-fd83f4c18edd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:47.081475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9080455-28f1-450c-8545-fd83f4c18edd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:47.081916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9080455-28f1-450c-8545-fd83f4c18edd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:47.082730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9080455-28f1-450c-8545-fd83f4c18edd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:47.083150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a9080455-28f1-450c-8545-fd83f4c18edd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:47.214003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a9080455-28f1-450c-8545-fd83f4c18edd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:47.221512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a9080455-28f1-450c-8545-fd83f4c18edd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.150919 Jul 28 20:08:47.222068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 698/1266] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:47.227165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-154a1053-ed4f-4cbf-822d-2524b21dd7f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:47.229461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-154a1053-ed4f-4cbf-822d-2524b21dd7f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:47.235026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-154a1053-ed4f-4cbf-822d-2524b21dd7f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:47.235467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-154a1053-ed4f-4cbf-822d-2524b21dd7f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:47.236242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-154a1053-ed4f-4cbf-822d-2524b21dd7f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:47.236694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-154a1053-ed4f-4cbf-822d-2524b21dd7f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:47.265232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-154a1053-ed4f-4cbf-822d-2524b21dd7f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042177 Jul 28 20:08:47.265758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 699/1267] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:47.270385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dd2e2ecd-bbb6-4e28-9c1e-fa4353fc8fbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:47.272449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dd2e2ecd-bbb6-4e28-9c1e-fa4353fc8fbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:47.278072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ecd-bbb6-4e28-9c1e-fa4353fc8fbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:47.278508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ecd-bbb6-4e28-9c1e-fa4353fc8fbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:47.279243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ecd-bbb6-4e28-9c1e-fa4353fc8fbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:47.279668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd2e2ecd-bbb6-4e28-9c1e-fa4353fc8fbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:47.308360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dd2e2ecd-bbb6-4e28-9c1e-fa4353fc8fbf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041561 Jul 28 20:08:47.308928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 700/1268] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:47 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:47.923605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:08:47.923803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:08:48.243206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-803d35eb-f1b5-4c98-b0a9-8afddb6f68e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:48.243880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-803d35eb-f1b5-4c98-b0a9-8afddb6f68e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:48.250622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-803d35eb-f1b5-4c98-b0a9-8afddb6f68e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:48.251076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-803d35eb-f1b5-4c98-b0a9-8afddb6f68e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:48.251838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-803d35eb-f1b5-4c98-b0a9-8afddb6f68e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:48.252281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-803d35eb-f1b5-4c98-b0a9-8afddb6f68e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:48.389705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-803d35eb-f1b5-4c98-b0a9-8afddb6f68e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:48.398307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-803d35eb-f1b5-4c98-b0a9-8afddb6f68e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.158923 Jul 28 20:08:48.398862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 701/1269] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:48.403355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7a2ba817-ddf8-492a-b089-e396f69a4112 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:48.405498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7a2ba817-ddf8-492a-b089-e396f69a4112 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:48.412220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7a2ba817-ddf8-492a-b089-e396f69a4112 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:48.412693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7a2ba817-ddf8-492a-b089-e396f69a4112 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:48.413464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7a2ba817-ddf8-492a-b089-e396f69a4112 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:48.413912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7a2ba817-ddf8-492a-b089-e396f69a4112 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:48.441878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7a2ba817-ddf8-492a-b089-e396f69a4112 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 Jul 28 20:08:48.442343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 702/1270] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:48 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:48.446801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-99ceefc0-508a-40cd-92cc-e3fcd8344043 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:48.448913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-99ceefc0-508a-40cd-92cc-e3fcd8344043 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:48.454498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99ceefc0-508a-40cd-92cc-e3fcd8344043 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:48.454942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99ceefc0-508a-40cd-92cc-e3fcd8344043 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:48.455697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99ceefc0-508a-40cd-92cc-e3fcd8344043 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:48.456130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99ceefc0-508a-40cd-92cc-e3fcd8344043 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:48.484832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-99ceefc0-508a-40cd-92cc-e3fcd8344043 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041482 Jul 28 20:08:48.485368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 703/1271] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:49.421045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-859fc17d-e724-406e-9f55-a769a3ff01ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:49.421701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-859fc17d-e724-406e-9f55-a769a3ff01ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:49.428389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-859fc17d-e724-406e-9f55-a769a3ff01ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:49.428868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-859fc17d-e724-406e-9f55-a769a3ff01ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:49.429632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-859fc17d-e724-406e-9f55-a769a3ff01ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:49.430063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-859fc17d-e724-406e-9f55-a769a3ff01ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:49.577801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-859fc17d-e724-406e-9f55-a769a3ff01ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:49.586313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-859fc17d-e724-406e-9f55-a769a3ff01ff tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.169594 Jul 28 20:08:49.586863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 704/1272] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:49 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:49.591699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ffd466d1-6a16-4188-9308-6d16a9c56060 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:49.593845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ffd466d1-6a16-4188-9308-6d16a9c56060 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:49.600419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ffd466d1-6a16-4188-9308-6d16a9c56060 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:49.600913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ffd466d1-6a16-4188-9308-6d16a9c56060 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:49.601669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ffd466d1-6a16-4188-9308-6d16a9c56060 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:49.602092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ffd466d1-6a16-4188-9308-6d16a9c56060 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:49.632341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ffd466d1-6a16-4188-9308-6d16a9c56060 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Jul 28 20:08:49.632909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 705/1273] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:49 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:49.637664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c7c360c1-239d-443f-961a-295fd04d050a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:49.639769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c7c360c1-239d-443f-961a-295fd04d050a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:49.645678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7c360c1-239d-443f-961a-295fd04d050a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:49.646172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7c360c1-239d-443f-961a-295fd04d050a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:49.647013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7c360c1-239d-443f-961a-295fd04d050a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:49.647470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7c360c1-239d-443f-961a-295fd04d050a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:49.678966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c7c360c1-239d-443f-961a-295fd04d050a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044917 Jul 28 20:08:49.679430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 706/1274] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:50.607803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5973dd5a-34ce-475a-9a12-99765f9e3696 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:50.608507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5973dd5a-34ce-475a-9a12-99765f9e3696 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:50.615112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5973dd5a-34ce-475a-9a12-99765f9e3696 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:50.615557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5973dd5a-34ce-475a-9a12-99765f9e3696 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:50.616313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5973dd5a-34ce-475a-9a12-99765f9e3696 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:50.616785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5973dd5a-34ce-475a-9a12-99765f9e3696 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:50.748825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5973dd5a-34ce-475a-9a12-99765f9e3696 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:50.757198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5973dd5a-34ce-475a-9a12-99765f9e3696 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.153304 Jul 28 20:08:50.758170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 707/1275] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:50.762531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d06a2d1b-aa82-4b47-a8bb-2b59dff898f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:50.764685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d06a2d1b-aa82-4b47-a8bb-2b59dff898f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:50.770753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d06a2d1b-aa82-4b47-a8bb-2b59dff898f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:50.771194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d06a2d1b-aa82-4b47-a8bb-2b59dff898f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:50.771952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d06a2d1b-aa82-4b47-a8bb-2b59dff898f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:50.772383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d06a2d1b-aa82-4b47-a8bb-2b59dff898f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:50.800394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d06a2d1b-aa82-4b47-a8bb-2b59dff898f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Jul 28 20:08:50.801490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 708/1276] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:50 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:50.805879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-82ee0c55-51c1-4ef7-9241-49a3e4d55be8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:50.807927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-82ee0c55-51c1-4ef7-9241-49a3e4d55be8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:50.813458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82ee0c55-51c1-4ef7-9241-49a3e4d55be8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:50.813906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82ee0c55-51c1-4ef7-9241-49a3e4d55be8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:50.814651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82ee0c55-51c1-4ef7-9241-49a3e4d55be8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:50.815083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82ee0c55-51c1-4ef7-9241-49a3e4d55be8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:50.842483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-82ee0c55-51c1-4ef7-9241-49a3e4d55be8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040036 Jul 28 20:08:50.843014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 709/1277] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:51.777135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-95f45352-8639-4162-8a79-2df2bae9e472 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:51.777792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-95f45352-8639-4162-8a79-2df2bae9e472 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:51.784418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95f45352-8639-4162-8a79-2df2bae9e472 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:51.784893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95f45352-8639-4162-8a79-2df2bae9e472 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:51.786534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95f45352-8639-4162-8a79-2df2bae9e472 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:51.786972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95f45352-8639-4162-8a79-2df2bae9e472 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:51.916947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-95f45352-8639-4162-8a79-2df2bae9e472 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:51.924415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-95f45352-8639-4162-8a79-2df2bae9e472 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151151 Jul 28 20:08:51.924992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 710/1278] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:51 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:51.929933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8efb727a-1780-4c45-b97a-83898e6433dc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:51.932145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8efb727a-1780-4c45-b97a-83898e6433dc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:51.937897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8efb727a-1780-4c45-b97a-83898e6433dc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:51.938382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8efb727a-1780-4c45-b97a-83898e6433dc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:51.939131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8efb727a-1780-4c45-b97a-83898e6433dc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:51.939552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8efb727a-1780-4c45-b97a-83898e6433dc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:51.956171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:51.970239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8efb727a-1780-4c45-b97a-83898e6433dc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Jul 28 20:08:51.970789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 711/1279] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:51.975680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc8db9a8-1194-4014-833b-b6637f327013 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:51.977800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc8db9a8-1194-4014-833b-b6637f327013 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:51.983431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc8db9a8-1194-4014-833b-b6637f327013 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:51.983874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc8db9a8-1194-4014-833b-b6637f327013 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:51.984652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc8db9a8-1194-4014-833b-b6637f327013 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:51.985078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc8db9a8-1194-4014-833b-b6637f327013 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:52.013315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc8db9a8-1194-4014-833b-b6637f327013 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041559 Jul 28 20:08:52.013866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 712/1280] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:52.946662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9591d249-7e2c-43d4-ad41-bf49c264b496 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:52.947428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9591d249-7e2c-43d4-ad41-bf49c264b496 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:52.953690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9591d249-7e2c-43d4-ad41-bf49c264b496 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:52.954131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9591d249-7e2c-43d4-ad41-bf49c264b496 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:52.954875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9591d249-7e2c-43d4-ad41-bf49c264b496 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:52.955292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9591d249-7e2c-43d4-ad41-bf49c264b496 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:53.087357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9591d249-7e2c-43d4-ad41-bf49c264b496 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:53.094922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9591d249-7e2c-43d4-ad41-bf49c264b496 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152122 Jul 28 20:08:53.095481 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 713/1281] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:52 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:53.100447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-200c0ca9-0da2-495b-b9ea-a5ffb12b0a3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:53.102593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-200c0ca9-0da2-495b-b9ea-a5ffb12b0a3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:53.108259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-200c0ca9-0da2-495b-b9ea-a5ffb12b0a3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:53.108747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-200c0ca9-0da2-495b-b9ea-a5ffb12b0a3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:53.109512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-200c0ca9-0da2-495b-b9ea-a5ffb12b0a3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:53.109947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-200c0ca9-0da2-495b-b9ea-a5ffb12b0a3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:53.138452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-200c0ca9-0da2-495b-b9ea-a5ffb12b0a3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041979 Jul 28 20:08:53.138992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 714/1282] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:53.143375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-33566742-0c61-40ce-8e65-454ba148b5f6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:53.145585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-33566742-0c61-40ce-8e65-454ba148b5f6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:53.151183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33566742-0c61-40ce-8e65-454ba148b5f6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:53.151626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33566742-0c61-40ce-8e65-454ba148b5f6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:53.152387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33566742-0c61-40ce-8e65-454ba148b5f6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:53.152855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33566742-0c61-40ce-8e65-454ba148b5f6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:53.182697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-33566742-0c61-40ce-8e65-454ba148b5f6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042668 Jul 28 20:08:53.183222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 715/1283] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:54.117162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-44473959-0d2f-4e47-ba70-fd663d373430 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:54.117966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-44473959-0d2f-4e47-ba70-fd663d373430 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:54.124649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44473959-0d2f-4e47-ba70-fd663d373430 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:54.125091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44473959-0d2f-4e47-ba70-fd663d373430 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:54.125835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44473959-0d2f-4e47-ba70-fd663d373430 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:54.126260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44473959-0d2f-4e47-ba70-fd663d373430 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:54.268741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-44473959-0d2f-4e47-ba70-fd663d373430 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:54.276260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-44473959-0d2f-4e47-ba70-fd663d373430 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.163199 Jul 28 20:08:54.276850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 716/1284] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:08:54.281298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6e5eba8b-1fa4-4633-8ebd-c2856d93e958 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:54.283647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6e5eba8b-1fa4-4633-8ebd-c2856d93e958 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:54.289357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6e5eba8b-1fa4-4633-8ebd-c2856d93e958 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:54.289802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6e5eba8b-1fa4-4633-8ebd-c2856d93e958 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:54.290548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6e5eba8b-1fa4-4633-8ebd-c2856d93e958 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:54.290977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6e5eba8b-1fa4-4633-8ebd-c2856d93e958 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:54.320856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6e5eba8b-1fa4-4633-8ebd-c2856d93e958 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042215 Jul 28 20:08:54.320856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 717/1285] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:54.325119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f10f88f7-3a04-48d5-a78c-7f1df3a9bca7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:54.327237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f10f88f7-3a04-48d5-a78c-7f1df3a9bca7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:54.333324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f10f88f7-3a04-48d5-a78c-7f1df3a9bca7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:54.333766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f10f88f7-3a04-48d5-a78c-7f1df3a9bca7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:54.334525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f10f88f7-3a04-48d5-a78c-7f1df3a9bca7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:54.334949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f10f88f7-3a04-48d5-a78c-7f1df3a9bca7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:54.362972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f10f88f7-3a04-48d5-a78c-7f1df3a9bca7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041361 Jul 28 20:08:54.364017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 718/1286] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:55.297479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8b4b5a92-c0d9-4cdc-ac55-604a575ce3c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:55.298137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8b4b5a92-c0d9-4cdc-ac55-604a575ce3c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:55.305135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b4b5a92-c0d9-4cdc-ac55-604a575ce3c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:55.305574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b4b5a92-c0d9-4cdc-ac55-604a575ce3c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:55.306317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b4b5a92-c0d9-4cdc-ac55-604a575ce3c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:55.306827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b4b5a92-c0d9-4cdc-ac55-604a575ce3c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:55.439072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8b4b5a92-c0d9-4cdc-ac55-604a575ce3c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:55.448125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8b4b5a92-c0d9-4cdc-ac55-604a575ce3c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.154516 Jul 28 20:08:55.448720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 719/1287] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:55.453383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-928e86a5-7096-41ce-8fb4-226be1ab335e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:55.455499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-928e86a5-7096-41ce-8fb4-226be1ab335e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:55.461935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-928e86a5-7096-41ce-8fb4-226be1ab335e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:55.462385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-928e86a5-7096-41ce-8fb4-226be1ab335e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:55.463145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-928e86a5-7096-41ce-8fb4-226be1ab335e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:55.463579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-928e86a5-7096-41ce-8fb4-226be1ab335e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:55.491833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-928e86a5-7096-41ce-8fb4-226be1ab335e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042110 Jul 28 20:08:55.492373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 720/1288] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:55 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:55.496969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9a9278eb-92a9-4fac-8e2e-7624c689fa3f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:55.499039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9a9278eb-92a9-4fac-8e2e-7624c689fa3f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:55.505325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a9278eb-92a9-4fac-8e2e-7624c689fa3f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:55.505773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a9278eb-92a9-4fac-8e2e-7624c689fa3f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:55.506532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a9278eb-92a9-4fac-8e2e-7624c689fa3f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:55.506964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a9278eb-92a9-4fac-8e2e-7624c689fa3f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:55.535424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9a9278eb-92a9-4fac-8e2e-7624c689fa3f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041876 Jul 28 20:08:55.535924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 721/1289] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:55.987125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:56.468976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f0b5c847-fe41-4811-89b7-fa758a2f38e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:56.469518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f0b5c847-fe41-4811-89b7-fa758a2f38e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:56.476257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0b5c847-fe41-4811-89b7-fa758a2f38e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:56.476829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0b5c847-fe41-4811-89b7-fa758a2f38e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:56.477575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0b5c847-fe41-4811-89b7-fa758a2f38e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:56.478001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0b5c847-fe41-4811-89b7-fa758a2f38e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:56.610260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f0b5c847-fe41-4811-89b7-fa758a2f38e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:56.618014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f0b5c847-fe41-4811-89b7-fa758a2f38e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.152963 Jul 28 20:08:56.618574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 722/1290] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:56 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:56.623105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d7c88da4-8e3b-4682-af13-89a05a9b2542 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:56.625220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d7c88da4-8e3b-4682-af13-89a05a9b2542 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:56.631131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7c88da4-8e3b-4682-af13-89a05a9b2542 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:56.631640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7c88da4-8e3b-4682-af13-89a05a9b2542 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:56.632396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7c88da4-8e3b-4682-af13-89a05a9b2542 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:56.632844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7c88da4-8e3b-4682-af13-89a05a9b2542 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:56.665025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d7c88da4-8e3b-4682-af13-89a05a9b2542 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045368 Jul 28 20:08:56.665558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 723/1291] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:56.670304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3130ac95-c9b4-460e-9d6b-5faa0c347d51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:56.672818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3130ac95-c9b4-460e-9d6b-5faa0c347d51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:56.678965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3130ac95-c9b4-460e-9d6b-5faa0c347d51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:56.679407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3130ac95-c9b4-460e-9d6b-5faa0c347d51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:56.680161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3130ac95-c9b4-460e-9d6b-5faa0c347d51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:56.680605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3130ac95-c9b4-460e-9d6b-5faa0c347d51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:56.709141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3130ac95-c9b4-460e-9d6b-5faa0c347d51 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042554 Jul 28 20:08:56.709694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 724/1292] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:56 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:57.639091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-de64c301-69d8-4eca-8ea4-fc75646a7b98 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:57.639767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-de64c301-69d8-4eca-8ea4-fc75646a7b98 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:57.646717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de64c301-69d8-4eca-8ea4-fc75646a7b98 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:57.647158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de64c301-69d8-4eca-8ea4-fc75646a7b98 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:57.647913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de64c301-69d8-4eca-8ea4-fc75646a7b98 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:57.648340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de64c301-69d8-4eca-8ea4-fc75646a7b98 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:57.779226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-de64c301-69d8-4eca-8ea4-fc75646a7b98 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:57.786982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-de64c301-69d8-4eca-8ea4-fc75646a7b98 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.151749 Jul 28 20:08:57.787570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 725/1293] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:57.792117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b81e0c80-6ba2-40af-9b77-ae05d34a8c60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:57.794311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b81e0c80-6ba2-40af-9b77-ae05d34a8c60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:57.800065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b81e0c80-6ba2-40af-9b77-ae05d34a8c60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:57.800513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b81e0c80-6ba2-40af-9b77-ae05d34a8c60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:57.801959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b81e0c80-6ba2-40af-9b77-ae05d34a8c60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:57.802388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b81e0c80-6ba2-40af-9b77-ae05d34a8c60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:57.830847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b81e0c80-6ba2-40af-9b77-ae05d34a8c60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Jul 28 20:08:57.831389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 726/1294] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:57 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:57.836312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b2ad6687-2132-4402-876c-34a0b81a07a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:57.838397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b2ad6687-2132-4402-876c-34a0b81a07a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:57.843864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2ad6687-2132-4402-876c-34a0b81a07a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:57.844315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2ad6687-2132-4402-876c-34a0b81a07a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:57.845110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2ad6687-2132-4402-876c-34a0b81a07a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:57.845539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2ad6687-2132-4402-876c-34a0b81a07a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:57.873575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b2ad6687-2132-4402-876c-34a0b81a07a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041219 Jul 28 20:08:57.874115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 727/1295] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:58.807994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c64fd12-7187-4fe8-9aa4-4a7a00583322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:58.808685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3c64fd12-7187-4fe8-9aa4-4a7a00583322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:58.815127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c64fd12-7187-4fe8-9aa4-4a7a00583322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:58.815573 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c64fd12-7187-4fe8-9aa4-4a7a00583322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:58.816323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c64fd12-7187-4fe8-9aa4-4a7a00583322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:58.817322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c64fd12-7187-4fe8-9aa4-4a7a00583322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:58.821276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:08:58.951028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3c64fd12-7187-4fe8-9aa4-4a7a00583322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:08:58.959485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3c64fd12-7187-4fe8-9aa4-4a7a00583322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.155368 Jul 28 20:08:58.960034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 728/1296] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:58 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:08:58.964691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f5c38e7e-77bb-4b17-b415-8c9f624a0b6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:58.966873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f5c38e7e-77bb-4b17-b415-8c9f624a0b6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:58.972485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5c38e7e-77bb-4b17-b415-8c9f624a0b6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:58.973080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5c38e7e-77bb-4b17-b415-8c9f624a0b6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:58.973908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5c38e7e-77bb-4b17-b415-8c9f624a0b6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:58.974334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5c38e7e-77bb-4b17-b415-8c9f624a0b6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:59.002930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f5c38e7e-77bb-4b17-b415-8c9f624a0b6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Jul 28 20:08:59.003465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 729/1297] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:59.008450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cebf5ea2-d444-4ead-8166-3947b7963dc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:59.010597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cebf5ea2-d444-4ead-8166-3947b7963dc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:59.016076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebf5ea2-d444-4ead-8166-3947b7963dc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:59.016516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebf5ea2-d444-4ead-8166-3947b7963dc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:59.017291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebf5ea2-d444-4ead-8166-3947b7963dc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:59.017716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebf5ea2-d444-4ead-8166-3947b7963dc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:59.054412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cebf5ea2-d444-4ead-8166-3947b7963dc5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049431 Jul 28 20:08:59.054974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 730/1298] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:08:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:08:59.980932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-326300b3-b793-420c-9e69-49a4fc787758 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:08:59.981584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-326300b3-b793-420c-9e69-49a4fc787758 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:08:59.988059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-326300b3-b793-420c-9e69-49a4fc787758 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:59.989098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-326300b3-b793-420c-9e69-49a4fc787758 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:08:59.989931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-326300b3-b793-420c-9e69-49a4fc787758 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:08:59.990367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-326300b3-b793-420c-9e69-49a4fc787758 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:00.119154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-326300b3-b793-420c-9e69-49a4fc787758 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:09:00.126658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-326300b3-b793-420c-9e69-49a4fc787758 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.149730 Jul 28 20:09:00.127215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 731/1299] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:08:59 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:09:00.131993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc696339-bd74-420b-b3eb-4d95961f1009 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:09:00.134142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc696339-bd74-420b-b3eb-4d95961f1009 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:09:00.139748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc696339-bd74-420b-b3eb-4d95961f1009 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:00.140194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc696339-bd74-420b-b3eb-4d95961f1009 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:00.141023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc696339-bd74-420b-b3eb-4d95961f1009 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:00.141459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc696339-bd74-420b-b3eb-4d95961f1009 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:00.174284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc696339-bd74-420b-b3eb-4d95961f1009 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Jul 28 20:09:00.174849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 732/1300] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:09:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:09:00.179494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-66895591-d054-4b74-a581-9b220dd29d2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:09:00.181637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-66895591-d054-4b74-a581-9b220dd29d2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:09:00.187326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66895591-d054-4b74-a581-9b220dd29d2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:00.187767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66895591-d054-4b74-a581-9b220dd29d2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:00.188519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66895591-d054-4b74-a581-9b220dd29d2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:00.188973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66895591-d054-4b74-a581-9b220dd29d2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:00.216635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-66895591-d054-4b74-a581-9b220dd29d2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040786 Jul 28 20:09:00.217179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 733/1301] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:09:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:09:01.149727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-00bf4441-c52e-49c4-996a-28244cfd96bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:09:01.150422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-00bf4441-c52e-49c4-996a-28244cfd96bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:09:01.157074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00bf4441-c52e-49c4-996a-28244cfd96bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:01.157519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00bf4441-c52e-49c4-996a-28244cfd96bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:01.158270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00bf4441-c52e-49c4-996a-28244cfd96bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:01.158723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00bf4441-c52e-49c4-996a-28244cfd96bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:01.292432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-00bf4441-c52e-49c4-996a-28244cfd96bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:09:01.299953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-00bf4441-c52e-49c4-996a-28244cfd96bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.156286 Jul 28 20:09:01.300509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 734/1302] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:09:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:09:01.306334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-44194b1b-cdb1-4a20-b0ef-a3089da91957 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:09:01.308444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-44194b1b-cdb1-4a20-b0ef-a3089da91957 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:09:01.314064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44194b1b-cdb1-4a20-b0ef-a3089da91957 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:01.314507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44194b1b-cdb1-4a20-b0ef-a3089da91957 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:01.315254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44194b1b-cdb1-4a20-b0ef-a3089da91957 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:01.315715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44194b1b-cdb1-4a20-b0ef-a3089da91957 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:01.345627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-44194b1b-cdb1-4a20-b0ef-a3089da91957 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042788 Jul 28 20:09:01.346167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 735/1303] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:09:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:09:01.351149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:09:01.351661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:09:01.357064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:01.357510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:01.358261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:09:01.358692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:09:11.354799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=84 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:09:11.376875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=50 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:01.448311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a921b9b-1963-483e-88c3-7fb21505ea7c) Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 HTTP/1.1 Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:10:01.451660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:10:01.453396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a921b9b-1963-483e-88c3-7fb21505ea7c) Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'server_id': '0038fe10-b9ea-4fe0-a220-9c2ab37f67ed', 'id': 'ead09975-af7f-40eb-ae0c-70936b340da0'} Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:10:01.454068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a921b9b-1963-483e-88c3-7fb21505ea7c) Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:10:01.455228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a921b9b-1963-483e-88c3-7fb21505ea7c) Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:01.456973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a921b9b-1963-483e-88c3-7fb21505ea7c) Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:10:01.458070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a921b9b-1963-483e-88c3-7fb21505ea7c) Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a921b9b-1963-483e-88c3-7fb21505ea7c) Jul 28 20:10:01.459216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:10:01.460287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6a921b9b-1963-483e-88c3-7fb21505ea7c) {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:10:01.460287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-873c1ac9-4101-404e-8a45-5427ef269f63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 400 len: 269 microversion: 2.1 time: 119.986073 Jul 28 20:10:01.460287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 569/1304] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:08:01 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 269 bytes in 119987 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:10:01.527755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c9b3aa1a-285e-42a5-9b75-a3ce9fb6286f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:10:01.530076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c9b3aa1a-285e-42a5-9b75-a3ce9fb6286f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:10:01.538472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9b3aa1a-285e-42a5-9b75-a3ce9fb6286f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:01.538924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9b3aa1a-285e-42a5-9b75-a3ce9fb6286f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:01.539690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9b3aa1a-285e-42a5-9b75-a3ce9fb6286f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:01.540118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9b3aa1a-285e-42a5-9b75-a3ce9fb6286f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:01.561438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'services' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:10:01.569641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c9b3aa1a-285e-42a5-9b75-a3ce9fb6286f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114894 Jul 28 20:10:01.570354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 570/1305] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:10:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:10:01.574584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d36bbe13-b951-4185-a7d6-1344d952b2e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:10:01.575187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d36bbe13-b951-4185-a7d6-1344d952b2e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:10:01.581072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d36bbe13-b951-4185-a7d6-1344d952b2e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:01.582779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d36bbe13-b951-4185-a7d6-1344d952b2e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:01.583552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d36bbe13-b951-4185-a7d6-1344d952b2e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:01.583987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d36bbe13-b951-4185-a7d6-1344d952b2e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:01.723232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d36bbe13-b951-4185-a7d6-1344d952b2e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:10:01.730831 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d36bbe13-b951-4185-a7d6-1344d952b2e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.159691 Jul 28 20:10:01.731384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 571/1306] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:10:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:10:01.735853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-985fa26e-fa2c-46da-a498-5a7a455edc64 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:10:01.738596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-985fa26e-fa2c-46da-a498-5a7a455edc64 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:10:01.744275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-985fa26e-fa2c-46da-a498-5a7a455edc64 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:01.744760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-985fa26e-fa2c-46da-a498-5a7a455edc64 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:01.745515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-985fa26e-fa2c-46da-a498-5a7a455edc64 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:01.746006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-985fa26e-fa2c-46da-a498-5a7a455edc64 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:01.776655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-985fa26e-fa2c-46da-a498-5a7a455edc64 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044223 Jul 28 20:10:01.777181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 572/1307] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:10:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:10:01.781631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:10:01.782405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:10:01.788402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:01.788950 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:01.789706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:01.790138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:11.572626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=4 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:11.786579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=8 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:11.808688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=22 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:18.564387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:10:18.565009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:10:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 (ip 10.222.0.67) !!! Jul 28 20:10:46.173293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dd816ff-aed7-408c-a773-9347b5a07c24) Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 HTTP/1.1 Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:10:46.175525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:10:46.177192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dd816ff-aed7-408c-a773-9347b5a07c24) Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': '0038fe10-b9ea-4fe0-a220-9c2ab37f67ed', 'id': 'ead09975-af7f-40eb-ae0c-70936b340da0'} Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:10:46.178206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dd816ff-aed7-408c-a773-9347b5a07c24) Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:10:46.179386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dd816ff-aed7-408c-a773-9347b5a07c24) Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:46.180562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dd816ff-aed7-408c-a773-9347b5a07c24) Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:10:46.181588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dd816ff-aed7-408c-a773-9347b5a07c24) Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dd816ff-aed7-408c-a773-9347b5a07c24) Jul 28 20:10:46.182701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:10:46.183831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4dd816ff-aed7-408c-a773-9347b5a07c24) {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:10:46.183831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d63842ec-0508-429f-b8d4-b84f77185804 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 400 len: 269 microversion: 2.1 time: 104.830035 Jul 28 20:10:46.183831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 736/1308] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:09:01 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 269 bytes in 104831 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:10:46.183831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8be16d37-8b54-4204-b032-22f68f2ad0ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:10:46.185581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8be16d37-8b54-4204-b032-22f68f2ad0ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:10:46.191594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8be16d37-8b54-4204-b032-22f68f2ad0ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:46.192044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8be16d37-8b54-4204-b032-22f68f2ad0ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:46.193340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8be16d37-8b54-4204-b032-22f68f2ad0ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:46.193785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8be16d37-8b54-4204-b032-22f68f2ad0ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:46.223354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8be16d37-8b54-4204-b032-22f68f2ad0ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044295 Jul 28 20:10:46.224157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 737/1309] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:10:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:10:46.224559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'services' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:10:46.228843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fe3b707c-5f6f-4bbc-b8e5-60911bf61395 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:10:46.229338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fe3b707c-5f6f-4bbc-b8e5-60911bf61395 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:10:46.235159 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe3b707c-5f6f-4bbc-b8e5-60911bf61395 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:46.235617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe3b707c-5f6f-4bbc-b8e5-60911bf61395 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:46.236382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe3b707c-5f6f-4bbc-b8e5-60911bf61395 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:10:46.236846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe3b707c-5f6f-4bbc-b8e5-60911bf61395 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:10:56.229356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:56.232853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=4 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:10:56.255776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=10 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:11:25.794269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:11:25.794875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:11:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 (ip 10.222.0.67) !!! Jul 28 20:11:48.286626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:11:48.287141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:11:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c (ip 10.222.0.67) !!! Jul 28 20:11:52.001260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:11:52.001974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:11:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 (ip 10.222.0.67) !!! Jul 28 20:12:01.678947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1df3046-1b44-4589-b921-2db4e0d1b3b0) Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 HTTP/1.1 Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:12:01.681391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:12:01.683324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1df3046-1b44-4589-b921-2db4e0d1b3b0) Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'server_id': '0038fe10-b9ea-4fe0-a220-9c2ab37f67ed', 'id': 'ead09975-af7f-40eb-ae0c-70936b340da0'} Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:12:01.684117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1df3046-1b44-4589-b921-2db4e0d1b3b0) Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:12:01.686183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1df3046-1b44-4589-b921-2db4e0d1b3b0) Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:12:01.687586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1df3046-1b44-4589-b921-2db4e0d1b3b0) Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:12:01.689087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1df3046-1b44-4589-b921-2db4e0d1b3b0) Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1df3046-1b44-4589-b921-2db4e0d1b3b0) Jul 28 20:12:01.690576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:12:01.692413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1df3046-1b44-4589-b921-2db4e0d1b3b0) {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:12:01.692413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2c4befd4-cb95-4ed2-a6f6-538b50b4a0e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 400 len: 269 microversion: 2.1 time: 119.904799 Jul 28 20:12:01.692413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 573/1310] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:10:01 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 269 bytes in 119906 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:12:01.758640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ae6c3326-dd0f-41c9-be1d-36044e9f478f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:12:01.759247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ae6c3326-dd0f-41c9-be1d-36044e9f478f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:12:01.765423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae6c3326-dd0f-41c9-be1d-36044e9f478f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:01.765881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae6c3326-dd0f-41c9-be1d-36044e9f478f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:01.766638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae6c3326-dd0f-41c9-be1d-36044e9f478f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:01.767069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae6c3326-dd0f-41c9-be1d-36044e9f478f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:01.793419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-fe3b707c-5f6f-4bbc-b8e5-60911bf61395 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lazy-loading 'services' on Instance uuid 768bb30f-60d9-4ad9-af77-64aadcfe531a {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:12:01.903593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ae6c3326-dd0f-41c9-be1d-36044e9f478f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:12:01.911599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ae6c3326-dd0f-41c9-be1d-36044e9f478f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.226697 Jul 28 20:12:01.912157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 574/1311] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:12:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:12:01.916693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-db8695f9-4040-4e43-b685-635dcef699f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:12:01.918926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-db8695f9-4040-4e43-b685-635dcef699f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:12:01.924653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db8695f9-4040-4e43-b685-635dcef699f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:01.925102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db8695f9-4040-4e43-b685-635dcef699f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:01.925852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db8695f9-4040-4e43-b685-635dcef699f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:01.926361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db8695f9-4040-4e43-b685-635dcef699f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:02.043288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-db8695f9-4040-4e43-b685-635dcef699f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/action" status: 200 len: 41123 microversion: 2.1 time: 0.129863 Jul 28 20:12:02.043935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 575/1312] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:12:01 2022] POST /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743/action => generated 41123 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:12:02.048994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9380a7b7-2daa-45c3-b0c8-15e23ac2f7c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:12:02.051702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9380a7b7-2daa-45c3-b0c8-15e23ac2f7c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:12:02.058560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9380a7b7-2daa-45c3-b0c8-15e23ac2f7c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:02.059005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9380a7b7-2daa-45c3-b0c8-15e23ac2f7c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:02.059762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9380a7b7-2daa-45c3-b0c8-15e23ac2f7c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:02.060195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9380a7b7-2daa-45c3-b0c8-15e23ac2f7c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:02.174845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9380a7b7-2daa-45c3-b0c8-15e23ac2f7c9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/action" status: 200 len: 82133 microversion: 2.1 time: 0.129470 Jul 28 20:12:02.175507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 576/1313] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:12:02 2022] POST /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/action => generated 82133 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:12:02.181141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:12:02.181723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:12:02.188688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:02.189145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:02.189904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:02.190340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:07.932969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:12:07.933554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:12:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c (ip 10.222.0.67) !!! Jul 28 20:12:11.806144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=4 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:12:12.186335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=8 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:12:12.210913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=18 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:12:46.343548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fe3b707c-5f6f-4bbc-b8e5-60911bf61395 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c" status: 202 len: 0 microversion: 2.1 time: 120.118378 Jul 28 20:12:46.344397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 738/1314] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:10:46 2022] DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c => generated 0 bytes in 120120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:12:46.352437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:12:46.353478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:12:46.359820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:46.360265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:46.361052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:12:46.361487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:12:46.386317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'services' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:12:56.356796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:12:56.384125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:12:56.391153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:13:38.572501 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:13:38.573106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c (ip 10.222.0.67) !!! Jul 28 20:14:02.228943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lazy-loading 'services' on Instance uuid 768bb30f-60d9-4ad9-af77-64aadcfe531a {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:02.411442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e7acac9f-c34d-41f3-99ab-a32f47831e1d) Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 HTTP/1.1 Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:14:02.414712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:14:02.416315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e7acac9f-c34d-41f3-99ab-a32f47831e1d) Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'server_id': '0038fe10-b9ea-4fe0-a220-9c2ab37f67ed', 'id': 'ead09975-af7f-40eb-ae0c-70936b340da0'} Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:02.418013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e7acac9f-c34d-41f3-99ab-a32f47831e1d) Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:02.420275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e7acac9f-c34d-41f3-99ab-a32f47831e1d) Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.424138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e7acac9f-c34d-41f3-99ab-a32f47831e1d) Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.426137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e7acac9f-c34d-41f3-99ab-a32f47831e1d) Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e7acac9f-c34d-41f3-99ab-a32f47831e1d) Jul 28 20:14:02.427770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.429332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e7acac9f-c34d-41f3-99ab-a32f47831e1d) {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:02.429332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2aab4b07-71ea-4a9f-bae7-92659c3083d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 400 len: 269 microversion: 2.1 time: 120.239680 Jul 28 20:14:02.429332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 577/1315] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:12:02 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 269 bytes in 120241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:02.429332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-875e8b29-8072-4c09-b3c2-a8f824e5610e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:02.429663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-875e8b29-8072-4c09-b3c2-a8f824e5610e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:02.430234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-875e8b29-8072-4c09-b3c2-a8f824e5610e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.430693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-875e8b29-8072-4c09-b3c2-a8f824e5610e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.431463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-875e8b29-8072-4c09-b3c2-a8f824e5610e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.431899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-875e8b29-8072-4c09-b3c2-a8f824e5610e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.538093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9989898e-8d57-41b3-8f4e-39e84233893c) Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Request method failure captured: Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c HTTP/1.1 Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4ur1zSHv01gg34TFkXuzNCv29zYUg46FPaXMA213_kls4uoFuV6FjYZ-w_RhmNOzbvZeiIoZpkG6_oVHrrctlCk1RLae13dKWMn0LqYdUwKkCqMtuH8JRTsd0V86XgCK-HTKodwItK7fVDMXhylAGaIHS88Rh7N1fuz2Wey9wz76HZU Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:14:02.540402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cc82c1496470409ca70c8cc12023a91e"}]}] Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 316033501d684cc680770c4ccda85d40 Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:14:02.541710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9989898e-8d57-41b3-8f4e-39e84233893c) Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': '768bb30f-60d9-4ad9-af77-64aadcfe531a', 'id': '73be0a6e-c54a-4300-afc6-99e7e3423a2c'} Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:02.543123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9989898e-8d57-41b3-8f4e-39e84233893c) Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:02.544336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9989898e-8d57-41b3-8f4e-39e84233893c) Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.545463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9989898e-8d57-41b3-8f4e-39e84233893c) Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.546434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9989898e-8d57-41b3-8f4e-39e84233893c) Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9989898e-8d57-41b3-8f4e-39e84233893c) Jul 28 20:14:02.547513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.549802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9989898e-8d57-41b3-8f4e-39e84233893c) {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:02.549802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6b594430-3460-4328-b4b7-42e1764b4365 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c" status: 400 len: 269 microversion: 2.1 time: 76.196379 Jul 28 20:14:02.549802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 739/1316] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:12:46 2022] DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c => generated 269 bytes in 76199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:02.550868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:02.551363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:02.557944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.558447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.559216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.559653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.573623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-875e8b29-8072-4c09-b3c2-a8f824e5610e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:02.581761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-875e8b29-8072-4c09-b3c2-a8f824e5610e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.163247 Jul 28 20:14:02.582771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 578/1317] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:02.587932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:02.588735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:02.597326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.597880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.598707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.599373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.689899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lazy-loading 'services' on Instance uuid ed7c90e0-e87c-42b9-b14d-6c06761c1eef {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:02.733711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'services' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:02.761655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03f7bbf6-1001-4c6f-adc0-884dab758935) Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Request method failure captured: Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac HTTP/1.1 Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uqn9Yz9PUjkOhuuxPkvhfMWuCSxxDmN1BPG4wjfto6sQ9y2AZCBg7ER4tPzVhwlrYekqps8fJnS9RHksjR7J-HSD7PzMfItfL9jNYZ1t3-5kSaVEz0OmTlh-Jbwk_W9WRm9D6AAL5PRgT_uOHbgHv-OFmazo_pHrcWELooOsfy3qxY Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 1a73bb1237bb4bcfa86aa6dc5bf413c7 Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-TestMinimumBasicScenario-569454584 Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:14:02.764676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}] Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-TestMinimumBasicScenario-569454584 Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 1a73bb1237bb4bcfa86aa6dc5bf413c7 Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-TestMinimumBasicScenario-569454584 Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-TestMinimumBasicScenario-569454584-project Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 3f7d1d13bfb843df855bc4d57374a8ab Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-TestMinimumBasicScenario-569454584-project Jul 28 20:14:02.766025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03f7bbf6-1001-4c6f-adc0-884dab758935) Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': 'ed7c90e0-e87c-42b9-b14d-6c06761c1eef', 'id': 'cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac'} Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:02.766944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03f7bbf6-1001-4c6f-adc0-884dab758935) Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:02.768004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03f7bbf6-1001-4c6f-adc0-884dab758935) Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.769234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03f7bbf6-1001-4c6f-adc0-884dab758935) Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.770315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03f7bbf6-1001-4c6f-adc0-884dab758935) Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03f7bbf6-1001-4c6f-adc0-884dab758935) Jul 28 20:14:02.771374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.772424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-03f7bbf6-1001-4c6f-adc0-884dab758935) {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:02.772424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a320b3e2-cef4-4730-9fa0-f234087607a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac" status: 400 len: 269 microversion: 2.1 time: 0.221158 Jul 28 20:14:02.772424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 740/1318] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:14:02 2022] DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac => generated 269 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:02.772424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:02.774614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:02.779416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.780091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.780948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.781384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.806808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4a181e6-5c65-4ddf-bf80-bf8c91679fef) Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 HTTP/1.1 Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:14:02.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:14:02.811136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4a181e6-5c65-4ddf-bf80-bf8c91679fef) Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'server_id': '0038fe10-b9ea-4fe0-a220-9c2ab37f67ed', 'id': 'ead09975-af7f-40eb-ae0c-70936b340da0'} Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:02.812079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4a181e6-5c65-4ddf-bf80-bf8c91679fef) Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:02.813471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4a181e6-5c65-4ddf-bf80-bf8c91679fef) Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.815623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4a181e6-5c65-4ddf-bf80-bf8c91679fef) Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.816909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4a181e6-5c65-4ddf-bf80-bf8c91679fef) Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4a181e6-5c65-4ddf-bf80-bf8c91679fef) Jul 28 20:14:02.818246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.819518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4a181e6-5c65-4ddf-bf80-bf8c91679fef) {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:02.819518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-80a3fdf0-c715-4945-9402-a6c8fe9c7baf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 400 len: 269 microversion: 2.1 time: 0.227173 Jul 28 20:14:02.819518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 579/1319] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:14:02 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 269 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:02.933404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:02.933798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:02.939746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.940195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.940989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.941429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.954562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] HTTP exception thrown: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Request method failure captured: Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 HTTP/1.1 Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4upjl8cyhU1Y-w0-xb4Q0VeT6_hQY1Tv0LbmZX-xo3Dkz5AfzsYkSINiJAmdRwJGkFLNDTbXBxqHZbHCk9D2iaP0GLbmd9kw4moiYSBLcfjh22aCpFNERVOvLSrUi_nx2W0Y0UmNcKbFaCPafVRcE7IjtIBs8VezAHDf7jHyDrP2OYk Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:14:02.956103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70cb4fda232e46b6842f8aa7840e48a7"}]}] Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 4e0e1988c7f44d5198811aca33e1345e Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:02.957609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': '4889e06d-18cf-4e5e-9f68-8c168109c1d3'} Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:02.958398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:02.959849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:02.961370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Returning 404 to user: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:02.961370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a86b7b3a-2bb7-4702-9592-69b9b9e8a2c1 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 404 len: 111 microversion: 2.20 time: 0.144501 Jul 28 20:14:02.961370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 580/1320] 10.222.0.67 () {60 vars in 1280 bytes} [Thu Jul 28 20:14:02 2022] DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:02.962963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4b199dc2-cc88-482c-9649-b4dc8d8922c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:02.963563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4b199dc2-cc88-482c-9649-b4dc8d8922c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:02.969402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b199dc2-cc88-482c-9649-b4dc8d8922c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.969855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b199dc2-cc88-482c-9649-b4dc8d8922c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:02.970613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b199dc2-cc88-482c-9649-b4dc8d8922c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:02.971046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b199dc2-cc88-482c-9649-b4dc8d8922c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:03.098977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4b199dc2-cc88-482c-9649-b4dc8d8922c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:03.107054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4b199dc2-cc88-482c-9649-b4dc8d8922c0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.147495 Jul 28 20:14:03.107617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 581/1321] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:03.112327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:03.112916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:03.118496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:03.118945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:03.119726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:03.120300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:12.775700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=4 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:12.801467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=16 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:13.116798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=10 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:13.138815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=26 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:45.802211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:14:45.802946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac (ip 10.222.0.67) !!! Jul 28 20:14:46.498773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lazy-loading 'services' on Instance uuid 768bb30f-60d9-4ad9-af77-64aadcfe531a {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:46.557263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lazy-loading 'services' on Instance uuid ed7c90e0-e87c-42b9-b14d-6c06761c1eef {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:46.627996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0660143c-e795-4d28-bf9e-5dedaa0dcb4a) Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Request method failure captured: Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c HTTP/1.1 Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4ur1zSHv01gg34TFkXuzNCv29zYUg46FPaXMA213_kls4uoFuV6FjYZ-w_RhmNOzbvZeiIoZpkG6_oVHrrctlCk1RLae13dKWMn0LqYdUwKkCqMtuH8JRTsd0V86XgCK-HTKodwItK7fVDMXhylAGaIHS88Rh7N1fuz2Wey9wz76HZU Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:14:46.630259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cc82c1496470409ca70c8cc12023a91e"}]}] Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 316033501d684cc680770c4ccda85d40 Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:14:46.631651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0660143c-e795-4d28-bf9e-5dedaa0dcb4a) Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': '768bb30f-60d9-4ad9-af77-64aadcfe531a', 'id': '73be0a6e-c54a-4300-afc6-99e7e3423a2c'} Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:46.632807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0660143c-e795-4d28-bf9e-5dedaa0dcb4a) Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:46.633930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0660143c-e795-4d28-bf9e-5dedaa0dcb4a) Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.635071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0660143c-e795-4d28-bf9e-5dedaa0dcb4a) Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.636074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0660143c-e795-4d28-bf9e-5dedaa0dcb4a) Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0660143c-e795-4d28-bf9e-5dedaa0dcb4a) Jul 28 20:14:46.637252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.638303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0660143c-e795-4d28-bf9e-5dedaa0dcb4a) {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:46.638303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-05188f4a-651c-4d01-a2fd-447e1aa13e6d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c" status: 400 len: 269 microversion: 2.1 time: 43.863817 Jul 28 20:14:46.638303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 741/1322] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:14:02 2022] DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c => generated 269 bytes in 43865 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:46.638303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:46.638614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:46.643825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.644278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.645095 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.645725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.668639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1ca6b8f-4e4c-44ac-b0b9-f70971f47559) Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Request method failure captured: Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac HTTP/1.1 Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uqn9Yz9PUjkOhuuxPkvhfMWuCSxxDmN1BPG4wjfto6sQ9y2AZCBg7ER4tPzVhwlrYekqps8fJnS9RHksjR7J-HSD7PzMfItfL9jNYZ1t3-5kSaVEz0OmTlh-Jbwk_W9WRm9D6AAL5PRgT_uOHbgHv-OFmazo_pHrcWELooOsfy3qxY Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 1a73bb1237bb4bcfa86aa6dc5bf413c7 Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-TestMinimumBasicScenario-569454584 Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:14:46.670824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}] Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-TestMinimumBasicScenario-569454584 Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 1a73bb1237bb4bcfa86aa6dc5bf413c7 Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-TestMinimumBasicScenario-569454584 Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-TestMinimumBasicScenario-569454584-project Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 3f7d1d13bfb843df855bc4d57374a8ab Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-TestMinimumBasicScenario-569454584-project Jul 28 20:14:46.672398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1ca6b8f-4e4c-44ac-b0b9-f70971f47559) Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'server_id': 'ed7c90e0-e87c-42b9-b14d-6c06761c1eef', 'id': 'cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac'} Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:46.673138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1ca6b8f-4e4c-44ac-b0b9-f70971f47559) Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:46.674145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1ca6b8f-4e4c-44ac-b0b9-f70971f47559) Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.675682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1ca6b8f-4e4c-44ac-b0b9-f70971f47559) Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.677847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1ca6b8f-4e4c-44ac-b0b9-f70971f47559) Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1ca6b8f-4e4c-44ac-b0b9-f70971f47559) Jul 28 20:14:46.679319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.680594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c1ca6b8f-4e4c-44ac-b0b9-f70971f47559) {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:46.680594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a0acab77-ccc6-4fc5-a062-fda71b6ba312 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac" status: 400 len: 269 microversion: 2.1 time: 43.563544 Jul 28 20:14:46.680594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 582/1323] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:14:03 2022] DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac => generated 269 bytes in 43565 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:46.680594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:46.680922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:46.685480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.685933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.686710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.687179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.728029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'services' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:46.769026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lazy-loading 'services' on Instance uuid 768bb30f-60d9-4ad9-af77-64aadcfe531a {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:46.797740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-754c5fcf-e025-4909-8d83-9266c46baee1) Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 HTTP/1.1 Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:14:46.799945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:14:46.801411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-754c5fcf-e025-4909-8d83-9266c46baee1) Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': '0038fe10-b9ea-4fe0-a220-9c2ab37f67ed', 'id': 'ead09975-af7f-40eb-ae0c-70936b340da0'} Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:46.802970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-754c5fcf-e025-4909-8d83-9266c46baee1) Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:46.804853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-754c5fcf-e025-4909-8d83-9266c46baee1) Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.807846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-754c5fcf-e025-4909-8d83-9266c46baee1) Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.809217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-754c5fcf-e025-4909-8d83-9266c46baee1) Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-754c5fcf-e025-4909-8d83-9266c46baee1) Jul 28 20:14:46.810674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.811817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-754c5fcf-e025-4909-8d83-9266c46baee1) {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:46.811817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a593faa2-72df-4d6e-b520-69572643db12 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 400 len: 269 microversion: 2.1 time: 0.168210 Jul 28 20:14:46.811817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 742/1324] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:14:46 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:46.811817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:46.812179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:46.815031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.815442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.816384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.816857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.830603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] HTTP exception thrown: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Request method failure captured: Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 HTTP/1.1 Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upjl8cyhU1Y-w0-xb4Q0VeT6_hQY1Tv0LbmZX-xo3Dkz5AfzsYkSINiJAmdRwJGkFLNDTbXBxqHZbHCk9D2iaP0GLbmd9kw4moiYSBLcfjh22aCpFNERVOvLSrUi_nx2W0Y0UmNcKbFaCPafVRcE7IjtIBs8VezAHDf7jHyDrP2OYk Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:14:46.832274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70cb4fda232e46b6842f8aa7840e48a7"}]}] Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 4e0e1988c7f44d5198811aca33e1345e Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:46.835366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '4889e06d-18cf-4e5e-9f68-8c168109c1d3'} Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:46.837106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:46.839715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.841232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Returning 404 to user: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:46.841232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6ddc6abb-2a43-4590-aeef-0c571576fef8 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 404 len: 111 microversion: 2.20 time: 0.030315 Jul 28 20:14:46.841391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eaab90e4-6505-4f36-aaaa-d762eba23839) Jul 28 20:14:46.841875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 743/1325] 10.222.0.67 () {60 vars in 1280 bytes} [Thu Jul 28 20:14:46 2022] DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Request method failure captured: Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c HTTP/1.1 Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4ur1zSHv01gg34TFkXuzNCv29zYUg46FPaXMA213_kls4uoFuV6FjYZ-w_RhmNOzbvZeiIoZpkG6_oVHrrctlCk1RLae13dKWMn0LqYdUwKkCqMtuH8JRTsd0V86XgCK-HTKodwItK7fVDMXhylAGaIHS88Rh7N1fuz2Wey9wz76HZU Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:14:46.841966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cc82c1496470409ca70c8cc12023a91e"}]}] Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 316033501d684cc680770c4ccda85d40 Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:14:46.843203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eaab90e4-6505-4f36-aaaa-d762eba23839) Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'server_id': '768bb30f-60d9-4ad9-af77-64aadcfe531a', 'id': '73be0a6e-c54a-4300-afc6-99e7e3423a2c'} Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:46.843828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eaab90e4-6505-4f36-aaaa-d762eba23839) Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:46.845197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eaab90e4-6505-4f36-aaaa-d762eba23839) Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.846536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eaab90e4-6505-4f36-aaaa-d762eba23839) Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.847538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eaab90e4-6505-4f36-aaaa-d762eba23839) Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eaab90e4-6505-4f36-aaaa-d762eba23839) Jul 28 20:14:46.849121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:46.850199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eaab90e4-6505-4f36-aaaa-d762eba23839) {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:46.850199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8eb708f3-0159-41ed-98fd-c200c7ff0e8a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c" status: 400 len: 269 microversion: 2.1 time: 0.164815 Jul 28 20:14:46.850199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 583/1326] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:14:46 2022] DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c => generated 269 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:46.850545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ee925309-93ea-4254-8bf6-2633afb258f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:46.850545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ee925309-93ea-4254-8bf6-2633afb258f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:46.851466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:46.852035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:46.853591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ee925309-93ea-4254-8bf6-2633afb258f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.854036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ee925309-93ea-4254-8bf6-2633afb258f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.854795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ee925309-93ea-4254-8bf6-2633afb258f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.855222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ee925309-93ea-4254-8bf6-2633afb258f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.858370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.858823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.859588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:46.860025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:46.941927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lazy-loading 'services' on Instance uuid ed7c90e0-e87c-42b9-b14d-6c06761c1eef {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:46.995793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ee925309-93ea-4254-8bf6-2633afb258f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:47.000224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a45b800e-f885-4939-bd96-b258962120db) Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Request method failure captured: Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac HTTP/1.1 Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uqn9Yz9PUjkOhuuxPkvhfMWuCSxxDmN1BPG4wjfto6sQ9y2AZCBg7ER4tPzVhwlrYekqps8fJnS9RHksjR7J-HSD7PzMfItfL9jNYZ1t3-5kSaVEz0OmTlh-Jbwk_W9WRm9D6AAL5PRgT_uOHbgHv-OFmazo_pHrcWELooOsfy3qxY Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 1a73bb1237bb4bcfa86aa6dc5bf413c7 Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-TestMinimumBasicScenario-569454584 Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:14:47.002431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1a73bb1237bb4bcfa86aa6dc5bf413c7"}]}] Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-TestMinimumBasicScenario-569454584 Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 1a73bb1237bb4bcfa86aa6dc5bf413c7 Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-TestMinimumBasicScenario-569454584 Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-TestMinimumBasicScenario-569454584-project Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 3f7d1d13bfb843df855bc4d57374a8ab Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-TestMinimumBasicScenario-569454584-project Jul 28 20:14:47.004059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a45b800e-f885-4939-bd96-b258962120db) Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'server_id': 'ed7c90e0-e87c-42b9-b14d-6c06761c1eef', 'id': 'cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac'} Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:47.006159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a45b800e-f885-4939-bd96-b258962120db) Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:47.008582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a45b800e-f885-4939-bd96-b258962120db) Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.011505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a45b800e-f885-4939-bd96-b258962120db) Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.013976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a45b800e-f885-4939-bd96-b258962120db) Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a45b800e-f885-4939-bd96-b258962120db) Jul 28 20:14:47.017211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.021919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a45b800e-f885-4939-bd96-b258962120db) {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:47.022034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ee925309-93ea-4254-8bf6-2633afb258f1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1561 microversion: 2.1 time: 0.167329 Jul 28 20:14:47.022146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-473b65a4-cca7-4040-944d-968187d79896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac" status: 400 len: 269 microversion: 2.1 time: 0.163205 Jul 28 20:14:47.022249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 744/1327] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:46 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:47.022346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 584/1328] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:14:46 2022] DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef/os-volume_attachments/cbf3e8df-46ee-4cf3-9b33-70d39ccf21ac => generated 269 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:47.022444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:47.022444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:47.022640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:47.022640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:47.022824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.022824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.023009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.023009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.023307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.023307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.023575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.023575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.112822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lazy-loading 'services' on Instance uuid 768bb30f-60d9-4ad9-af77-64aadcfe531a {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:47.155265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'services' on Instance uuid 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:14:47.230463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-218752be-5e03-4d5d-8e13-d1c15dc13d32) Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Request method failure captured: Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c HTTP/1.1 Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4ur1zSHv01gg34TFkXuzNCv29zYUg46FPaXMA213_kls4uoFuV6FjYZ-w_RhmNOzbvZeiIoZpkG6_oVHrrctlCk1RLae13dKWMn0LqYdUwKkCqMtuH8JRTsd0V86XgCK-HTKodwItK7fVDMXhylAGaIHS88Rh7N1fuz2Wey9wz76HZU Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:14:47.232678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/cc82c1496470409ca70c8cc12023a91e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_cc82c1496470409ca70c8cc12023a91e"}]}] Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: cc82c1496470409ca70c8cc12023a91e Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1367459192 Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 316033501d684cc680770c4ccda85d40 Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-VolumesSnapshotTestJSON-1367459192-project Jul 28 20:14:47.234031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-218752be-5e03-4d5d-8e13-d1c15dc13d32) Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'server_id': '768bb30f-60d9-4ad9-af77-64aadcfe531a', 'id': '73be0a6e-c54a-4300-afc6-99e7e3423a2c'} Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:47.234864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-218752be-5e03-4d5d-8e13-d1c15dc13d32) Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:47.235914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-218752be-5e03-4d5d-8e13-d1c15dc13d32) Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.237051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-218752be-5e03-4d5d-8e13-d1c15dc13d32) Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.238129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-218752be-5e03-4d5d-8e13-d1c15dc13d32) Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-218752be-5e03-4d5d-8e13-d1c15dc13d32) Jul 28 20:14:47.240978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.242349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-218752be-5e03-4d5d-8e13-d1c15dc13d32) {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:47.242349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-11202b31-b89a-4a5d-b5be-8cb17323c213 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c" status: 400 len: 269 microversion: 2.1 time: 0.228282 Jul 28 20:14:47.242349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 585/1329] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:14:47 2022] DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a/os-volume_attachments/73be0a6e-c54a-4300-afc6-99e7e3423a2c => generated 269 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:47.242349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:47.242727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:47.247901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.248351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.249154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.249590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.263876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] HTTP exception thrown: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.266015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-294376cc-1b7f-4525-bd3c-28d60d13594e) Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Request method failure captured: Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 HTTP/1.1 Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4upjl8cyhU1Y-w0-xb4Q0VeT6_hQY1Tv0LbmZX-xo3Dkz5AfzsYkSINiJAmdRwJGkFLNDTbXBxqHZbHCk9D2iaP0GLbmd9kw4moiYSBLcfjh22aCpFNERVOvLSrUi_nx2W0Y0UmNcKbFaCPafVRcE7IjtIBs8VezAHDf7jHyDrP2OYk Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:14:47.266274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70cb4fda232e46b6842f8aa7840e48a7"}]}] Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 4e0e1988c7f44d5198811aca33e1345e Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.267901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': '4889e06d-18cf-4e5e-9f68-8c168109c1d3'} Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:47.268725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.269919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.271148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Returning 404 to user: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:47.271148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3c8ff3e9-1451-46e5-82a5-969f203a3190 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 404 len: 111 microversion: 2.20 time: 0.032160 Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 HTTP/1.1 Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:14:47.271309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:14:47.272698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-294376cc-1b7f-4525-bd3c-28d60d13594e) Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'server_id': '0038fe10-b9ea-4fe0-a220-9c2ab37f67ed', 'id': 'ead09975-af7f-40eb-ae0c-70936b340da0'} Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:47.273311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-294376cc-1b7f-4525-bd3c-28d60d13594e) Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in _detach_volume Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:14:47.274298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-294376cc-1b7f-4525-bd3c-28d60d13594e) Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.275924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5153, in detach_volume Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5133, in _detach_volume Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-294376cc-1b7f-4525-bd3c-28d60d13594e) Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.277783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-294376cc-1b7f-4525-bd3c-28d60d13594e) Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-294376cc-1b7f-4525-bd3c-28d60d13594e) Jul 28 20:14:47.279702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.282081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 586/1330] 10.222.0.67 () {60 vars in 1280 bytes} [Thu Jul 28 20:14:47 2022] DELETE /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:47.282482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-294376cc-1b7f-4525-bd3c-28d60d13594e) {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:47.282482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c8028b39-2adf-4d4e-b320-89af4d8fec4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0" status: 400 len: 269 microversion: 2.1 time: 0.264741 Jul 28 20:14:47.282482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 745/1331] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:14:47 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments/ead09975-af7f-40eb-ae0c-70936b340da0 => generated 269 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:14:47.282898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-de70ffff-2aeb-44bc-9591-f57896df3c06 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:47.283032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:47.283170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-de70ffff-2aeb-44bc-9591-f57896df3c06 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:47.283314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] [instance: 4889e06d-18cf-4e5e-9f68-8c168109c1d3] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:47.283458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de70ffff-2aeb-44bc-9591-f57896df3c06 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.283601 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de70ffff-2aeb-44bc-9591-f57896df3c06 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.285460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de70ffff-2aeb-44bc-9591-f57896df3c06 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.285460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de70ffff-2aeb-44bc-9591-f57896df3c06 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.288271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.288831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.289600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.290040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.305409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] HTTP exception thrown: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Request method failure captured: Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 HTTP/1.1 Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4upjl8cyhU1Y-w0-xb4Q0VeT6_hQY1Tv0LbmZX-xo3Dkz5AfzsYkSINiJAmdRwJGkFLNDTbXBxqHZbHCk9D2iaP0GLbmd9kw4moiYSBLcfjh22aCpFNERVOvLSrUi_nx2W0Y0UmNcKbFaCPafVRcE7IjtIBs8VezAHDf7jHyDrP2OYk Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:14:47.306957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/70cb4fda232e46b6842f8aa7840e48a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_70cb4fda232e46b6842f8aa7840e48a7"}]}] Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 70cb4fda232e46b6842f8aa7840e48a7 Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-82724451 Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 4e0e1988c7f44d5198811aca33e1345e Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeShelveTestJSON-82724451-project Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.308732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '4889e06d-18cf-4e5e-9f68-8c168109c1d3'} Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:14:47.309642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. Jul 28 20:14:47.311043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:14:47.312317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] Returning 404 to user: Instance 4889e06d-18cf-4e5e-9f68-8c168109c1d3 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:14:47.312317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ee9e9a89-7d80-4694-9a00-209c36b84162 tempest-AttachVolumeShelveTestJSON-82724451 tempest-AttachVolumeShelveTestJSON-82724451-project] 10.222.0.67 "GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3" status: 404 len: 111 microversion: 2.20 time: 0.036139 Jul 28 20:14:47.314679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 746/1332] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jul 28 20:14:47 2022] GET /compute/v2.1/servers/4889e06d-18cf-4e5e-9f68-8c168109c1d3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 20:14:47.319203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-083e15e0-aefe-4952-9b8b-cc030fcec312 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:47.323595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-083e15e0-aefe-4952-9b8b-cc030fcec312 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:47.329729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-083e15e0-aefe-4952-9b8b-cc030fcec312 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.330173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-083e15e0-aefe-4952-9b8b-cc030fcec312 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.330942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-083e15e0-aefe-4952-9b8b-cc030fcec312 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:47.331375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-083e15e0-aefe-4952-9b8b-cc030fcec312 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:47.363479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-083e15e0-aefe-4952-9b8b-cc030fcec312 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048745 Jul 28 20:14:47.364100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 747/1333] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:47.437582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-de70ffff-2aeb-44bc-9591-f57896df3c06 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:47.445248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-de70ffff-2aeb-44bc-9591-f57896df3c06 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1561 microversion: 2.1 time: 0.175624 Jul 28 20:14:47.445828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 587/1334] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:48.376621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-379e4833-c898-42f2-afa7-4e5ee39d5884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:48.378777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-379e4833-c898-42f2-afa7-4e5ee39d5884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:48.386518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-379e4833-c898-42f2-afa7-4e5ee39d5884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:48.387208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-379e4833-c898-42f2-afa7-4e5ee39d5884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:48.387976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-379e4833-c898-42f2-afa7-4e5ee39d5884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:48.388417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-379e4833-c898-42f2-afa7-4e5ee39d5884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:48.419578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-379e4833-c898-42f2-afa7-4e5ee39d5884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046788 Jul 28 20:14:48.420326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 748/1335] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:49.266246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fcf27bda-229d-42c5-9e45-e746de9ce52c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:49.266246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fcf27bda-229d-42c5-9e45-e746de9ce52c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:49.287545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fcf27bda-229d-42c5-9e45-e746de9ce52c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:49.288482 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fcf27bda-229d-42c5-9e45-e746de9ce52c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:49.289577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fcf27bda-229d-42c5-9e45-e746de9ce52c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:49.291517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fcf27bda-229d-42c5-9e45-e746de9ce52c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:49.323196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fcf27bda-229d-42c5-9e45-e746de9ce52c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:14:49.388470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-ca7746ab-c9bb-47c3-a3c5-359ab367531a req-8d139ae0-13ae-43c1-809e-f622c35f9ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86779ed-0aff-43b5-a713-44e5384deb0d", "tag": "0ef4ac93-7c07-48a3-8303-7e752c056864"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:14:49.400930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-ca7746ab-c9bb-47c3-a3c5-359ab367531a req-8d139ae0-13ae-43c1-809e-f622c35f9ce8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:49.401767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-ca7746ab-c9bb-47c3-a3c5-359ab367531a req-8d139ae0-13ae-43c1-809e-f622c35f9ce8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:49.421634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fcf27bda-229d-42c5-9e45-e746de9ce52c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "DELETE /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 204 len: 0 microversion: 2.1 time: 0.161045 Jul 28 20:14:49.423154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 588/1336] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:14:49 2022] DELETE /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:14:49.443200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c9566a8e-3de6-4cd7-bd2e-e43c0c8cafa5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:49.443200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c9566a8e-3de6-4cd7-bd2e-e43c0c8cafa5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:49.444995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-ca7746ab-c9bb-47c3-a3c5-359ab367531a req-8d139ae0-13ae-43c1-809e-f622c35f9ce8 service nova] Creating event network-changed:0ef4ac93-7c07-48a3-8303-7e752c056864 for instance f86779ed-0aff-43b5-a713-44e5384deb0d on hv-cinder-85144 Jul 28 20:14:49.456565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-ca7746ab-c9bb-47c3-a3c5-359ab367531a req-8d139ae0-13ae-43c1-809e-f622c35f9ce8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173348 Jul 28 20:14:49.466470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9566a8e-3de6-4cd7-bd2e-e43c0c8cafa5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:49.467418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 749/1337] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:14:49.472742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9566a8e-3de6-4cd7-bd2e-e43c0c8cafa5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:49.474368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9566a8e-3de6-4cd7-bd2e-e43c0c8cafa5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:49.474807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9566a8e-3de6-4cd7-bd2e-e43c0c8cafa5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:49.475591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c6eea715-1052-4ac9-95f7-667e17d51a5c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:49.479860 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c6eea715-1052-4ac9-95f7-667e17d51a5c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:49.493679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6eea715-1052-4ac9-95f7-667e17d51a5c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:49.495895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6eea715-1052-4ac9-95f7-667e17d51a5c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:49.496899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6eea715-1052-4ac9-95f7-667e17d51a5c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:49.498766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6eea715-1052-4ac9-95f7-667e17d51a5c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:49.540483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c6eea715-1052-4ac9-95f7-667e17d51a5c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071082 Jul 28 20:14:49.541687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 750/1338] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:49.651886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c9566a8e-3de6-4cd7-bd2e-e43c0c8cafa5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:49.661559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c9566a8e-3de6-4cd7-bd2e-e43c0c8cafa5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.226490 Jul 28 20:14:49.662804 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 589/1339] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:49 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:50.553316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c069301-9a6b-46c8-baef-5db92ef4c170 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:50.555703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3c069301-9a6b-46c8-baef-5db92ef4c170 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:50.562326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c069301-9a6b-46c8-baef-5db92ef4c170 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:50.563115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c069301-9a6b-46c8-baef-5db92ef4c170 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:50.564712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c069301-9a6b-46c8-baef-5db92ef4c170 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:50.565395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c069301-9a6b-46c8-baef-5db92ef4c170 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:50.598367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3c069301-9a6b-46c8-baef-5db92ef4c170 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049430 Jul 28 20:14:50.599797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 751/1340] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:50.683757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-00ec799c-37c5-4947-a3bd-b31a958db8cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:50.684481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-00ec799c-37c5-4947-a3bd-b31a958db8cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:50.694179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00ec799c-37c5-4947-a3bd-b31a958db8cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:50.696483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00ec799c-37c5-4947-a3bd-b31a958db8cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:50.698487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00ec799c-37c5-4947-a3bd-b31a958db8cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:50.699102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00ec799c-37c5-4947-a3bd-b31a958db8cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:50.972381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-00ec799c-37c5-4947-a3bd-b31a958db8cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:50.992182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-00ec799c-37c5-4947-a3bd-b31a958db8cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1567 microversion: 2.1 time: 0.308276 Jul 28 20:14:51.005855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 590/1341] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1567 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:14:51.515824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-5f235786-28ab-4e69-881c-f1457526d5ac req-fbe24479-d5f3-4bc2-9d76-6a86177bb2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86779ed-0aff-43b5-a713-44e5384deb0d", "name": "network-vif-deleted", "tag": "0ef4ac93-7c07-48a3-8303-7e752c056864"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:14:51.537584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-5f235786-28ab-4e69-881c-f1457526d5ac req-fbe24479-d5f3-4bc2-9d76-6a86177bb2b4 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:51.538032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-5f235786-28ab-4e69-881c-f1457526d5ac req-fbe24479-d5f3-4bc2-9d76-6a86177bb2b4 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:51.550116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-5f235786-28ab-4e69-881c-f1457526d5ac req-fbe24479-d5f3-4bc2-9d76-6a86177bb2b4 service nova] Creating event network-vif-deleted:0ef4ac93-7c07-48a3-8303-7e752c056864 for instance f86779ed-0aff-43b5-a713-44e5384deb0d on hv-cinder-85144 Jul 28 20:14:51.556093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-5f235786-28ab-4e69-881c-f1457526d5ac req-fbe24479-d5f3-4bc2-9d76-6a86177bb2b4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043864 Jul 28 20:14:51.557655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 752/1342] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:51.611015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-47344e73-cc13-49f8-a16c-b7a58723ddac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:51.613409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-47344e73-cc13-49f8-a16c-b7a58723ddac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:51.620334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47344e73-cc13-49f8-a16c-b7a58723ddac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:51.620817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47344e73-cc13-49f8-a16c-b7a58723ddac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:51.621605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47344e73-cc13-49f8-a16c-b7a58723ddac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:51.622043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47344e73-cc13-49f8-a16c-b7a58723ddac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:51.657078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-47344e73-cc13-49f8-a16c-b7a58723ddac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049933 Jul 28 20:14:51.657896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 591/1343] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:52.017451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-51e5fd9c-44a1-41ce-aee4-2accb4757f2a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:52.018397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-51e5fd9c-44a1-41ce-aee4-2accb4757f2a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:52.026094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51e5fd9c-44a1-41ce-aee4-2accb4757f2a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:52.026778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51e5fd9c-44a1-41ce-aee4-2accb4757f2a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:52.027555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51e5fd9c-44a1-41ce-aee4-2accb4757f2a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:52.028145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51e5fd9c-44a1-41ce-aee4-2accb4757f2a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:52.115321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-51e5fd9c-44a1-41ce-aee4-2accb4757f2a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:52.124055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-51e5fd9c-44a1-41ce-aee4-2accb4757f2a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.112090 Jul 28 20:14:52.126299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 753/1344] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:52 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:52.671321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-401680b7-f763-49af-a7c9-eaac9dc365e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:52.673685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-401680b7-f763-49af-a7c9-eaac9dc365e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:52.681686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-401680b7-f763-49af-a7c9-eaac9dc365e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:52.682133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-401680b7-f763-49af-a7c9-eaac9dc365e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:52.682914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-401680b7-f763-49af-a7c9-eaac9dc365e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:52.683346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-401680b7-f763-49af-a7c9-eaac9dc365e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:52.718348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-401680b7-f763-49af-a7c9-eaac9dc365e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051968 Jul 28 20:14:52.718929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 592/1345] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:14:53.151791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c039d0d5-a7cc-47d6-a101-9a61ac9c310c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:53.152617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c039d0d5-a7cc-47d6-a101-9a61ac9c310c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:53.159547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c039d0d5-a7cc-47d6-a101-9a61ac9c310c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:53.160494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c039d0d5-a7cc-47d6-a101-9a61ac9c310c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:53.162032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c039d0d5-a7cc-47d6-a101-9a61ac9c310c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:53.162568 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c039d0d5-a7cc-47d6-a101-9a61ac9c310c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:53.225667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c039d0d5-a7cc-47d6-a101-9a61ac9c310c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:53.233724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c039d0d5-a7cc-47d6-a101-9a61ac9c310c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086427 Jul 28 20:14:53.234286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 754/1346] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:53 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:53.730836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c1758e3b-429a-48b3-b04c-e36e8e186a35 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:53.733151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c1758e3b-429a-48b3-b04c-e36e8e186a35 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:53.739894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1758e3b-429a-48b3-b04c-e36e8e186a35 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:53.740413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1758e3b-429a-48b3-b04c-e36e8e186a35 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:53.741332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1758e3b-429a-48b3-b04c-e36e8e186a35 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:53.741835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1758e3b-429a-48b3-b04c-e36e8e186a35 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:53.771949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c1758e3b-429a-48b3-b04c-e36e8e186a35 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Jul 28 20:14:53.772496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 593/1347] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:54.256178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1d80171d-833a-49d6-9804-eafc752cda1e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:54.256944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1d80171d-833a-49d6-9804-eafc752cda1e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:54.263567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d80171d-833a-49d6-9804-eafc752cda1e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:54.264018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d80171d-833a-49d6-9804-eafc752cda1e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:54.264813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d80171d-833a-49d6-9804-eafc752cda1e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:54.265247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d80171d-833a-49d6-9804-eafc752cda1e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:54.325864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1d80171d-833a-49d6-9804-eafc752cda1e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:54.334229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1d80171d-833a-49d6-9804-eafc752cda1e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082877 Jul 28 20:14:54.334796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 755/1348] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:54.784529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5360cf54-5bd3-4946-a130-7323f904f7f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:54.787488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5360cf54-5bd3-4946-a130-7323f904f7f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:54.793973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5360cf54-5bd3-4946-a130-7323f904f7f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:54.794425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5360cf54-5bd3-4946-a130-7323f904f7f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:54.795188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5360cf54-5bd3-4946-a130-7323f904f7f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:54.795628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5360cf54-5bd3-4946-a130-7323f904f7f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:54.824720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5360cf54-5bd3-4946-a130-7323f904f7f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044355 Jul 28 20:14:54.825273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 594/1349] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:55.355797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0341103c-69ec-42ba-9734-d8037b39e211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:55.356410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0341103c-69ec-42ba-9734-d8037b39e211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:55.363190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0341103c-69ec-42ba-9734-d8037b39e211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:55.363633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0341103c-69ec-42ba-9734-d8037b39e211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:55.364757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0341103c-69ec-42ba-9734-d8037b39e211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:55.364865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0341103c-69ec-42ba-9734-d8037b39e211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:55.437788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0341103c-69ec-42ba-9734-d8037b39e211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:55.446503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0341103c-69ec-42ba-9734-d8037b39e211 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.094503 Jul 28 20:14:55.448564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 756/1350] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:55.837401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-280c81a5-8442-4fed-bc42-ed608fcfc644 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:55.839708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-280c81a5-8442-4fed-bc42-ed608fcfc644 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:55.846175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-280c81a5-8442-4fed-bc42-ed608fcfc644 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:55.846627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-280c81a5-8442-4fed-bc42-ed608fcfc644 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:55.847381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-280c81a5-8442-4fed-bc42-ed608fcfc644 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:55.847813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-280c81a5-8442-4fed-bc42-ed608fcfc644 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:55.879144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-280c81a5-8442-4fed-bc42-ed608fcfc644 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045957 Jul 28 20:14:55.879727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 595/1351] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:55 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:56.468588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4de9dd4e-136e-4724-ad08-ee2fb6afdd47 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:56.469243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4de9dd4e-136e-4724-ad08-ee2fb6afdd47 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:56.475716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4de9dd4e-136e-4724-ad08-ee2fb6afdd47 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:56.476161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4de9dd4e-136e-4724-ad08-ee2fb6afdd47 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:56.476940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4de9dd4e-136e-4724-ad08-ee2fb6afdd47 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:56.477370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4de9dd4e-136e-4724-ad08-ee2fb6afdd47 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:56.537713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4de9dd4e-136e-4724-ad08-ee2fb6afdd47 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:56.545275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4de9dd4e-136e-4724-ad08-ee2fb6afdd47 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080666 Jul 28 20:14:56.545825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 757/1352] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:56 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:56.891386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-64c0222f-a187-47d0-9e79-92ae99ae9e8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:56.893613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-64c0222f-a187-47d0-9e79-92ae99ae9e8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:56.900098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64c0222f-a187-47d0-9e79-92ae99ae9e8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:56.900560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64c0222f-a187-47d0-9e79-92ae99ae9e8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:56.901331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64c0222f-a187-47d0-9e79-92ae99ae9e8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:56.901766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64c0222f-a187-47d0-9e79-92ae99ae9e8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:56.927548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:56.932844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-64c0222f-a187-47d0-9e79-92ae99ae9e8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Jul 28 20:14:56.933421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 596/1353] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:57.566057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8ef0b97c-c173-4f2c-8c07-9a3a18963fc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:57.566630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8ef0b97c-c173-4f2c-8c07-9a3a18963fc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:57.573238 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ef0b97c-c173-4f2c-8c07-9a3a18963fc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:57.573685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ef0b97c-c173-4f2c-8c07-9a3a18963fc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:57.574439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ef0b97c-c173-4f2c-8c07-9a3a18963fc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:57.574870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ef0b97c-c173-4f2c-8c07-9a3a18963fc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:57.634704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8ef0b97c-c173-4f2c-8c07-9a3a18963fc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:57.642110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8ef0b97c-c173-4f2c-8c07-9a3a18963fc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.079974 Jul 28 20:14:57.642684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 758/1354] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:57.945699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e3a43cd6-0eca-4029-b3cc-ba7d21ae14e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:57.947953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e3a43cd6-0eca-4029-b3cc-ba7d21ae14e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:57.956513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3a43cd6-0eca-4029-b3cc-ba7d21ae14e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:57.957020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3a43cd6-0eca-4029-b3cc-ba7d21ae14e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:57.958530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3a43cd6-0eca-4029-b3cc-ba7d21ae14e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:57.958957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3a43cd6-0eca-4029-b3cc-ba7d21ae14e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:57.987746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e3a43cd6-0eca-4029-b3cc-ba7d21ae14e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046637 Jul 28 20:14:57.988291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 597/1355] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:58.664087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9ba6f154-8703-4770-9a9d-41ded026eb5d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:58.664715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9ba6f154-8703-4770-9a9d-41ded026eb5d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:58.671139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ba6f154-8703-4770-9a9d-41ded026eb5d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:58.671575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ba6f154-8703-4770-9a9d-41ded026eb5d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:58.672409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ba6f154-8703-4770-9a9d-41ded026eb5d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:58.672873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ba6f154-8703-4770-9a9d-41ded026eb5d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:58.732643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9ba6f154-8703-4770-9a9d-41ded026eb5d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:58.736169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:14:58.741922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9ba6f154-8703-4770-9a9d-41ded026eb5d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082201 Jul 28 20:14:58.742478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 759/1356] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:58 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:14:58.999615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ac5b228-4e1e-486b-99c9-725f1bb7029a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:59.001739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0ac5b228-4e1e-486b-99c9-725f1bb7029a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:59.008770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ac5b228-4e1e-486b-99c9-725f1bb7029a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:59.009217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ac5b228-4e1e-486b-99c9-725f1bb7029a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:59.009973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ac5b228-4e1e-486b-99c9-725f1bb7029a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:59.010409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ac5b228-4e1e-486b-99c9-725f1bb7029a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:59.040384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0ac5b228-4e1e-486b-99c9-725f1bb7029a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044903 Jul 28 20:14:59.041010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 598/1357] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:14:58 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:14:59.763314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-718b9fb8-d57d-44c3-9fcc-8c3678bb20a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:14:59.763953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-718b9fb8-d57d-44c3-9fcc-8c3678bb20a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:14:59.770858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-718b9fb8-d57d-44c3-9fcc-8c3678bb20a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:59.771300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-718b9fb8-d57d-44c3-9fcc-8c3678bb20a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:59.772053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-718b9fb8-d57d-44c3-9fcc-8c3678bb20a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:14:59.772480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-718b9fb8-d57d-44c3-9fcc-8c3678bb20a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:14:59.836208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-718b9fb8-d57d-44c3-9fcc-8c3678bb20a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:14:59.843776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-718b9fb8-d57d-44c3-9fcc-8c3678bb20a9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084649 Jul 28 20:14:59.844354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 760/1358] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:14:59 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:00.053762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-80fe8d57-e168-49e6-a17a-22e4ea0dde76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:00.055821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-80fe8d57-e168-49e6-a17a-22e4ea0dde76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:00.062354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80fe8d57-e168-49e6-a17a-22e4ea0dde76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:00.062805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80fe8d57-e168-49e6-a17a-22e4ea0dde76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:00.063572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80fe8d57-e168-49e6-a17a-22e4ea0dde76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:00.064011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80fe8d57-e168-49e6-a17a-22e4ea0dde76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:00.092456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-80fe8d57-e168-49e6-a17a-22e4ea0dde76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Jul 28 20:15:00.093046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 599/1359] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:00.865073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3f314ea0-e58e-489f-bd2a-5e031c404233 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:00.865687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3f314ea0-e58e-489f-bd2a-5e031c404233 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:00.873254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f314ea0-e58e-489f-bd2a-5e031c404233 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:00.874103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f314ea0-e58e-489f-bd2a-5e031c404233 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:00.874802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f314ea0-e58e-489f-bd2a-5e031c404233 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:00.875238 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f314ea0-e58e-489f-bd2a-5e031c404233 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:01.105655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cc33f9c9-3ae8-4e23-b02a-edec5dcafb7a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:01.107799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cc33f9c9-3ae8-4e23-b02a-edec5dcafb7a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:01.114690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc33f9c9-3ae8-4e23-b02a-edec5dcafb7a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:01.115189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc33f9c9-3ae8-4e23-b02a-edec5dcafb7a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:01.115896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc33f9c9-3ae8-4e23-b02a-edec5dcafb7a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:01.116323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc33f9c9-3ae8-4e23-b02a-edec5dcafb7a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:01.155707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f314ea0-e58e-489f-bd2a-5e031c404233 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:01.155961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cc33f9c9-3ae8-4e23-b02a-edec5dcafb7a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049615 Jul 28 20:15:01.155961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 600/1360] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:15:01.165165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3f314ea0-e58e-489f-bd2a-5e031c404233 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.304519 Jul 28 20:15:01.165742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 761/1361] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:00 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:02.163743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0fcbd098-ea9f-493f-a832-731bb423656c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:02.166241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0fcbd098-ea9f-493f-a832-731bb423656c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:02.172758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0fcbd098-ea9f-493f-a832-731bb423656c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:02.173199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0fcbd098-ea9f-493f-a832-731bb423656c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:02.173951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0fcbd098-ea9f-493f-a832-731bb423656c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:02.174407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0fcbd098-ea9f-493f-a832-731bb423656c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:02.199050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3d25472d-76d6-4768-8cfa-0eddab644fde tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:02.199688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3d25472d-76d6-4768-8cfa-0eddab644fde tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:02.204514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0fcbd098-ea9f-493f-a832-731bb423656c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Jul 28 20:15:02.205147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 601/1362] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:02 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:02.206448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d25472d-76d6-4768-8cfa-0eddab644fde tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:02.206968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d25472d-76d6-4768-8cfa-0eddab644fde tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:02.208419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d25472d-76d6-4768-8cfa-0eddab644fde tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:02.208948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d25472d-76d6-4768-8cfa-0eddab644fde tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:02.270303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3d25472d-76d6-4768-8cfa-0eddab644fde tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:02.277817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3d25472d-76d6-4768-8cfa-0eddab644fde tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082487 Jul 28 20:15:02.278369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 762/1363] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:15:03.216625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-baa8fb60-6c1b-43c0-b365-4f76027e3041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:03.218810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-baa8fb60-6c1b-43c0-b365-4f76027e3041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:03.226313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-baa8fb60-6c1b-43c0-b365-4f76027e3041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:03.226755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-baa8fb60-6c1b-43c0-b365-4f76027e3041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:03.227522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-baa8fb60-6c1b-43c0-b365-4f76027e3041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:03.227956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-baa8fb60-6c1b-43c0-b365-4f76027e3041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:03.257753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-baa8fb60-6c1b-43c0-b365-4f76027e3041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045191 Jul 28 20:15:03.258302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 602/1364] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:15:03.299302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-322dca7f-6a76-4107-9020-a2433005ca90 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:03.299920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-322dca7f-6a76-4107-9020-a2433005ca90 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:03.306049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-322dca7f-6a76-4107-9020-a2433005ca90 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:03.306488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-322dca7f-6a76-4107-9020-a2433005ca90 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:03.307237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-322dca7f-6a76-4107-9020-a2433005ca90 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:03.307667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-322dca7f-6a76-4107-9020-a2433005ca90 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:03.369824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-322dca7f-6a76-4107-9020-a2433005ca90 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:03.377136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-322dca7f-6a76-4107-9020-a2433005ca90 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081890 Jul 28 20:15:03.377688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 763/1365] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:03 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:04.270616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-46cf9e1e-b07e-48e1-a32c-298194aec360 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:04.272730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-46cf9e1e-b07e-48e1-a32c-298194aec360 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:04.279571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46cf9e1e-b07e-48e1-a32c-298194aec360 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:04.280020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46cf9e1e-b07e-48e1-a32c-298194aec360 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:04.280822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46cf9e1e-b07e-48e1-a32c-298194aec360 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:04.281257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46cf9e1e-b07e-48e1-a32c-298194aec360 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:04.310164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-46cf9e1e-b07e-48e1-a32c-298194aec360 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044145 Jul 28 20:15:04.310701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 603/1366] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:04.398603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b5910597-c7e4-4512-acd2-79eaeea12b0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:04.399214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b5910597-c7e4-4512-acd2-79eaeea12b0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:04.405730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5910597-c7e4-4512-acd2-79eaeea12b0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:04.406174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5910597-c7e4-4512-acd2-79eaeea12b0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:04.406938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5910597-c7e4-4512-acd2-79eaeea12b0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:04.407625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5910597-c7e4-4512-acd2-79eaeea12b0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:04.467579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b5910597-c7e4-4512-acd2-79eaeea12b0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:04.475892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b5910597-c7e4-4512-acd2-79eaeea12b0b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081656 Jul 28 20:15:04.476450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 764/1367] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:04 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:05.323105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0b64d705-c4f5-4b34-a94d-6ef2ea079839 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:05.325288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0b64d705-c4f5-4b34-a94d-6ef2ea079839 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:05.332080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b64d705-c4f5-4b34-a94d-6ef2ea079839 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:05.333305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b64d705-c4f5-4b34-a94d-6ef2ea079839 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:05.334059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b64d705-c4f5-4b34-a94d-6ef2ea079839 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:05.334484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b64d705-c4f5-4b34-a94d-6ef2ea079839 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:05.362521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0b64d705-c4f5-4b34-a94d-6ef2ea079839 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Jul 28 20:15:05.363304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 604/1368] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:05.496421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a2cb4b5a-68f7-4d15-bea4-4df88210e7b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:05.497077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a2cb4b5a-68f7-4d15-bea4-4df88210e7b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:05.503575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2cb4b5a-68f7-4d15-bea4-4df88210e7b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:05.504014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2cb4b5a-68f7-4d15-bea4-4df88210e7b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:05.505433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2cb4b5a-68f7-4d15-bea4-4df88210e7b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:05.505724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2cb4b5a-68f7-4d15-bea4-4df88210e7b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:05.569553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a2cb4b5a-68f7-4d15-bea4-4df88210e7b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:05.577083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a2cb4b5a-68f7-4d15-bea4-4df88210e7b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084452 Jul 28 20:15:05.577568 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 765/1369] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:05 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:06.375078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c1b6a9c4-c7d6-4e93-a4be-95675ff11288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:06.377225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c1b6a9c4-c7d6-4e93-a4be-95675ff11288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:06.384126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1b6a9c4-c7d6-4e93-a4be-95675ff11288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:06.384590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1b6a9c4-c7d6-4e93-a4be-95675ff11288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:06.385340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1b6a9c4-c7d6-4e93-a4be-95675ff11288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:06.385801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1b6a9c4-c7d6-4e93-a4be-95675ff11288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:06.415253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c1b6a9c4-c7d6-4e93-a4be-95675ff11288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 Jul 28 20:15:06.415791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 605/1370] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:06.598336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1a443b9e-cb91-4ac5-bfac-9f413d5bbc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:06.598972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1a443b9e-cb91-4ac5-bfac-9f413d5bbc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:06.605545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a443b9e-cb91-4ac5-bfac-9f413d5bbc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:06.606001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a443b9e-cb91-4ac5-bfac-9f413d5bbc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:06.606760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a443b9e-cb91-4ac5-bfac-9f413d5bbc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:06.607196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a443b9e-cb91-4ac5-bfac-9f413d5bbc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:06.668387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1a443b9e-cb91-4ac5-bfac-9f413d5bbc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:06.675975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1a443b9e-cb91-4ac5-bfac-9f413d5bbc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081632 Jul 28 20:15:06.677157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 766/1371] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:06 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:07.427440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cfb745d7-97f9-4d0b-84dd-6e4e50924df9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:07.429641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cfb745d7-97f9-4d0b-84dd-6e4e50924df9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:07.435985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfb745d7-97f9-4d0b-84dd-6e4e50924df9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:07.436427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfb745d7-97f9-4d0b-84dd-6e4e50924df9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:07.437355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfb745d7-97f9-4d0b-84dd-6e4e50924df9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:07.437786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfb745d7-97f9-4d0b-84dd-6e4e50924df9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:07.466381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cfb745d7-97f9-4d0b-84dd-6e4e50924df9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042877 Jul 28 20:15:07.466922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 606/1372] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:07.698048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a6f03e4b-9250-43c0-ba08-513675810c27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:07.698578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a6f03e4b-9250-43c0-ba08-513675810c27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:07.705096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6f03e4b-9250-43c0-ba08-513675810c27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:07.705539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6f03e4b-9250-43c0-ba08-513675810c27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:07.706295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6f03e4b-9250-43c0-ba08-513675810c27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:07.706727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6f03e4b-9250-43c0-ba08-513675810c27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:07.767818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a6f03e4b-9250-43c0-ba08-513675810c27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:07.775805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a6f03e4b-9250-43c0-ba08-513675810c27 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081751 Jul 28 20:15:07.776366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 767/1373] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:07 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:15:08.294979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:15:08.295186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:15:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:15:08.479202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6736eab3-64e5-41a2-9c20-a8b013714333 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:08.481291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6736eab3-64e5-41a2-9c20-a8b013714333 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:08.487615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6736eab3-64e5-41a2-9c20-a8b013714333 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:08.488054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6736eab3-64e5-41a2-9c20-a8b013714333 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:08.489700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6736eab3-64e5-41a2-9c20-a8b013714333 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:08.490132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6736eab3-64e5-41a2-9c20-a8b013714333 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:08.518809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6736eab3-64e5-41a2-9c20-a8b013714333 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043658 Jul 28 20:15:08.519349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 607/1374] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:08.796787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3afc7b6d-6b14-47fb-b3ee-69c8d4af2b75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:08.797318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3afc7b6d-6b14-47fb-b3ee-69c8d4af2b75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:08.803985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3afc7b6d-6b14-47fb-b3ee-69c8d4af2b75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:08.804448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3afc7b6d-6b14-47fb-b3ee-69c8d4af2b75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:08.805218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3afc7b6d-6b14-47fb-b3ee-69c8d4af2b75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:08.805668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3afc7b6d-6b14-47fb-b3ee-69c8d4af2b75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:08.865465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3afc7b6d-6b14-47fb-b3ee-69c8d4af2b75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:08.872947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3afc7b6d-6b14-47fb-b3ee-69c8d4af2b75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080072 Jul 28 20:15:08.873496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 768/1375] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:08 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:09.531244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eb6346f1-6faa-4ae1-9e06-1f851cd0b34c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:09.533642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eb6346f1-6faa-4ae1-9e06-1f851cd0b34c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:09.540023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb6346f1-6faa-4ae1-9e06-1f851cd0b34c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:09.540468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb6346f1-6faa-4ae1-9e06-1f851cd0b34c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:09.541244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb6346f1-6faa-4ae1-9e06-1f851cd0b34c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:09.541673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb6346f1-6faa-4ae1-9e06-1f851cd0b34c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:09.570295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eb6346f1-6faa-4ae1-9e06-1f851cd0b34c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043099 Jul 28 20:15:09.570828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 608/1376] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:09 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:09.893603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3d98ab62-7c35-4857-81ea-bbeebc9500af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:09.894181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3d98ab62-7c35-4857-81ea-bbeebc9500af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:09.900819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d98ab62-7c35-4857-81ea-bbeebc9500af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:09.901270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d98ab62-7c35-4857-81ea-bbeebc9500af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:09.902024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d98ab62-7c35-4857-81ea-bbeebc9500af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:09.902456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d98ab62-7c35-4857-81ea-bbeebc9500af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:09.967636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3d98ab62-7c35-4857-81ea-bbeebc9500af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:09.975700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3d98ab62-7c35-4857-81ea-bbeebc9500af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086028 Jul 28 20:15:09.976263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 769/1377] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:09 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:10.583764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-29211946-5f91-419f-98bd-7d6c4c917f32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:10.585983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-29211946-5f91-419f-98bd-7d6c4c917f32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:10.592436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29211946-5f91-419f-98bd-7d6c4c917f32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:10.592912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29211946-5f91-419f-98bd-7d6c4c917f32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:10.593667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29211946-5f91-419f-98bd-7d6c4c917f32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:10.594098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29211946-5f91-419f-98bd-7d6c4c917f32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:10.622565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-29211946-5f91-419f-98bd-7d6c4c917f32 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043757 Jul 28 20:15:10.623103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 609/1378] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:10.995839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2c90441a-c33c-4e89-a7c4-aa85978b6714 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:10.996392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2c90441a-c33c-4e89-a7c4-aa85978b6714 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:11.002808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c90441a-c33c-4e89-a7c4-aa85978b6714 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:11.003257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c90441a-c33c-4e89-a7c4-aa85978b6714 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:11.004010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c90441a-c33c-4e89-a7c4-aa85978b6714 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:11.005135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c90441a-c33c-4e89-a7c4-aa85978b6714 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:11.063959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2c90441a-c33c-4e89-a7c4-aa85978b6714 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:11.072398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2c90441a-c33c-4e89-a7c4-aa85978b6714 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080444 Jul 28 20:15:11.072989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 770/1379] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:10 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:11.634902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-887ebd20-c59f-44d8-afa0-9a044a8332d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:11.637112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-887ebd20-c59f-44d8-afa0-9a044a8332d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:11.643543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-887ebd20-c59f-44d8-afa0-9a044a8332d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:11.643992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-887ebd20-c59f-44d8-afa0-9a044a8332d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:11.644786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-887ebd20-c59f-44d8-afa0-9a044a8332d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:11.645796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-887ebd20-c59f-44d8-afa0-9a044a8332d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:11.675017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-887ebd20-c59f-44d8-afa0-9a044a8332d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Jul 28 20:15:11.675569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 610/1380] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:12.011623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:15:12.011819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:15:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:15:12.093398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-be5eb360-eed8-4505-bf75-09ff94ded691 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:12.094009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-be5eb360-eed8-4505-bf75-09ff94ded691 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:12.101144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be5eb360-eed8-4505-bf75-09ff94ded691 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:12.101582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be5eb360-eed8-4505-bf75-09ff94ded691 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:12.102327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be5eb360-eed8-4505-bf75-09ff94ded691 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:12.102752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be5eb360-eed8-4505-bf75-09ff94ded691 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:12.164055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-be5eb360-eed8-4505-bf75-09ff94ded691 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:12.171747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-be5eb360-eed8-4505-bf75-09ff94ded691 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082197 Jul 28 20:15:12.172306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 771/1381] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:12 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:12.687502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d0380142-1147-4020-892c-9e4d248795d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:12.689846 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d0380142-1147-4020-892c-9e4d248795d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:12.696529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0380142-1147-4020-892c-9e4d248795d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:12.697011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0380142-1147-4020-892c-9e4d248795d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:12.697768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0380142-1147-4020-892c-9e4d248795d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:12.698205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0380142-1147-4020-892c-9e4d248795d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:12.728035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d0380142-1147-4020-892c-9e4d248795d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Jul 28 20:15:12.728602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 611/1382] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:13.193608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-31d467a1-a0c5-4833-8d70-12f17b155e1d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:13.194222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-31d467a1-a0c5-4833-8d70-12f17b155e1d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:13.196690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=61 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:13.202031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31d467a1-a0c5-4833-8d70-12f17b155e1d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:13.202476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31d467a1-a0c5-4833-8d70-12f17b155e1d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:13.203230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31d467a1-a0c5-4833-8d70-12f17b155e1d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:13.203658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31d467a1-a0c5-4833-8d70-12f17b155e1d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:13.265462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-31d467a1-a0c5-4833-8d70-12f17b155e1d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:13.273607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-31d467a1-a0c5-4833-8d70-12f17b155e1d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084558 Jul 28 20:15:13.274173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 772/1383] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:13 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:13.740480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f0e3842b-2aad-4be6-a28c-0e3301036b03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:13.742657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f0e3842b-2aad-4be6-a28c-0e3301036b03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:13.744943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:13.749953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0e3842b-2aad-4be6-a28c-0e3301036b03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:13.750400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0e3842b-2aad-4be6-a28c-0e3301036b03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:13.751158 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0e3842b-2aad-4be6-a28c-0e3301036b03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:13.751596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f0e3842b-2aad-4be6-a28c-0e3301036b03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:13.781406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f0e3842b-2aad-4be6-a28c-0e3301036b03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Jul 28 20:15:13.781952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 612/1384] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:14.294360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-14523a73-84bc-4694-a338-95a0dbb0bcd7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:14.294971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-14523a73-84bc-4694-a338-95a0dbb0bcd7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:14.302059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14523a73-84bc-4694-a338-95a0dbb0bcd7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:14.302498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14523a73-84bc-4694-a338-95a0dbb0bcd7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:14.303241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14523a73-84bc-4694-a338-95a0dbb0bcd7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:14.303669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14523a73-84bc-4694-a338-95a0dbb0bcd7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:14.366486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-14523a73-84bc-4694-a338-95a0dbb0bcd7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:14.373867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-14523a73-84bc-4694-a338-95a0dbb0bcd7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083349 Jul 28 20:15:14.374421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 773/1385] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:14.794099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ac40577b-330f-4fbf-8fab-ae7c3c7350ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:14.796157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ac40577b-330f-4fbf-8fab-ae7c3c7350ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:14.803362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac40577b-330f-4fbf-8fab-ae7c3c7350ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:14.803800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac40577b-330f-4fbf-8fab-ae7c3c7350ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:14.804566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac40577b-330f-4fbf-8fab-ae7c3c7350ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:14.805013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ac40577b-330f-4fbf-8fab-ae7c3c7350ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:14.822163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:14.835762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ac40577b-330f-4fbf-8fab-ae7c3c7350ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045705 Jul 28 20:15:14.836324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 613/1386] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:15.396272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cf7b9644-d657-4510-9264-6db6e21a74e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:15.396928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cf7b9644-d657-4510-9264-6db6e21a74e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:15.403228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf7b9644-d657-4510-9264-6db6e21a74e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:15.403674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf7b9644-d657-4510-9264-6db6e21a74e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:15.404436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf7b9644-d657-4510-9264-6db6e21a74e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:15.404885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf7b9644-d657-4510-9264-6db6e21a74e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:15.466290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cf7b9644-d657-4510-9264-6db6e21a74e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:15.473748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cf7b9644-d657-4510-9264-6db6e21a74e9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082153 Jul 28 20:15:15.474303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 774/1387] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:15 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:15.847733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7ec526db-c3e8-4aa5-9494-8b54d48af13b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:15.850457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7ec526db-c3e8-4aa5-9494-8b54d48af13b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:15.857261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ec526db-c3e8-4aa5-9494-8b54d48af13b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:15.857701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ec526db-c3e8-4aa5-9494-8b54d48af13b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:15.858461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ec526db-c3e8-4aa5-9494-8b54d48af13b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:15.858955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ec526db-c3e8-4aa5-9494-8b54d48af13b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:15.890801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7ec526db-c3e8-4aa5-9494-8b54d48af13b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046946 Jul 28 20:15:15.891361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 614/1388] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:16.495613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c328d4fa-a706-404b-aa03-1828ef3dbd4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:16.496151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c328d4fa-a706-404b-aa03-1828ef3dbd4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:16.502613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c328d4fa-a706-404b-aa03-1828ef3dbd4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:16.503062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c328d4fa-a706-404b-aa03-1828ef3dbd4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:16.503817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c328d4fa-a706-404b-aa03-1828ef3dbd4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:16.505023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c328d4fa-a706-404b-aa03-1828ef3dbd4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:16.566755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c328d4fa-a706-404b-aa03-1828ef3dbd4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:16.574279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c328d4fa-a706-404b-aa03-1828ef3dbd4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082613 Jul 28 20:15:16.574837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 775/1389] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:16 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:16.903206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-265ff214-aa30-4a13-999d-e91b02fed696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:16.905379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-265ff214-aa30-4a13-999d-e91b02fed696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:16.912629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-265ff214-aa30-4a13-999d-e91b02fed696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:16.913103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-265ff214-aa30-4a13-999d-e91b02fed696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:16.913859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-265ff214-aa30-4a13-999d-e91b02fed696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:16.914287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-265ff214-aa30-4a13-999d-e91b02fed696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:16.942949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-265ff214-aa30-4a13-999d-e91b02fed696 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Jul 28 20:15:16.943495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 615/1390] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:17.594288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f297bc9b-4478-49a0-bddf-b9da7bbef039 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:17.594894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f297bc9b-4478-49a0-bddf-b9da7bbef039 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:17.601493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f297bc9b-4478-49a0-bddf-b9da7bbef039 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:17.601935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f297bc9b-4478-49a0-bddf-b9da7bbef039 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:17.602679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f297bc9b-4478-49a0-bddf-b9da7bbef039 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:17.603103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f297bc9b-4478-49a0-bddf-b9da7bbef039 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:17.622660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:17.666645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f297bc9b-4478-49a0-bddf-b9da7bbef039 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:17.674198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f297bc9b-4478-49a0-bddf-b9da7bbef039 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083727 Jul 28 20:15:17.674756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 776/1391] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:17 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:17.955291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-74746e44-78d9-4329-bb4f-347971eeda3b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:17.957389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-74746e44-78d9-4329-bb4f-347971eeda3b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:17.963871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74746e44-78d9-4329-bb4f-347971eeda3b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:17.964321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74746e44-78d9-4329-bb4f-347971eeda3b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:17.965112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74746e44-78d9-4329-bb4f-347971eeda3b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:17.965543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74746e44-78d9-4329-bb4f-347971eeda3b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:17.997326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-74746e44-78d9-4329-bb4f-347971eeda3b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046045 Jul 28 20:15:17.997884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 616/1392] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:18.696038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d9f87edc-4616-4b7b-abe5-39057e858fa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:18.696666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d9f87edc-4616-4b7b-abe5-39057e858fa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:18.703062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9f87edc-4616-4b7b-abe5-39057e858fa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:18.703504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9f87edc-4616-4b7b-abe5-39057e858fa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:18.704246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9f87edc-4616-4b7b-abe5-39057e858fa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:18.704708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9f87edc-4616-4b7b-abe5-39057e858fa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:18.768713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d9f87edc-4616-4b7b-abe5-39057e858fa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:18.776304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d9f87edc-4616-4b7b-abe5-39057e858fa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084809 Jul 28 20:15:18.776891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 777/1393] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:18 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:19.009931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-132a4d62-cc04-415b-b8bd-5bdea033fe25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:19.011985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-132a4d62-cc04-415b-b8bd-5bdea033fe25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:19.018414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-132a4d62-cc04-415b-b8bd-5bdea033fe25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:19.018855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-132a4d62-cc04-415b-b8bd-5bdea033fe25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:19.019696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-132a4d62-cc04-415b-b8bd-5bdea033fe25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:19.020673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-132a4d62-cc04-415b-b8bd-5bdea033fe25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:19.049055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-132a4d62-cc04-415b-b8bd-5bdea033fe25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043101 Jul 28 20:15:19.049586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 617/1394] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:19.796861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b9fc879c-3d26-4248-a4ec-0b2fa05a71e6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:19.797630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b9fc879c-3d26-4248-a4ec-0b2fa05a71e6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:19.805008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9fc879c-3d26-4248-a4ec-0b2fa05a71e6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:19.805546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9fc879c-3d26-4248-a4ec-0b2fa05a71e6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:19.806419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9fc879c-3d26-4248-a4ec-0b2fa05a71e6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:19.806841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9fc879c-3d26-4248-a4ec-0b2fa05a71e6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:19.867527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b9fc879c-3d26-4248-a4ec-0b2fa05a71e6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:19.874977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b9fc879c-3d26-4248-a4ec-0b2fa05a71e6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082030 Jul 28 20:15:19.875516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 778/1395] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:19 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:15:20.061626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8897ec5b-cc65-4f0f-bbf4-784e0d8d174c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:20.063707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8897ec5b-cc65-4f0f-bbf4-784e0d8d174c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:20.070414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8897ec5b-cc65-4f0f-bbf4-784e0d8d174c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:20.070864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8897ec5b-cc65-4f0f-bbf4-784e0d8d174c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:20.071680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8897ec5b-cc65-4f0f-bbf4-784e0d8d174c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:20.072117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8897ec5b-cc65-4f0f-bbf4-784e0d8d174c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:20.103515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8897ec5b-cc65-4f0f-bbf4-784e0d8d174c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 Jul 28 20:15:20.104080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 618/1396] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:20.895261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-454c6dbc-8256-466c-938c-583983511dfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:20.895866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-454c6dbc-8256-466c-938c-583983511dfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:20.902270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-454c6dbc-8256-466c-938c-583983511dfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:20.902708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-454c6dbc-8256-466c-938c-583983511dfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:20.903456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-454c6dbc-8256-466c-938c-583983511dfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:20.903883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-454c6dbc-8256-466c-938c-583983511dfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:20.964941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-454c6dbc-8256-466c-938c-583983511dfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:20.972271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-454c6dbc-8256-466c-938c-583983511dfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081017 Jul 28 20:15:20.973085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 779/1397] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:20 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:21.115792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4b930ab5-b8cf-4b5d-8f26-915559a67b40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:21.118027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4b930ab5-b8cf-4b5d-8f26-915559a67b40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:21.124582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b930ab5-b8cf-4b5d-8f26-915559a67b40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:21.125038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b930ab5-b8cf-4b5d-8f26-915559a67b40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:21.125800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b930ab5-b8cf-4b5d-8f26-915559a67b40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:21.126239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b930ab5-b8cf-4b5d-8f26-915559a67b40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:21.155657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4b930ab5-b8cf-4b5d-8f26-915559a67b40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044024 Jul 28 20:15:21.156125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 619/1398] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:21.993966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-287ccf34-813f-4f4e-ad30-4a500ca937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:21.994518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-287ccf34-813f-4f4e-ad30-4a500ca937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:22.001018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-287ccf34-813f-4f4e-ad30-4a500ca937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:22.001456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-287ccf34-813f-4f4e-ad30-4a500ca937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:22.002199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-287ccf34-813f-4f4e-ad30-4a500ca937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:22.002621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-287ccf34-813f-4f4e-ad30-4a500ca937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:22.064998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-287ccf34-813f-4f4e-ad30-4a500ca937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:22.072611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-287ccf34-813f-4f4e-ad30-4a500ca937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082539 Jul 28 20:15:22.073162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 780/1399] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:21 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:15:22.167938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d2ed43b3-c1d6-49d0-8cc8-70ae69756376 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:22.170130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d2ed43b3-c1d6-49d0-8cc8-70ae69756376 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:22.176932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2ed43b3-c1d6-49d0-8cc8-70ae69756376 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:22.177383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2ed43b3-c1d6-49d0-8cc8-70ae69756376 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:22.178131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2ed43b3-c1d6-49d0-8cc8-70ae69756376 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:22.178558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2ed43b3-c1d6-49d0-8cc8-70ae69756376 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:22.207095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d2ed43b3-c1d6-49d0-8cc8-70ae69756376 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Jul 28 20:15:22.208370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 620/1400] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:22 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:23.093249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8479fff6-8913-404d-b5f3-e358a9febec5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:23.093869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8479fff6-8913-404d-b5f3-e358a9febec5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:23.101237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8479fff6-8913-404d-b5f3-e358a9febec5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:23.101680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8479fff6-8913-404d-b5f3-e358a9febec5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:23.102423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8479fff6-8913-404d-b5f3-e358a9febec5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:23.102845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8479fff6-8913-404d-b5f3-e358a9febec5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:23.165820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8479fff6-8913-404d-b5f3-e358a9febec5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:23.173636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8479fff6-8913-404d-b5f3-e358a9febec5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084197 Jul 28 20:15:23.174191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 781/1401] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:23 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:23.220641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-27ef0ffb-9097-498f-bee7-7163b68edb2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:23.223580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-27ef0ffb-9097-498f-bee7-7163b68edb2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:23.230052 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ef0ffb-9097-498f-bee7-7163b68edb2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:23.230515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ef0ffb-9097-498f-bee7-7163b68edb2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:23.231277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ef0ffb-9097-498f-bee7-7163b68edb2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:23.231701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ef0ffb-9097-498f-bee7-7163b68edb2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:23.260564 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-27ef0ffb-9097-498f-bee7-7163b68edb2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Jul 28 20:15:23.261189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 621/1402] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:24.195352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3ab00041-3079-4429-a684-a0f569356185 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:24.195959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3ab00041-3079-4429-a684-a0f569356185 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:24.202405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ab00041-3079-4429-a684-a0f569356185 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:24.202844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ab00041-3079-4429-a684-a0f569356185 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:24.203593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ab00041-3079-4429-a684-a0f569356185 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:24.204017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ab00041-3079-4429-a684-a0f569356185 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:24.268875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3ab00041-3079-4429-a684-a0f569356185 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:24.271995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-787573df-b310-41c3-a85f-0c63e765b37a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:24.274227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-787573df-b310-41c3-a85f-0c63e765b37a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:24.277085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3ab00041-3079-4429-a684-a0f569356185 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085619 Jul 28 20:15:24.277684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 782/1403] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:24 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:24.281028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-787573df-b310-41c3-a85f-0c63e765b37a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:24.281474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-787573df-b310-41c3-a85f-0c63e765b37a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:24.282494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-787573df-b310-41c3-a85f-0c63e765b37a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:24.282917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-787573df-b310-41c3-a85f-0c63e765b37a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:24.312198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-787573df-b310-41c3-a85f-0c63e765b37a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Jul 28 20:15:24.312774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 622/1404] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:15:25.298412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-57fec031-180c-40b3-9d22-0c8af42dbec8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:25.299023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-57fec031-180c-40b3-9d22-0c8af42dbec8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:25.306061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57fec031-180c-40b3-9d22-0c8af42dbec8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:25.306515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57fec031-180c-40b3-9d22-0c8af42dbec8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:25.307250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57fec031-180c-40b3-9d22-0c8af42dbec8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:25.307683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57fec031-180c-40b3-9d22-0c8af42dbec8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:25.324091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b77806a9-279d-4b75-bd5d-126bebbb5a6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:25.326313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b77806a9-279d-4b75-bd5d-126bebbb5a6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:25.332852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b77806a9-279d-4b75-bd5d-126bebbb5a6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:25.333294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b77806a9-279d-4b75-bd5d-126bebbb5a6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:25.334066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b77806a9-279d-4b75-bd5d-126bebbb5a6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:25.334506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b77806a9-279d-4b75-bd5d-126bebbb5a6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:25.363355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b77806a9-279d-4b75-bd5d-126bebbb5a6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043131 Jul 28 20:15:25.364415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 623/1405] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:15:25.369459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-57fec031-180c-40b3-9d22-0c8af42dbec8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:25.377938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-57fec031-180c-40b3-9d22-0c8af42dbec8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083290 Jul 28 20:15:25.378500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 783/1406] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:25 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:26.375485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f44ddb22-aad3-4f5f-89b0-dd6bb778de8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:26.377574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f44ddb22-aad3-4f5f-89b0-dd6bb778de8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:26.384765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f44ddb22-aad3-4f5f-89b0-dd6bb778de8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:26.385209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f44ddb22-aad3-4f5f-89b0-dd6bb778de8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:26.385956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f44ddb22-aad3-4f5f-89b0-dd6bb778de8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:26.386382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f44ddb22-aad3-4f5f-89b0-dd6bb778de8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:26.399837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-65bb7352-ed0a-4ef2-ba39-77108f737b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:26.400561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-65bb7352-ed0a-4ef2-ba39-77108f737b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:26.406978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65bb7352-ed0a-4ef2-ba39-77108f737b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:26.407682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65bb7352-ed0a-4ef2-ba39-77108f737b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:26.408441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65bb7352-ed0a-4ef2-ba39-77108f737b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:26.408903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65bb7352-ed0a-4ef2-ba39-77108f737b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:26.416722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f44ddb22-aad3-4f5f-89b0-dd6bb778de8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Jul 28 20:15:26.417274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 624/1407] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:26.469987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-65bb7352-ed0a-4ef2-ba39-77108f737b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:26.477510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-65bb7352-ed0a-4ef2-ba39-77108f737b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081576 Jul 28 20:15:26.478059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 784/1408] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:26 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:15:27.429611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-99ec7e8a-a589-4dfb-90e2-9f96dad47099 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:27.431740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-99ec7e8a-a589-4dfb-90e2-9f96dad47099 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:27.438252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-99ec7e8a-a589-4dfb-90e2-9f96dad47099 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:27.438701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-99ec7e8a-a589-4dfb-90e2-9f96dad47099 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:27.439458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-99ec7e8a-a589-4dfb-90e2-9f96dad47099 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:27.439892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-99ec7e8a-a589-4dfb-90e2-9f96dad47099 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:27.468825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-99ec7e8a-a589-4dfb-90e2-9f96dad47099 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Jul 28 20:15:27.469367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 625/1409] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:27.497739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-39d09d86-cdb9-468e-be28-d6a76c040a73 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:27.498337 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-39d09d86-cdb9-468e-be28-d6a76c040a73 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:27.505165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39d09d86-cdb9-468e-be28-d6a76c040a73 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:27.505605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39d09d86-cdb9-468e-be28-d6a76c040a73 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:27.506350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39d09d86-cdb9-468e-be28-d6a76c040a73 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:27.506898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39d09d86-cdb9-468e-be28-d6a76c040a73 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:27.569958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-39d09d86-cdb9-468e-be28-d6a76c040a73 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:27.577404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-39d09d86-cdb9-468e-be28-d6a76c040a73 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083517 Jul 28 20:15:27.577960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 785/1410] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:27 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:28.482516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-152f4b3b-aa97-4c79-95dc-9dec2629f5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:28.484637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-152f4b3b-aa97-4c79-95dc-9dec2629f5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:28.491658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-152f4b3b-aa97-4c79-95dc-9dec2629f5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:28.492108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-152f4b3b-aa97-4c79-95dc-9dec2629f5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:28.492888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-152f4b3b-aa97-4c79-95dc-9dec2629f5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:28.493322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-152f4b3b-aa97-4c79-95dc-9dec2629f5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:28.521967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-152f4b3b-aa97-4c79-95dc-9dec2629f5fc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Jul 28 20:15:28.522504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 626/1411] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:28.599083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b2f8f396-a787-4a9c-ba35-efd8ab6b2c2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:28.599703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b2f8f396-a787-4a9c-ba35-efd8ab6b2c2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:28.606378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2f8f396-a787-4a9c-ba35-efd8ab6b2c2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:28.606832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2f8f396-a787-4a9c-ba35-efd8ab6b2c2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:28.607590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2f8f396-a787-4a9c-ba35-efd8ab6b2c2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:28.608026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2f8f396-a787-4a9c-ba35-efd8ab6b2c2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:28.669065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b2f8f396-a787-4a9c-ba35-efd8ab6b2c2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:28.677160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b2f8f396-a787-4a9c-ba35-efd8ab6b2c2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082398 Jul 28 20:15:28.677725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 786/1412] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:28 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:29.534788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f9c69b75-f4f0-4749-999e-5e8d17be4e3d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:29.537043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f9c69b75-f4f0-4749-999e-5e8d17be4e3d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:29.543712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9c69b75-f4f0-4749-999e-5e8d17be4e3d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:29.544161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9c69b75-f4f0-4749-999e-5e8d17be4e3d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:29.545033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9c69b75-f4f0-4749-999e-5e8d17be4e3d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:29.545471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9c69b75-f4f0-4749-999e-5e8d17be4e3d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:29.575499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f9c69b75-f4f0-4749-999e-5e8d17be4e3d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045088 Jul 28 20:15:29.576103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 627/1413] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:29 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:29.698370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8e6371b9-c0ba-4f57-99fc-2ddb0866cac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:29.698970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8e6371b9-c0ba-4f57-99fc-2ddb0866cac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:29.705402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6371b9-c0ba-4f57-99fc-2ddb0866cac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:29.705844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6371b9-c0ba-4f57-99fc-2ddb0866cac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:29.706584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6371b9-c0ba-4f57-99fc-2ddb0866cac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:29.707008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6371b9-c0ba-4f57-99fc-2ddb0866cac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:29.767375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e6371b9-c0ba-4f57-99fc-2ddb0866cac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:29.775345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8e6371b9-c0ba-4f57-99fc-2ddb0866cac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080807 Jul 28 20:15:29.777147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 787/1414] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:29 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:30.587801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-891bf4bd-c02a-4766-9d07-7c3e13d23e86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:30.590021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-891bf4bd-c02a-4766-9d07-7c3e13d23e86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:30.596460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-891bf4bd-c02a-4766-9d07-7c3e13d23e86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:30.596938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-891bf4bd-c02a-4766-9d07-7c3e13d23e86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:30.597720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-891bf4bd-c02a-4766-9d07-7c3e13d23e86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:30.598235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-891bf4bd-c02a-4766-9d07-7c3e13d23e86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:30.627014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-891bf4bd-c02a-4766-9d07-7c3e13d23e86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Jul 28 20:15:30.627547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 628/1415] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:30.797941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a853b603-0c82-4005-b831-b026d48bb250 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:30.798544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a853b603-0c82-4005-b831-b026d48bb250 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:30.805698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a853b603-0c82-4005-b831-b026d48bb250 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:30.806137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a853b603-0c82-4005-b831-b026d48bb250 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:30.806882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a853b603-0c82-4005-b831-b026d48bb250 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:30.807307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a853b603-0c82-4005-b831-b026d48bb250 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:30.868656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a853b603-0c82-4005-b831-b026d48bb250 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:30.876096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a853b603-0c82-4005-b831-b026d48bb250 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082031 Jul 28 20:15:30.876671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 788/1416] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:30 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:31.639814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4b2d148d-375e-4b76-990c-cf998b293496 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:31.642033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4b2d148d-375e-4b76-990c-cf998b293496 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:31.648161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b2d148d-375e-4b76-990c-cf998b293496 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:31.648634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b2d148d-375e-4b76-990c-cf998b293496 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:31.649388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b2d148d-375e-4b76-990c-cf998b293496 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:31.649817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b2d148d-375e-4b76-990c-cf998b293496 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:31.679834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4b2d148d-375e-4b76-990c-cf998b293496 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043970 Jul 28 20:15:31.680368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 629/1417] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:31.897875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-46fe71b5-a3ff-4093-89e4-2e8c52e30fad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:31.898427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-46fe71b5-a3ff-4093-89e4-2e8c52e30fad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:31.905023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46fe71b5-a3ff-4093-89e4-2e8c52e30fad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:31.905470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46fe71b5-a3ff-4093-89e4-2e8c52e30fad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:31.906223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46fe71b5-a3ff-4093-89e4-2e8c52e30fad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:31.906650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-46fe71b5-a3ff-4093-89e4-2e8c52e30fad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:31.973988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-46fe71b5-a3ff-4093-89e4-2e8c52e30fad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:31.981684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-46fe71b5-a3ff-4093-89e4-2e8c52e30fad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.088376 Jul 28 20:15:31.982235 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 789/1418] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:31 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:32.692231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a75703c9-e51e-4020-9ce7-b6047a26c735 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:32.694682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a75703c9-e51e-4020-9ce7-b6047a26c735 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:32.701152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a75703c9-e51e-4020-9ce7-b6047a26c735 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:32.701597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a75703c9-e51e-4020-9ce7-b6047a26c735 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:32.702357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a75703c9-e51e-4020-9ce7-b6047a26c735 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:32.702789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a75703c9-e51e-4020-9ce7-b6047a26c735 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:32.706327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:32.732717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a75703c9-e51e-4020-9ce7-b6047a26c735 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Jul 28 20:15:32.733263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 630/1419] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:33.002159 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-98f86b9a-8494-4c29-a659-a7475a905a42 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:33.002723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-98f86b9a-8494-4c29-a659-a7475a905a42 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:33.009253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98f86b9a-8494-4c29-a659-a7475a905a42 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:33.009691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98f86b9a-8494-4c29-a659-a7475a905a42 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:33.010433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98f86b9a-8494-4c29-a659-a7475a905a42 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:33.010857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98f86b9a-8494-4c29-a659-a7475a905a42 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:33.072443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-98f86b9a-8494-4c29-a659-a7475a905a42 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:33.079897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-98f86b9a-8494-4c29-a659-a7475a905a42 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081870 Jul 28 20:15:33.080452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 790/1420] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:32 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:33.745832 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d2965a08-6d15-422a-aca1-5e2b23c09756 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:33.748026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d2965a08-6d15-422a-aca1-5e2b23c09756 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:33.755494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2965a08-6d15-422a-aca1-5e2b23c09756 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:33.755945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2965a08-6d15-422a-aca1-5e2b23c09756 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:33.756829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2965a08-6d15-422a-aca1-5e2b23c09756 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:33.757267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2965a08-6d15-422a-aca1-5e2b23c09756 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:33.788857 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d2965a08-6d15-422a-aca1-5e2b23c09756 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046966 Jul 28 20:15:33.789425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 631/1421] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:34.100796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-35b8ba05-0ddc-42e0-96b5-77d6039e4412 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:34.101411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-35b8ba05-0ddc-42e0-96b5-77d6039e4412 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:34.107874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35b8ba05-0ddc-42e0-96b5-77d6039e4412 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:34.108318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35b8ba05-0ddc-42e0-96b5-77d6039e4412 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:34.109173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35b8ba05-0ddc-42e0-96b5-77d6039e4412 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:34.109605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35b8ba05-0ddc-42e0-96b5-77d6039e4412 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:34.170904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-35b8ba05-0ddc-42e0-96b5-77d6039e4412 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:34.179634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-35b8ba05-0ddc-42e0-96b5-77d6039e4412 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083203 Jul 28 20:15:34.180196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 791/1422] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:34 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:34.801874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8b0af9e4-52c2-4812-af7d-0abc28209283 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:34.804040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8b0af9e4-52c2-4812-af7d-0abc28209283 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:34.810427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b0af9e4-52c2-4812-af7d-0abc28209283 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:34.810870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b0af9e4-52c2-4812-af7d-0abc28209283 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:34.811620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b0af9e4-52c2-4812-af7d-0abc28209283 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:34.812051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b0af9e4-52c2-4812-af7d-0abc28209283 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:34.841572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8b0af9e4-52c2-4812-af7d-0abc28209283 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Jul 28 20:15:34.842116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 632/1423] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:35.202912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3064891e-b2c0-4fde-8cae-f5dedca0635e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:35.203519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3064891e-b2c0-4fde-8cae-f5dedca0635e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:35.211196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3064891e-b2c0-4fde-8cae-f5dedca0635e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:35.211640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3064891e-b2c0-4fde-8cae-f5dedca0635e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:35.212392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3064891e-b2c0-4fde-8cae-f5dedca0635e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:35.212853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3064891e-b2c0-4fde-8cae-f5dedca0635e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:35.275300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3064891e-b2c0-4fde-8cae-f5dedca0635e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:35.282962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3064891e-b2c0-4fde-8cae-f5dedca0635e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084991 Jul 28 20:15:35.283518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 792/1424] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:35 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:35.853912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eb22e723-6941-4229-b7ef-105595a0a92c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:35.855971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eb22e723-6941-4229-b7ef-105595a0a92c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:35.862488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb22e723-6941-4229-b7ef-105595a0a92c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:35.862934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb22e723-6941-4229-b7ef-105595a0a92c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:35.864177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb22e723-6941-4229-b7ef-105595a0a92c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:35.864630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb22e723-6941-4229-b7ef-105595a0a92c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:35.893328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eb22e723-6941-4229-b7ef-105595a0a92c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043435 Jul 28 20:15:35.893863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 633/1425] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:36.303928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fdc15560-becb-4bdc-baf8-b4157d304d1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:36.304561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fdc15560-becb-4bdc-baf8-b4157d304d1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:36.310936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdc15560-becb-4bdc-baf8-b4157d304d1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:36.311398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdc15560-becb-4bdc-baf8-b4157d304d1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:36.312141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdc15560-becb-4bdc-baf8-b4157d304d1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:36.312584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdc15560-becb-4bdc-baf8-b4157d304d1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:36.316360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:36.375771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fdc15560-becb-4bdc-baf8-b4157d304d1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:36.383936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fdc15560-becb-4bdc-baf8-b4157d304d1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084250 Jul 28 20:15:36.384487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 793/1426] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:36 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:36.906352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-25db7333-1467-4802-ab0c-0333d6aa7dc4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:36.908781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-25db7333-1467-4802-ab0c-0333d6aa7dc4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:36.915689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25db7333-1467-4802-ab0c-0333d6aa7dc4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:36.916138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25db7333-1467-4802-ab0c-0333d6aa7dc4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:36.916944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25db7333-1467-4802-ab0c-0333d6aa7dc4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:36.917385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25db7333-1467-4802-ab0c-0333d6aa7dc4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:36.947251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-25db7333-1467-4802-ab0c-0333d6aa7dc4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Jul 28 20:15:36.947803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 634/1427] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:37.405199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f28ca82c-5960-44e2-abc1-42c2114a51c4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:37.405831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f28ca82c-5960-44e2-abc1-42c2114a51c4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:37.413350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f28ca82c-5960-44e2-abc1-42c2114a51c4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:37.413735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f28ca82c-5960-44e2-abc1-42c2114a51c4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:37.414494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f28ca82c-5960-44e2-abc1-42c2114a51c4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:37.414923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f28ca82c-5960-44e2-abc1-42c2114a51c4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:37.476188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f28ca82c-5960-44e2-abc1-42c2114a51c4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:37.483664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f28ca82c-5960-44e2-abc1-42c2114a51c4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082435 Jul 28 20:15:37.484221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 794/1428] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:37 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:37.959972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a4d6c67f-684a-4d0a-b00c-9470039f51cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:37.962127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a4d6c67f-684a-4d0a-b00c-9470039f51cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:37.968555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a4d6c67f-684a-4d0a-b00c-9470039f51cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:37.969013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a4d6c67f-684a-4d0a-b00c-9470039f51cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:37.969766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a4d6c67f-684a-4d0a-b00c-9470039f51cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:37.970196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a4d6c67f-684a-4d0a-b00c-9470039f51cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:37.999265 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a4d6c67f-684a-4d0a-b00c-9470039f51cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043855 Jul 28 20:15:37.999809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 635/1429] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:38.505056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-67ce6cbd-2881-4796-842f-b259ffd15645 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:38.505662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-67ce6cbd-2881-4796-842f-b259ffd15645 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:38.512100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67ce6cbd-2881-4796-842f-b259ffd15645 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:38.512553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67ce6cbd-2881-4796-842f-b259ffd15645 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:38.513322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67ce6cbd-2881-4796-842f-b259ffd15645 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:38.513750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67ce6cbd-2881-4796-842f-b259ffd15645 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:38.574699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-67ce6cbd-2881-4796-842f-b259ffd15645 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:38.582247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-67ce6cbd-2881-4796-842f-b259ffd15645 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080978 Jul 28 20:15:38.595295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 795/1430] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:38 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:39.011466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bc79c57c-e2d6-445d-a567-1a8fe37e6c9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:39.013709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bc79c57c-e2d6-445d-a567-1a8fe37e6c9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:39.020744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bc79c57c-e2d6-445d-a567-1a8fe37e6c9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:39.021196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bc79c57c-e2d6-445d-a567-1a8fe37e6c9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:39.021964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bc79c57c-e2d6-445d-a567-1a8fe37e6c9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:39.022397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bc79c57c-e2d6-445d-a567-1a8fe37e6c9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:39.051065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bc79c57c-e2d6-445d-a567-1a8fe37e6c9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Jul 28 20:15:39.051615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 636/1431] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:39.602885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4dae9b49-d789-4573-9d76-093f6613fa16 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:39.603520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4dae9b49-d789-4573-9d76-093f6613fa16 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:39.609948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4dae9b49-d789-4573-9d76-093f6613fa16 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:39.610383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4dae9b49-d789-4573-9d76-093f6613fa16 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:39.611126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4dae9b49-d789-4573-9d76-093f6613fa16 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:39.611550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4dae9b49-d789-4573-9d76-093f6613fa16 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:39.673285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4dae9b49-d789-4573-9d76-093f6613fa16 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:39.681244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4dae9b49-d789-4573-9d76-093f6613fa16 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082213 Jul 28 20:15:39.681799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 796/1432] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:39 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:40.063565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-abd26c77-c1b4-4089-8e5a-af8cddb1ba1e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:40.065642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-abd26c77-c1b4-4089-8e5a-af8cddb1ba1e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:40.072332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abd26c77-c1b4-4089-8e5a-af8cddb1ba1e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:40.072808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abd26c77-c1b4-4089-8e5a-af8cddb1ba1e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:40.073559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abd26c77-c1b4-4089-8e5a-af8cddb1ba1e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:40.073987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abd26c77-c1b4-4089-8e5a-af8cddb1ba1e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:40.102274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-abd26c77-c1b4-4089-8e5a-af8cddb1ba1e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042872 Jul 28 20:15:40.102813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 637/1433] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:40.702698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-91e1f6a6-de08-44ec-931a-7d5160b132e1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:40.703287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-91e1f6a6-de08-44ec-931a-7d5160b132e1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:40.710660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91e1f6a6-de08-44ec-931a-7d5160b132e1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:40.711100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91e1f6a6-de08-44ec-931a-7d5160b132e1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:40.711845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91e1f6a6-de08-44ec-931a-7d5160b132e1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:40.712276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91e1f6a6-de08-44ec-931a-7d5160b132e1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:40.775020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-91e1f6a6-de08-44ec-931a-7d5160b132e1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:40.782665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-91e1f6a6-de08-44ec-931a-7d5160b132e1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083613 Jul 28 20:15:40.783218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 797/1434] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:40 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:41.113594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-42c73640-d6c9-4afe-8c15-7a76422cd8b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:41.115729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-42c73640-d6c9-4afe-8c15-7a76422cd8b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:41.122163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42c73640-d6c9-4afe-8c15-7a76422cd8b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:41.122600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42c73640-d6c9-4afe-8c15-7a76422cd8b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:41.123346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42c73640-d6c9-4afe-8c15-7a76422cd8b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:41.123772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42c73640-d6c9-4afe-8c15-7a76422cd8b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:41.153794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-42c73640-d6c9-4afe-8c15-7a76422cd8b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Jul 28 20:15:41.154330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 638/1435] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:41.803865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7cc66a99-9334-4b4e-9245-f7c24d963b48 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:41.804469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7cc66a99-9334-4b4e-9245-f7c24d963b48 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:41.811033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7cc66a99-9334-4b4e-9245-f7c24d963b48 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:41.811489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7cc66a99-9334-4b4e-9245-f7c24d963b48 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:41.812241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7cc66a99-9334-4b4e-9245-f7c24d963b48 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:41.812703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7cc66a99-9334-4b4e-9245-f7c24d963b48 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:41.873223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7cc66a99-9334-4b4e-9245-f7c24d963b48 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:41.881321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7cc66a99-9334-4b4e-9245-f7c24d963b48 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081938 Jul 28 20:15:41.881884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 798/1436] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:41 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:42.165900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ea6d5163-5847-46ff-bff8-df3527148b57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:42.168049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ea6d5163-5847-46ff-bff8-df3527148b57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:42.174556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea6d5163-5847-46ff-bff8-df3527148b57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:42.174991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea6d5163-5847-46ff-bff8-df3527148b57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:42.176030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea6d5163-5847-46ff-bff8-df3527148b57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:42.176469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea6d5163-5847-46ff-bff8-df3527148b57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:42.205276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ea6d5163-5847-46ff-bff8-df3527148b57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043319 Jul 28 20:15:42.205818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 639/1437] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:42.901799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8b161b87-9b61-49d6-abf9-01a811f1c558 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:42.902403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8b161b87-9b61-49d6-abf9-01a811f1c558 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:42.909097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b161b87-9b61-49d6-abf9-01a811f1c558 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:42.909536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b161b87-9b61-49d6-abf9-01a811f1c558 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:42.910354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b161b87-9b61-49d6-abf9-01a811f1c558 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:42.910783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b161b87-9b61-49d6-abf9-01a811f1c558 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:42.971739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8b161b87-9b61-49d6-abf9-01a811f1c558 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:42.979640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8b161b87-9b61-49d6-abf9-01a811f1c558 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081691 Jul 28 20:15:42.980212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 799/1438] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:42 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:43.218231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-21b1afdb-937f-4a9c-83aa-e322e135f4ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:43.220406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-21b1afdb-937f-4a9c-83aa-e322e135f4ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:43.226837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21b1afdb-937f-4a9c-83aa-e322e135f4ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:43.227282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21b1afdb-937f-4a9c-83aa-e322e135f4ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:43.228059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21b1afdb-937f-4a9c-83aa-e322e135f4ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:43.228494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21b1afdb-937f-4a9c-83aa-e322e135f4ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:43.257465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-21b1afdb-937f-4a9c-83aa-e322e135f4ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043255 Jul 28 20:15:43.258015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 640/1439] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:44.000533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-77521d5a-2d37-4521-bc01-485689652675 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:44.001159 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-77521d5a-2d37-4521-bc01-485689652675 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:44.003400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=56 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:44.008948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77521d5a-2d37-4521-bc01-485689652675 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:44.009388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77521d5a-2d37-4521-bc01-485689652675 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:44.010133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77521d5a-2d37-4521-bc01-485689652675 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:44.010558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77521d5a-2d37-4521-bc01-485689652675 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:44.073296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-77521d5a-2d37-4521-bc01-485689652675 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:44.080782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-77521d5a-2d37-4521-bc01-485689652675 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084099 Jul 28 20:15:44.081334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 800/1440] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:43 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:15:44.271368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eba8c5fc-d178-4747-aa80-5836b94cbb03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:44.273480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eba8c5fc-d178-4747-aa80-5836b94cbb03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:44.275761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=58 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:44.280755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eba8c5fc-d178-4747-aa80-5836b94cbb03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:44.281205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eba8c5fc-d178-4747-aa80-5836b94cbb03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:44.281968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eba8c5fc-d178-4747-aa80-5836b94cbb03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:44.282655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eba8c5fc-d178-4747-aa80-5836b94cbb03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:44.313296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eba8c5fc-d178-4747-aa80-5836b94cbb03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046261 Jul 28 20:15:44.313845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 641/1441] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:45.101925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8429fe82-18d5-400f-ac94-748139ad28b3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:45.102540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8429fe82-18d5-400f-ac94-748139ad28b3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:45.109277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8429fe82-18d5-400f-ac94-748139ad28b3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:45.109716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8429fe82-18d5-400f-ac94-748139ad28b3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:45.110465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8429fe82-18d5-400f-ac94-748139ad28b3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:45.110891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8429fe82-18d5-400f-ac94-748139ad28b3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:45.174906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8429fe82-18d5-400f-ac94-748139ad28b3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:45.182490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8429fe82-18d5-400f-ac94-748139ad28b3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084997 Jul 28 20:15:45.183038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 801/1442] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:45 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:45.325739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-403b4cc7-cb2b-44c4-8142-174827521580 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:45.327887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-403b4cc7-cb2b-44c4-8142-174827521580 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:45.335074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-403b4cc7-cb2b-44c4-8142-174827521580 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:45.335518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-403b4cc7-cb2b-44c4-8142-174827521580 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:45.336277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-403b4cc7-cb2b-44c4-8142-174827521580 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:45.336749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-403b4cc7-cb2b-44c4-8142-174827521580 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:45.365426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-403b4cc7-cb2b-44c4-8142-174827521580 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 Jul 28 20:15:45.365897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 642/1443] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:46.203266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9f72f3e5-ba53-482f-8493-4edd18a9f3ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:46.203878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9f72f3e5-ba53-482f-8493-4edd18a9f3ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:46.210912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f72f3e5-ba53-482f-8493-4edd18a9f3ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:46.211359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f72f3e5-ba53-482f-8493-4edd18a9f3ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:46.212147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f72f3e5-ba53-482f-8493-4edd18a9f3ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:46.212600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f72f3e5-ba53-482f-8493-4edd18a9f3ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:46.277654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9f72f3e5-ba53-482f-8493-4edd18a9f3ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:46.286383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9f72f3e5-ba53-482f-8493-4edd18a9f3ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086019 Jul 28 20:15:46.286961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 802/1444] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:46 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:46.377625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1db4162e-d848-428a-873d-2816d03e789d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:46.380125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1db4162e-d848-428a-873d-2816d03e789d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:46.386746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1db4162e-d848-428a-873d-2816d03e789d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:46.387193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1db4162e-d848-428a-873d-2816d03e789d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:46.387953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1db4162e-d848-428a-873d-2816d03e789d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:46.388386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1db4162e-d848-428a-873d-2816d03e789d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:46.418827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1db4162e-d848-428a-873d-2816d03e789d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045236 Jul 28 20:15:46.419366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 643/1445] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:47.307004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-34df9201-afdf-4862-b725-18c5b4ceedd0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:47.307616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-34df9201-afdf-4862-b725-18c5b4ceedd0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:47.314156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34df9201-afdf-4862-b725-18c5b4ceedd0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:47.314598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34df9201-afdf-4862-b725-18c5b4ceedd0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:47.315353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34df9201-afdf-4862-b725-18c5b4ceedd0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:47.315799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34df9201-afdf-4862-b725-18c5b4ceedd0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:47.375531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-34df9201-afdf-4862-b725-18c5b4ceedd0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:47.383003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-34df9201-afdf-4862-b725-18c5b4ceedd0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.079868 Jul 28 20:15:47.383564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 803/1446] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:47.431700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-50b6e232-0c5d-4c57-a659-5395abd89adb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:47.433789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-50b6e232-0c5d-4c57-a659-5395abd89adb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:47.440344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50b6e232-0c5d-4c57-a659-5395abd89adb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:47.440811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50b6e232-0c5d-4c57-a659-5395abd89adb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:47.441615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50b6e232-0c5d-4c57-a659-5395abd89adb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:47.442153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50b6e232-0c5d-4c57-a659-5395abd89adb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:47.470161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-50b6e232-0c5d-4c57-a659-5395abd89adb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042431 Jul 28 20:15:47.470697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 644/1447] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:48.403219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8890bb45-2932-4ae8-9148-ef3706c65950 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:48.403819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8890bb45-2932-4ae8-9148-ef3706c65950 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:48.411245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8890bb45-2932-4ae8-9148-ef3706c65950 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:48.411687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8890bb45-2932-4ae8-9148-ef3706c65950 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:48.412457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8890bb45-2932-4ae8-9148-ef3706c65950 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:48.412908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8890bb45-2932-4ae8-9148-ef3706c65950 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:48.474137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8890bb45-2932-4ae8-9148-ef3706c65950 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:48.481781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8890bb45-2932-4ae8-9148-ef3706c65950 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082418 Jul 28 20:15:48.482343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 804/1448] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:48.482870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-22269d47-3687-4e3c-9996-545b4223d3cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:48.485064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-22269d47-3687-4e3c-9996-545b4223d3cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:48.492197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-22269d47-3687-4e3c-9996-545b4223d3cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:48.492672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-22269d47-3687-4e3c-9996-545b4223d3cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:48.493437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-22269d47-3687-4e3c-9996-545b4223d3cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:48.493871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-22269d47-3687-4e3c-9996-545b4223d3cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:48.523465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-22269d47-3687-4e3c-9996-545b4223d3cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044508 Jul 28 20:15:48.524017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 645/1449] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:15:49.507932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3a50100c-000f-4687-9785-633ee860dd88 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:49.509004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3a50100c-000f-4687-9785-633ee860dd88 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:49.516869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a50100c-000f-4687-9785-633ee860dd88 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:49.517315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a50100c-000f-4687-9785-633ee860dd88 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:49.518069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a50100c-000f-4687-9785-633ee860dd88 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:49.518507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a50100c-000f-4687-9785-633ee860dd88 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:49.536405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0df8e5f1-f667-45a8-8064-f68022b9af54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:49.538655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0df8e5f1-f667-45a8-8064-f68022b9af54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:49.545276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0df8e5f1-f667-45a8-8064-f68022b9af54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:49.545722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0df8e5f1-f667-45a8-8064-f68022b9af54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:49.546476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0df8e5f1-f667-45a8-8064-f68022b9af54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:49.546899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0df8e5f1-f667-45a8-8064-f68022b9af54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:49.572744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:49.577678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0df8e5f1-f667-45a8-8064-f68022b9af54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046189 Jul 28 20:15:49.578329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 646/1450] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:15:49.583357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3a50100c-000f-4687-9785-633ee860dd88 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:49.590932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3a50100c-000f-4687-9785-633ee860dd88 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.091127 Jul 28 20:15:49.591484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 805/1451] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:49 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:50.590087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ffd9ec7c-1eca-44ab-9c56-ded1f04b0084 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:50.592232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ffd9ec7c-1eca-44ab-9c56-ded1f04b0084 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:50.598813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffd9ec7c-1eca-44ab-9c56-ded1f04b0084 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:50.599253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffd9ec7c-1eca-44ab-9c56-ded1f04b0084 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:50.600005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffd9ec7c-1eca-44ab-9c56-ded1f04b0084 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:50.600438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffd9ec7c-1eca-44ab-9c56-ded1f04b0084 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:50.611601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-72612dcc-5a30-4aba-9a75-349c90a504fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:50.612209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-72612dcc-5a30-4aba-9a75-349c90a504fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:50.619280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72612dcc-5a30-4aba-9a75-349c90a504fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:50.619718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72612dcc-5a30-4aba-9a75-349c90a504fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:50.620467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72612dcc-5a30-4aba-9a75-349c90a504fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:50.620921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72612dcc-5a30-4aba-9a75-349c90a504fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:50.630432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ffd9ec7c-1eca-44ab-9c56-ded1f04b0084 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 Jul 28 20:15:50.630987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 647/1452] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:50.682444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-72612dcc-5a30-4aba-9a75-349c90a504fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:50.689734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-72612dcc-5a30-4aba-9a75-349c90a504fe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081926 Jul 28 20:15:50.690277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 806/1453] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:15:51.642764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-91f1d29b-6ddb-427b-8020-15c0099aff54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:51.645481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-91f1d29b-6ddb-427b-8020-15c0099aff54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:51.651843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91f1d29b-6ddb-427b-8020-15c0099aff54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:51.652318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91f1d29b-6ddb-427b-8020-15c0099aff54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:51.653114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91f1d29b-6ddb-427b-8020-15c0099aff54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:51.653547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91f1d29b-6ddb-427b-8020-15c0099aff54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:51.682551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-91f1d29b-6ddb-427b-8020-15c0099aff54 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043767 Jul 28 20:15:51.683100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 648/1454] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:51.711781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e9eeca6e-ac9c-4874-ab83-1b0eeb04cc4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:51.712395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e9eeca6e-ac9c-4874-ab83-1b0eeb04cc4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:51.718919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9eeca6e-ac9c-4874-ab83-1b0eeb04cc4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:51.719364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9eeca6e-ac9c-4874-ab83-1b0eeb04cc4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:51.720112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9eeca6e-ac9c-4874-ab83-1b0eeb04cc4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:51.720559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9eeca6e-ac9c-4874-ab83-1b0eeb04cc4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:51.781552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e9eeca6e-ac9c-4874-ab83-1b0eeb04cc4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:51.789342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e9eeca6e-ac9c-4874-ab83-1b0eeb04cc4e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081385 Jul 28 20:15:51.789905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 807/1455] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:51 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:52.695143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-136713a0-f946-4278-9620-4fde6c3b1b2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:52.697317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-136713a0-f946-4278-9620-4fde6c3b1b2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:52.703699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-136713a0-f946-4278-9620-4fde6c3b1b2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:52.704163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-136713a0-f946-4278-9620-4fde6c3b1b2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:52.704934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-136713a0-f946-4278-9620-4fde6c3b1b2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:52.705367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-136713a0-f946-4278-9620-4fde6c3b1b2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:52.734256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-136713a0-f946-4278-9620-4fde6c3b1b2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043464 Jul 28 20:15:52.734795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 649/1456] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:52.809974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b7d54c89-1918-47d8-95f7-808f85681b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:52.810572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b7d54c89-1918-47d8-95f7-808f85681b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:52.817603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7d54c89-1918-47d8-95f7-808f85681b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:52.818042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7d54c89-1918-47d8-95f7-808f85681b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:52.818780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7d54c89-1918-47d8-95f7-808f85681b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:52.819203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b7d54c89-1918-47d8-95f7-808f85681b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:52.881454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b7d54c89-1918-47d8-95f7-808f85681b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:52.888868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b7d54c89-1918-47d8-95f7-808f85681b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082659 Jul 28 20:15:52.889420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 808/1457] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:52 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:53.747112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f6ad3da9-0f93-4b92-9d05-0eafa0721920 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:53.749337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f6ad3da9-0f93-4b92-9d05-0eafa0721920 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:53.755869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6ad3da9-0f93-4b92-9d05-0eafa0721920 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:53.756319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6ad3da9-0f93-4b92-9d05-0eafa0721920 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:53.757110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6ad3da9-0f93-4b92-9d05-0eafa0721920 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:53.757542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6ad3da9-0f93-4b92-9d05-0eafa0721920 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:53.787172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f6ad3da9-0f93-4b92-9d05-0eafa0721920 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Jul 28 20:15:53.787708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 650/1458] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:53.909669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-137b3696-f268-4fc7-9ea8-000b05557e52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:53.910940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-137b3696-f268-4fc7-9ea8-000b05557e52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:53.917525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-137b3696-f268-4fc7-9ea8-000b05557e52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:53.917967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-137b3696-f268-4fc7-9ea8-000b05557e52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:53.918721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-137b3696-f268-4fc7-9ea8-000b05557e52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:53.919180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-137b3696-f268-4fc7-9ea8-000b05557e52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:53.984184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-137b3696-f268-4fc7-9ea8-000b05557e52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:53.987658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:15:53.992819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-137b3696-f268-4fc7-9ea8-000b05557e52 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087193 Jul 28 20:15:53.993382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 809/1459] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:53 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:54.799438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0dd099c6-905d-4f25-9ec3-a056b98a2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:54.802437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0dd099c6-905d-4f25-9ec3-a056b98a2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:54.808937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dd099c6-905d-4f25-9ec3-a056b98a2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:54.809391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dd099c6-905d-4f25-9ec3-a056b98a2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:54.810163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dd099c6-905d-4f25-9ec3-a056b98a2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:54.810598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dd099c6-905d-4f25-9ec3-a056b98a2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:54.838573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0dd099c6-905d-4f25-9ec3-a056b98a2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043143 Jul 28 20:15:54.839122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 651/1460] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:55.014050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7c955e33-52f7-4dc3-bcf3-eeeceaa68625 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:55.014662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7c955e33-52f7-4dc3-bcf3-eeeceaa68625 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:55.021746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c955e33-52f7-4dc3-bcf3-eeeceaa68625 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:55.022188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c955e33-52f7-4dc3-bcf3-eeeceaa68625 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:55.022940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c955e33-52f7-4dc3-bcf3-eeeceaa68625 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:55.023371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c955e33-52f7-4dc3-bcf3-eeeceaa68625 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:55.084584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7c955e33-52f7-4dc3-bcf3-eeeceaa68625 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:55.091981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7c955e33-52f7-4dc3-bcf3-eeeceaa68625 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081794 Jul 28 20:15:55.092528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 810/1461] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:55.851680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-753a0cdb-6145-4661-98e0-33e488778910 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:55.854338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-753a0cdb-6145-4661-98e0-33e488778910 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:55.860909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-753a0cdb-6145-4661-98e0-33e488778910 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:55.861456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-753a0cdb-6145-4661-98e0-33e488778910 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:55.862224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-753a0cdb-6145-4661-98e0-33e488778910 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:55.862660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-753a0cdb-6145-4661-98e0-33e488778910 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:55.893007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-753a0cdb-6145-4661-98e0-33e488778910 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046024 Jul 28 20:15:55.893829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 652/1462] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:55 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:56.112229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d9d86a0f-9fa8-4c27-8f42-0aef96c20fa6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:56.113523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d9d86a0f-9fa8-4c27-8f42-0aef96c20fa6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:56.119910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9d86a0f-9fa8-4c27-8f42-0aef96c20fa6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:56.120353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9d86a0f-9fa8-4c27-8f42-0aef96c20fa6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:56.121139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9d86a0f-9fa8-4c27-8f42-0aef96c20fa6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:56.121571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9d86a0f-9fa8-4c27-8f42-0aef96c20fa6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:56.183121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d9d86a0f-9fa8-4c27-8f42-0aef96c20fa6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:56.190652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d9d86a0f-9fa8-4c27-8f42-0aef96c20fa6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082375 Jul 28 20:15:56.191260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 811/1463] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:56 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:56.905104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0a7356df-6edc-4123-9408-a37f49d3d364 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:56.907633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0a7356df-6edc-4123-9408-a37f49d3d364 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:56.915498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a7356df-6edc-4123-9408-a37f49d3d364 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:56.915948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a7356df-6edc-4123-9408-a37f49d3d364 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:56.916752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a7356df-6edc-4123-9408-a37f49d3d364 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:56.917189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a7356df-6edc-4123-9408-a37f49d3d364 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:56.950738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0a7356df-6edc-4123-9408-a37f49d3d364 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049610 Jul 28 20:15:56.951210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 653/1464] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:57.211783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-95bfe055-3ec8-44cc-85b7-b762ab923a8c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:57.212315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-95bfe055-3ec8-44cc-85b7-b762ab923a8c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:57.218996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95bfe055-3ec8-44cc-85b7-b762ab923a8c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:57.219436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95bfe055-3ec8-44cc-85b7-b762ab923a8c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:57.220185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95bfe055-3ec8-44cc-85b7-b762ab923a8c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:57.220667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95bfe055-3ec8-44cc-85b7-b762ab923a8c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:57.288352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-95bfe055-3ec8-44cc-85b7-b762ab923a8c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:57.295877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-95bfe055-3ec8-44cc-85b7-b762ab923a8c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087998 Jul 28 20:15:57.296430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 812/1465] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:57.964013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-954ba8d1-a431-4b13-a368-97410dc960ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:57.966175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-954ba8d1-a431-4b13-a368-97410dc960ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:57.972640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-954ba8d1-a431-4b13-a368-97410dc960ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:57.973090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-954ba8d1-a431-4b13-a368-97410dc960ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:57.973837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-954ba8d1-a431-4b13-a368-97410dc960ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:57.974264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-954ba8d1-a431-4b13-a368-97410dc960ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:58.002398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-954ba8d1-a431-4b13-a368-97410dc960ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042601 Jul 28 20:15:58.002970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 654/1466] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:58.318043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-28b89769-20e6-4c00-8575-4fb0cb369785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:58.318600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-28b89769-20e6-4c00-8575-4fb0cb369785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:58.325042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b89769-20e6-4c00-8575-4fb0cb369785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:58.325489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b89769-20e6-4c00-8575-4fb0cb369785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:58.326242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b89769-20e6-4c00-8575-4fb0cb369785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:58.326672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b89769-20e6-4c00-8575-4fb0cb369785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:58.391036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-28b89769-20e6-4c00-8575-4fb0cb369785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:58.398696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-28b89769-20e6-4c00-8575-4fb0cb369785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085179 Jul 28 20:15:58.399255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 813/1467] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:58 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:15:59.015125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e595794-7629-44e1-a446-4341e828bd73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:59.017266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9e595794-7629-44e1-a446-4341e828bd73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:59.024242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e595794-7629-44e1-a446-4341e828bd73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:59.024729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e595794-7629-44e1-a446-4341e828bd73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:59.027400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e595794-7629-44e1-a446-4341e828bd73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:59.027843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e595794-7629-44e1-a446-4341e828bd73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:59.058071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e595794-7629-44e1-a446-4341e828bd73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046820 Jul 28 20:15:59.058612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 655/1468] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:15:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:15:59.419983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ba352525-1ec4-467f-b4f4-73d0e6605f76 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:15:59.420664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ba352525-1ec4-467f-b4f4-73d0e6605f76 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:15:59.427272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba352525-1ec4-467f-b4f4-73d0e6605f76 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:59.427709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba352525-1ec4-467f-b4f4-73d0e6605f76 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:59.428460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba352525-1ec4-467f-b4f4-73d0e6605f76 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:15:59.428928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba352525-1ec4-467f-b4f4-73d0e6605f76 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:15:59.490932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ba352525-1ec4-467f-b4f4-73d0e6605f76 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:15:59.498430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ba352525-1ec4-467f-b4f4-73d0e6605f76 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082335 Jul 28 20:15:59.498973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 814/1469] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:15:59 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:00.070453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d2560e69-7d10-4281-8192-2674210829fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:00.072619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d2560e69-7d10-4281-8192-2674210829fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:00.079068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2560e69-7d10-4281-8192-2674210829fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:00.079514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2560e69-7d10-4281-8192-2674210829fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:00.080269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2560e69-7d10-4281-8192-2674210829fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:00.080732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2560e69-7d10-4281-8192-2674210829fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:00.109455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d2560e69-7d10-4281-8192-2674210829fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 Jul 28 20:16:00.109992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 656/1470] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:00.520415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cd704f4b-9b3b-4131-a80e-eca883a21969 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:00.520993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cd704f4b-9b3b-4131-a80e-eca883a21969 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:00.527325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd704f4b-9b3b-4131-a80e-eca883a21969 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:00.527764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd704f4b-9b3b-4131-a80e-eca883a21969 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:00.528516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd704f4b-9b3b-4131-a80e-eca883a21969 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:00.528967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd704f4b-9b3b-4131-a80e-eca883a21969 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:00.588792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cd704f4b-9b3b-4131-a80e-eca883a21969 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:00.596127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cd704f4b-9b3b-4131-a80e-eca883a21969 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080391 Jul 28 20:16:00.596709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 815/1471] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:00 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:01.123095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-593a8624-9bf2-43f7-a6cb-2ecad652694f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:01.125277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-593a8624-9bf2-43f7-a6cb-2ecad652694f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:01.131924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-593a8624-9bf2-43f7-a6cb-2ecad652694f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:01.132392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-593a8624-9bf2-43f7-a6cb-2ecad652694f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:01.133176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-593a8624-9bf2-43f7-a6cb-2ecad652694f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:01.133609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-593a8624-9bf2-43f7-a6cb-2ecad652694f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:01.162409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-593a8624-9bf2-43f7-a6cb-2ecad652694f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043420 Jul 28 20:16:01.162976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 657/1472] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:01.617415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-57f1a66e-2a3f-47a3-bafe-d682405abfc6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:01.618141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-57f1a66e-2a3f-47a3-bafe-d682405abfc6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:01.624867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57f1a66e-2a3f-47a3-bafe-d682405abfc6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:01.625317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57f1a66e-2a3f-47a3-bafe-d682405abfc6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:01.626074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57f1a66e-2a3f-47a3-bafe-d682405abfc6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:01.626505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57f1a66e-2a3f-47a3-bafe-d682405abfc6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:01.689092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-57f1a66e-2a3f-47a3-bafe-d682405abfc6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:01.697185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-57f1a66e-2a3f-47a3-bafe-d682405abfc6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083813 Jul 28 20:16:01.697742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 816/1473] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:02.174582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ff7fd733-7303-4ec9-a88f-6e50eff0c21d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:02.177300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ff7fd733-7303-4ec9-a88f-6e50eff0c21d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:02.183684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff7fd733-7303-4ec9-a88f-6e50eff0c21d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:02.184131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff7fd733-7303-4ec9-a88f-6e50eff0c21d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:02.184938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff7fd733-7303-4ec9-a88f-6e50eff0c21d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:02.185372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff7fd733-7303-4ec9-a88f-6e50eff0c21d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:02.214264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ff7fd733-7303-4ec9-a88f-6e50eff0c21d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Jul 28 20:16:02.214834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 658/1474] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:02 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:02.718363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-321c9cd7-35b3-4708-ab8f-e9ef20b7d387 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:02.718966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-321c9cd7-35b3-4708-ab8f-e9ef20b7d387 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:02.725885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-321c9cd7-35b3-4708-ab8f-e9ef20b7d387 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:02.726322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-321c9cd7-35b3-4708-ab8f-e9ef20b7d387 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:02.727062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-321c9cd7-35b3-4708-ab8f-e9ef20b7d387 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:02.727488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-321c9cd7-35b3-4708-ab8f-e9ef20b7d387 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:02.795090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-321c9cd7-35b3-4708-ab8f-e9ef20b7d387 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:02.803044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-321c9cd7-35b3-4708-ab8f-e9ef20b7d387 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.088520 Jul 28 20:16:02.803626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 817/1475] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:03.226744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cb1561ab-2500-4b8a-9563-4fe5468670ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:03.228945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cb1561ab-2500-4b8a-9563-4fe5468670ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:03.236725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1561ab-2500-4b8a-9563-4fe5468670ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:03.237172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1561ab-2500-4b8a-9563-4fe5468670ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:03.237933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1561ab-2500-4b8a-9563-4fe5468670ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:03.238365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1561ab-2500-4b8a-9563-4fe5468670ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:03.268027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cb1561ab-2500-4b8a-9563-4fe5468670ed tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Jul 28 20:16:03.273136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 659/1476] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:03.823721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2c63321d-7ae3-4e33-9837-00f76fc1b6e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:03.824331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2c63321d-7ae3-4e33-9837-00f76fc1b6e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:03.830787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c63321d-7ae3-4e33-9837-00f76fc1b6e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:03.831242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c63321d-7ae3-4e33-9837-00f76fc1b6e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:03.831980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c63321d-7ae3-4e33-9837-00f76fc1b6e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:03.832416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c63321d-7ae3-4e33-9837-00f76fc1b6e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:03.894148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2c63321d-7ae3-4e33-9837-00f76fc1b6e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:03.902371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2c63321d-7ae3-4e33-9837-00f76fc1b6e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082535 Jul 28 20:16:03.902930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 818/1477] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:03 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:04.280565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-41f44187-d2f5-45fe-b085-474fe7c0c573 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:04.283002 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-41f44187-d2f5-45fe-b085-474fe7c0c573 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:04.290512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41f44187-d2f5-45fe-b085-474fe7c0c573 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:04.290958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41f44187-d2f5-45fe-b085-474fe7c0c573 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:04.291713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41f44187-d2f5-45fe-b085-474fe7c0c573 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:04.292143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41f44187-d2f5-45fe-b085-474fe7c0c573 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:04.320228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-41f44187-d2f5-45fe-b085-474fe7c0c573 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Jul 28 20:16:04.320806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 660/1478] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:04.923602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eb4e6e89-7e72-45ee-81c0-be3f2c9bdbd5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:04.924202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eb4e6e89-7e72-45ee-81c0-be3f2c9bdbd5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:04.931253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb4e6e89-7e72-45ee-81c0-be3f2c9bdbd5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:04.931689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb4e6e89-7e72-45ee-81c0-be3f2c9bdbd5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:04.932430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb4e6e89-7e72-45ee-81c0-be3f2c9bdbd5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:04.932885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb4e6e89-7e72-45ee-81c0-be3f2c9bdbd5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:04.993547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eb4e6e89-7e72-45ee-81c0-be3f2c9bdbd5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:05.000999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eb4e6e89-7e72-45ee-81c0-be3f2c9bdbd5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081191 Jul 28 20:16:05.001546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 819/1479] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:04 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:05.331733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e9bb4c7a-1ff1-4109-93c0-e535fc4f1fa9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:05.334387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e9bb4c7a-1ff1-4109-93c0-e535fc4f1fa9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:05.340939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9bb4c7a-1ff1-4109-93c0-e535fc4f1fa9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:05.341385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9bb4c7a-1ff1-4109-93c0-e535fc4f1fa9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:05.342140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9bb4c7a-1ff1-4109-93c0-e535fc4f1fa9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:05.344497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9bb4c7a-1ff1-4109-93c0-e535fc4f1fa9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:05.374922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e9bb4c7a-1ff1-4109-93c0-e535fc4f1fa9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Jul 28 20:16:05.375427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 661/1480] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:06.022187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5154af4d-ee8e-4bcf-b844-03a278077acd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:06.022814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5154af4d-ee8e-4bcf-b844-03a278077acd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:06.029235 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5154af4d-ee8e-4bcf-b844-03a278077acd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:06.029678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5154af4d-ee8e-4bcf-b844-03a278077acd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:06.030422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5154af4d-ee8e-4bcf-b844-03a278077acd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:06.030848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5154af4d-ee8e-4bcf-b844-03a278077acd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:06.092010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5154af4d-ee8e-4bcf-b844-03a278077acd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:06.100014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5154af4d-ee8e-4bcf-b844-03a278077acd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081743 Jul 28 20:16:06.100600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 820/1481] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:06 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:06.388055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-75466bb7-ae47-44a7-ad27-484ff70b6e80 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:06.390229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-75466bb7-ae47-44a7-ad27-484ff70b6e80 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:06.397885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75466bb7-ae47-44a7-ad27-484ff70b6e80 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:06.398330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75466bb7-ae47-44a7-ad27-484ff70b6e80 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:06.399088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75466bb7-ae47-44a7-ad27-484ff70b6e80 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:06.399521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75466bb7-ae47-44a7-ad27-484ff70b6e80 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:06.429492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-75466bb7-ae47-44a7-ad27-484ff70b6e80 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045467 Jul 28 20:16:06.430039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 662/1482] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:07.120610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4cdcf81b-2f36-4461-ac25-d801a0e4db84 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:07.121223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4cdcf81b-2f36-4461-ac25-d801a0e4db84 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:07.128175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4cdcf81b-2f36-4461-ac25-d801a0e4db84 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:07.128659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4cdcf81b-2f36-4461-ac25-d801a0e4db84 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:07.130127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4cdcf81b-2f36-4461-ac25-d801a0e4db84 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:07.130583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4cdcf81b-2f36-4461-ac25-d801a0e4db84 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:07.195494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4cdcf81b-2f36-4461-ac25-d801a0e4db84 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:07.203246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4cdcf81b-2f36-4461-ac25-d801a0e4db84 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086222 Jul 28 20:16:07.203800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 821/1483] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:07 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:07.442505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2aac99ab-9524-43b8-b654-46370825788a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:07.444749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2aac99ab-9524-43b8-b654-46370825788a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:07.451279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2aac99ab-9524-43b8-b654-46370825788a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:07.451727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2aac99ab-9524-43b8-b654-46370825788a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:07.452490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2aac99ab-9524-43b8-b654-46370825788a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:07.453014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2aac99ab-9524-43b8-b654-46370825788a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:07.469782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:07.483786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2aac99ab-9524-43b8-b654-46370825788a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045984 Jul 28 20:16:07.484342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 663/1484] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:16:08.223828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b96f4ad2-3800-4c4b-9cd6-1a8b08e6e168 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:08.224624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b96f4ad2-3800-4c4b-9cd6-1a8b08e6e168 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:08.230995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b96f4ad2-3800-4c4b-9cd6-1a8b08e6e168 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:08.231435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b96f4ad2-3800-4c4b-9cd6-1a8b08e6e168 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:08.232179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b96f4ad2-3800-4c4b-9cd6-1a8b08e6e168 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:08.232632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b96f4ad2-3800-4c4b-9cd6-1a8b08e6e168 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:08.292937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b96f4ad2-3800-4c4b-9cd6-1a8b08e6e168 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:08.300637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b96f4ad2-3800-4c4b-9cd6-1a8b08e6e168 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081280 Jul 28 20:16:08.301624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 822/1485] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:08 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:08.495613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5bd347ab-19bd-4c4c-b816-90dc454ebd8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:08.497824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5bd347ab-19bd-4c4c-b816-90dc454ebd8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:08.504798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bd347ab-19bd-4c4c-b816-90dc454ebd8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:08.505246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bd347ab-19bd-4c4c-b816-90dc454ebd8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:08.505998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bd347ab-19bd-4c4c-b816-90dc454ebd8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:08.506424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bd347ab-19bd-4c4c-b816-90dc454ebd8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:08.535148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5bd347ab-19bd-4c4c-b816-90dc454ebd8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Jul 28 20:16:08.535853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 664/1486] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:09.321765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a68eeb88-c868-4190-9c31-fb205f4fb05e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:09.322380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a68eeb88-c868-4190-9c31-fb205f4fb05e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:09.329795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a68eeb88-c868-4190-9c31-fb205f4fb05e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:09.330246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a68eeb88-c868-4190-9c31-fb205f4fb05e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:09.331005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a68eeb88-c868-4190-9c31-fb205f4fb05e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:09.331440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a68eeb88-c868-4190-9c31-fb205f4fb05e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:09.393538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a68eeb88-c868-4190-9c31-fb205f4fb05e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:09.401492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a68eeb88-c868-4190-9c31-fb205f4fb05e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083745 Jul 28 20:16:09.402045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 823/1487] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:09 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:09.547495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2e881d6c-44f4-4d17-84f7-8be390fe5aad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:09.549596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2e881d6c-44f4-4d17-84f7-8be390fe5aad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:09.556037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2e881d6c-44f4-4d17-84f7-8be390fe5aad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:09.556476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2e881d6c-44f4-4d17-84f7-8be390fe5aad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:09.557255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2e881d6c-44f4-4d17-84f7-8be390fe5aad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:09.557684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2e881d6c-44f4-4d17-84f7-8be390fe5aad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:09.586776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2e881d6c-44f4-4d17-84f7-8be390fe5aad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043301 Jul 28 20:16:09.587314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 665/1488] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:09 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:10.423311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-50232f6a-04c4-47e0-b626-5b7a107e32c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:10.423928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-50232f6a-04c4-47e0-b626-5b7a107e32c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:10.431181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50232f6a-04c4-47e0-b626-5b7a107e32c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:10.431621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50232f6a-04c4-47e0-b626-5b7a107e32c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:10.432370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50232f6a-04c4-47e0-b626-5b7a107e32c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:10.432848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50232f6a-04c4-47e0-b626-5b7a107e32c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:10.493642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-50232f6a-04c4-47e0-b626-5b7a107e32c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:10.500995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-50232f6a-04c4-47e0-b626-5b7a107e32c2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081495 Jul 28 20:16:10.501548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 824/1489] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:10 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:10.599425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c4aacdad-87e9-4dc2-84ce-b9b049190820 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:10.601637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c4aacdad-87e9-4dc2-84ce-b9b049190820 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:10.607992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4aacdad-87e9-4dc2-84ce-b9b049190820 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:10.608442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4aacdad-87e9-4dc2-84ce-b9b049190820 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:10.609234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4aacdad-87e9-4dc2-84ce-b9b049190820 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:10.609668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4aacdad-87e9-4dc2-84ce-b9b049190820 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:10.638524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c4aacdad-87e9-4dc2-84ce-b9b049190820 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Jul 28 20:16:10.639069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 666/1490] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:16:11.522247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-da84cfbc-6c1d-4d5c-92f0-2db6b7a363f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:11.522780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-da84cfbc-6c1d-4d5c-92f0-2db6b7a363f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:11.529233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da84cfbc-6c1d-4d5c-92f0-2db6b7a363f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:11.529679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da84cfbc-6c1d-4d5c-92f0-2db6b7a363f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:11.530428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da84cfbc-6c1d-4d5c-92f0-2db6b7a363f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:11.530854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da84cfbc-6c1d-4d5c-92f0-2db6b7a363f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:11.595756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-da84cfbc-6c1d-4d5c-92f0-2db6b7a363f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:11.604105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-da84cfbc-6c1d-4d5c-92f0-2db6b7a363f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086246 Jul 28 20:16:11.604686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 825/1491] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:11 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:11.651273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1eee191f-bce7-44cc-a601-a80adb6dfb0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:11.653463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1eee191f-bce7-44cc-a601-a80adb6dfb0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:11.660145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1eee191f-bce7-44cc-a601-a80adb6dfb0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:11.661292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1eee191f-bce7-44cc-a601-a80adb6dfb0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:11.662063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1eee191f-bce7-44cc-a601-a80adb6dfb0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:11.662503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1eee191f-bce7-44cc-a601-a80adb6dfb0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:11.691385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1eee191f-bce7-44cc-a601-a80adb6dfb0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043970 Jul 28 20:16:11.692011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 667/1492] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:12.625295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-67738f2c-5ec9-4ef9-b4cd-469880f2146b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:12.625904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-67738f2c-5ec9-4ef9-b4cd-469880f2146b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:12.632619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67738f2c-5ec9-4ef9-b4cd-469880f2146b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:12.633087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67738f2c-5ec9-4ef9-b4cd-469880f2146b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:12.633818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67738f2c-5ec9-4ef9-b4cd-469880f2146b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:12.634246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67738f2c-5ec9-4ef9-b4cd-469880f2146b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:12.652426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:12.695941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-67738f2c-5ec9-4ef9-b4cd-469880f2146b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:12.703308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a1db1caf-6251-4967-a90a-9f86d6cd5257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:12.703789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-67738f2c-5ec9-4ef9-b4cd-469880f2146b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082015 Jul 28 20:16:12.704053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 826/1493] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:12 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:12.705522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a1db1caf-6251-4967-a90a-9f86d6cd5257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:12.712819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1db1caf-6251-4967-a90a-9f86d6cd5257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:12.713270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1db1caf-6251-4967-a90a-9f86d6cd5257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:12.714038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1db1caf-6251-4967-a90a-9f86d6cd5257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:12.714466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1db1caf-6251-4967-a90a-9f86d6cd5257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:12.743456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a1db1caf-6251-4967-a90a-9f86d6cd5257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044147 Jul 28 20:16:12.744003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 668/1494] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:16:13.724918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-444c943f-33f7-4451-ac17-9c1918d9a443 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:13.725468 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-444c943f-33f7-4451-ac17-9c1918d9a443 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:13.731808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-444c943f-33f7-4451-ac17-9c1918d9a443 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:13.732248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-444c943f-33f7-4451-ac17-9c1918d9a443 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:13.733012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-444c943f-33f7-4451-ac17-9c1918d9a443 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:13.733437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-444c943f-33f7-4451-ac17-9c1918d9a443 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:13.755822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-92ca15ed-bbdc-4a12-baf6-305e6c73e14c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:13.758090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-92ca15ed-bbdc-4a12-baf6-305e6c73e14c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:13.764647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92ca15ed-bbdc-4a12-baf6-305e6c73e14c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:13.765095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92ca15ed-bbdc-4a12-baf6-305e6c73e14c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:13.765860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92ca15ed-bbdc-4a12-baf6-305e6c73e14c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:13.766294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92ca15ed-bbdc-4a12-baf6-305e6c73e14c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:13.794880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-444c943f-33f7-4451-ac17-9c1918d9a443 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:13.796652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-92ca15ed-bbdc-4a12-baf6-305e6c73e14c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Jul 28 20:16:13.797256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 669/1495] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:16:13.803077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-444c943f-33f7-4451-ac17-9c1918d9a443 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082712 Jul 28 20:16:13.803624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 827/1496] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:13 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:14.808919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5c1f3dc2-d16f-4973-98f6-83377b237095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:14.811078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5c1f3dc2-d16f-4973-98f6-83377b237095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:14.813361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=58 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:14.819725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c1f3dc2-d16f-4973-98f6-83377b237095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:14.820177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c1f3dc2-d16f-4973-98f6-83377b237095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:14.821047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c1f3dc2-d16f-4973-98f6-83377b237095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:14.821484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c1f3dc2-d16f-4973-98f6-83377b237095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:14.824441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dad57a41-68d2-42b1-8d53-ea3000ef7045 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:14.825096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dad57a41-68d2-42b1-8d53-ea3000ef7045 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:14.827478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=56 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:14.832847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dad57a41-68d2-42b1-8d53-ea3000ef7045 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:14.833292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dad57a41-68d2-42b1-8d53-ea3000ef7045 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:14.834056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dad57a41-68d2-42b1-8d53-ea3000ef7045 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:14.834487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dad57a41-68d2-42b1-8d53-ea3000ef7045 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:14.852750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5c1f3dc2-d16f-4973-98f6-83377b237095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047732 Jul 28 20:16:14.853339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 670/1497] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:14.897628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dad57a41-68d2-42b1-8d53-ea3000ef7045 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:14.905140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dad57a41-68d2-42b1-8d53-ea3000ef7045 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084891 Jul 28 20:16:14.905697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 828/1498] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:16:15.864436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e07a6548-243e-425b-8c5b-1395b2e6cabd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:15.866620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e07a6548-243e-425b-8c5b-1395b2e6cabd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:15.873561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e07a6548-243e-425b-8c5b-1395b2e6cabd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:15.874007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e07a6548-243e-425b-8c5b-1395b2e6cabd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:15.874756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e07a6548-243e-425b-8c5b-1395b2e6cabd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:15.875184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e07a6548-243e-425b-8c5b-1395b2e6cabd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:15.909357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e07a6548-243e-425b-8c5b-1395b2e6cabd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048869 Jul 28 20:16:15.909906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 671/1499] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:15.926029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f5ddadd1-2352-40fc-9e59-f289b2380f75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:15.926633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f5ddadd1-2352-40fc-9e59-f289b2380f75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:15.933515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5ddadd1-2352-40fc-9e59-f289b2380f75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:15.933958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5ddadd1-2352-40fc-9e59-f289b2380f75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:15.934705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5ddadd1-2352-40fc-9e59-f289b2380f75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:15.935131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5ddadd1-2352-40fc-9e59-f289b2380f75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:16.000424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f5ddadd1-2352-40fc-9e59-f289b2380f75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:16.008413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f5ddadd1-2352-40fc-9e59-f289b2380f75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086153 Jul 28 20:16:16.009001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 829/1500] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:15 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:16.921874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b524b6a-bdf8-4553-a0e5-31cf07966c5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:16.924067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b524b6a-bdf8-4553-a0e5-31cf07966c5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:16.931074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b524b6a-bdf8-4553-a0e5-31cf07966c5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:16.931525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b524b6a-bdf8-4553-a0e5-31cf07966c5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:16.932276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b524b6a-bdf8-4553-a0e5-31cf07966c5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:16.932741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b524b6a-bdf8-4553-a0e5-31cf07966c5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:16.961610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b524b6a-bdf8-4553-a0e5-31cf07966c5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043757 Jul 28 20:16:16.962148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 672/1501] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:17.029590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-693cef95-a6e2-4dfe-a22d-23082a305df0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:17.030325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-693cef95-a6e2-4dfe-a22d-23082a305df0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:17.037620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-693cef95-a6e2-4dfe-a22d-23082a305df0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:17.038058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-693cef95-a6e2-4dfe-a22d-23082a305df0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:17.038803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-693cef95-a6e2-4dfe-a22d-23082a305df0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:17.039226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-693cef95-a6e2-4dfe-a22d-23082a305df0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:17.097968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-693cef95-a6e2-4dfe-a22d-23082a305df0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:17.106287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-693cef95-a6e2-4dfe-a22d-23082a305df0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080834 Jul 28 20:16:17.106836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 830/1502] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:17 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:17.974885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6af19b8e-d801-42a7-900f-cf8cd16fbb0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:17.977339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6af19b8e-d801-42a7-900f-cf8cd16fbb0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:17.984125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6af19b8e-d801-42a7-900f-cf8cd16fbb0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:17.984605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6af19b8e-d801-42a7-900f-cf8cd16fbb0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:17.985379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6af19b8e-d801-42a7-900f-cf8cd16fbb0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:17.985817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6af19b8e-d801-42a7-900f-cf8cd16fbb0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:18.015178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6af19b8e-d801-42a7-900f-cf8cd16fbb0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Jul 28 20:16:18.015718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 673/1503] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:18.126331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c6fb5ccf-c450-4c93-a81c-1836d6d85004 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:18.126939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c6fb5ccf-c450-4c93-a81c-1836d6d85004 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:18.134050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6fb5ccf-c450-4c93-a81c-1836d6d85004 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:18.134491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6fb5ccf-c450-4c93-a81c-1836d6d85004 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:18.135244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6fb5ccf-c450-4c93-a81c-1836d6d85004 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:18.135672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6fb5ccf-c450-4c93-a81c-1836d6d85004 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:18.201750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c6fb5ccf-c450-4c93-a81c-1836d6d85004 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:18.210017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c6fb5ccf-c450-4c93-a81c-1836d6d85004 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087383 Jul 28 20:16:18.210597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 831/1504] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:18 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:19.028534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4bd64c67-e3c8-4959-bfce-ecefaaba6c1d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:19.030742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4bd64c67-e3c8-4959-bfce-ecefaaba6c1d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:19.037578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bd64c67-e3c8-4959-bfce-ecefaaba6c1d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:19.038030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bd64c67-e3c8-4959-bfce-ecefaaba6c1d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:19.038791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bd64c67-e3c8-4959-bfce-ecefaaba6c1d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:19.039229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4bd64c67-e3c8-4959-bfce-ecefaaba6c1d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:19.068782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4bd64c67-e3c8-4959-bfce-ecefaaba6c1d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Jul 28 20:16:19.069329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 674/1505] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:19.230819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3d61a9b7-6189-400a-a48a-08362f798d45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:19.231451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3d61a9b7-6189-400a-a48a-08362f798d45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:19.238115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d61a9b7-6189-400a-a48a-08362f798d45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:19.238564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d61a9b7-6189-400a-a48a-08362f798d45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:19.239325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d61a9b7-6189-400a-a48a-08362f798d45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:19.240301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d61a9b7-6189-400a-a48a-08362f798d45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:19.300756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3d61a9b7-6189-400a-a48a-08362f798d45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:19.310123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3d61a9b7-6189-400a-a48a-08362f798d45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083208 Jul 28 20:16:19.310700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 832/1506] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:19 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:20.081059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f43d8ec1-d9d6-4680-9c8e-883cf096dbd6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:20.083184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f43d8ec1-d9d6-4680-9c8e-883cf096dbd6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:20.090127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43d8ec1-d9d6-4680-9c8e-883cf096dbd6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:20.090568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43d8ec1-d9d6-4680-9c8e-883cf096dbd6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:20.091320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43d8ec1-d9d6-4680-9c8e-883cf096dbd6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:20.091754 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43d8ec1-d9d6-4680-9c8e-883cf096dbd6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:20.120677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f43d8ec1-d9d6-4680-9c8e-883cf096dbd6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043605 Jul 28 20:16:20.121216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 675/1507] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:20.331040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ae045d7f-806d-4556-bd64-793d27d7244c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:20.331700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ae045d7f-806d-4556-bd64-793d27d7244c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:20.338958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae045d7f-806d-4556-bd64-793d27d7244c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:20.339403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae045d7f-806d-4556-bd64-793d27d7244c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:20.340147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae045d7f-806d-4556-bd64-793d27d7244c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:20.340602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae045d7f-806d-4556-bd64-793d27d7244c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:20.403914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ae045d7f-806d-4556-bd64-793d27d7244c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:20.411593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ae045d7f-806d-4556-bd64-793d27d7244c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084425 Jul 28 20:16:20.412489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 833/1508] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:20 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:21.132508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-21bab9d6-7168-4735-98cd-91d9e04468ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:21.134671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-21bab9d6-7168-4735-98cd-91d9e04468ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:21.141302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21bab9d6-7168-4735-98cd-91d9e04468ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:21.141752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21bab9d6-7168-4735-98cd-91d9e04468ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:21.142503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21bab9d6-7168-4735-98cd-91d9e04468ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:21.142931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21bab9d6-7168-4735-98cd-91d9e04468ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:21.172688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-21bab9d6-7168-4735-98cd-91d9e04468ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Jul 28 20:16:21.173241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 676/1509] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:21.432937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b307957b-9ab7-43ef-964d-083464b83d94 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:21.433526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b307957b-9ab7-43ef-964d-083464b83d94 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:21.440037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b307957b-9ab7-43ef-964d-083464b83d94 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:21.440483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b307957b-9ab7-43ef-964d-083464b83d94 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:21.441272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b307957b-9ab7-43ef-964d-083464b83d94 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:21.441706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b307957b-9ab7-43ef-964d-083464b83d94 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:21.503426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b307957b-9ab7-43ef-964d-083464b83d94 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:21.511206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b307957b-9ab7-43ef-964d-083464b83d94 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082306 Jul 28 20:16:21.511762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 834/1510] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:21 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:22.185069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-723e1f66-c1c9-4e97-993c-27cd1d1e513a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:22.187241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-723e1f66-c1c9-4e97-993c-27cd1d1e513a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:22.194740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-723e1f66-c1c9-4e97-993c-27cd1d1e513a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:22.195186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-723e1f66-c1c9-4e97-993c-27cd1d1e513a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:22.195943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-723e1f66-c1c9-4e97-993c-27cd1d1e513a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:22.196373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-723e1f66-c1c9-4e97-993c-27cd1d1e513a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:22.225821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-723e1f66-c1c9-4e97-993c-27cd1d1e513a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Jul 28 20:16:22.226382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 677/1511] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:22 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:22.532848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-178c9372-73d6-4099-98f4-2e65b4dfd73b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:22.533407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-178c9372-73d6-4099-98f4-2e65b4dfd73b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:22.540382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-178c9372-73d6-4099-98f4-2e65b4dfd73b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:22.540843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-178c9372-73d6-4099-98f4-2e65b4dfd73b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:22.541587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-178c9372-73d6-4099-98f4-2e65b4dfd73b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:22.542013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-178c9372-73d6-4099-98f4-2e65b4dfd73b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:22.602045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-178c9372-73d6-4099-98f4-2e65b4dfd73b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:22.609372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-178c9372-73d6-4099-98f4-2e65b4dfd73b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080789 Jul 28 20:16:22.609924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 835/1512] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:22 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:23.238106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-79192b79-9985-4718-9805-3a986c5d4755 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:23.240407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-79192b79-9985-4718-9805-3a986c5d4755 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:23.246917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79192b79-9985-4718-9805-3a986c5d4755 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:23.247368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79192b79-9985-4718-9805-3a986c5d4755 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:23.248126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79192b79-9985-4718-9805-3a986c5d4755 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:23.248577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79192b79-9985-4718-9805-3a986c5d4755 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:23.277888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-79192b79-9985-4718-9805-3a986c5d4755 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043771 Jul 28 20:16:23.278424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 678/1513] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:23.631549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7bde079f-633a-4126-980d-b92e4f53e9ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:23.632171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7bde079f-633a-4126-980d-b92e4f53e9ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:23.638757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bde079f-633a-4126-980d-b92e4f53e9ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:23.639205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bde079f-633a-4126-980d-b92e4f53e9ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:23.639962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bde079f-633a-4126-980d-b92e4f53e9ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:23.640394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bde079f-633a-4126-980d-b92e4f53e9ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:23.705247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7bde079f-633a-4126-980d-b92e4f53e9ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:23.712934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7bde079f-633a-4126-980d-b92e4f53e9ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086390 Jul 28 20:16:23.713484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 836/1514] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:23 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:24.291043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ee875814-ef8a-4aa3-8505-5cddf3cdd1cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:24.293264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ee875814-ef8a-4aa3-8505-5cddf3cdd1cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:24.299680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee875814-ef8a-4aa3-8505-5cddf3cdd1cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:24.300134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee875814-ef8a-4aa3-8505-5cddf3cdd1cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:24.300923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee875814-ef8a-4aa3-8505-5cddf3cdd1cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:24.301364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee875814-ef8a-4aa3-8505-5cddf3cdd1cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:24.330221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ee875814-ef8a-4aa3-8505-5cddf3cdd1cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Jul 28 20:16:24.330763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 679/1515] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:16:24.733780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3b223723-941f-4a65-8560-e3fb92667830 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:24.734328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3b223723-941f-4a65-8560-e3fb92667830 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:24.740799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b223723-941f-4a65-8560-e3fb92667830 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:24.741249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b223723-941f-4a65-8560-e3fb92667830 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:24.742009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b223723-941f-4a65-8560-e3fb92667830 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:24.742446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b223723-941f-4a65-8560-e3fb92667830 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:24.806082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3b223723-941f-4a65-8560-e3fb92667830 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:24.813821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3b223723-941f-4a65-8560-e3fb92667830 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083937 Jul 28 20:16:24.814381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 837/1516] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:24 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:25.342592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-588f8486-df0c-4746-b251-daf4d7f71606 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:25.344806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-588f8486-df0c-4746-b251-daf4d7f71606 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:25.351298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-588f8486-df0c-4746-b251-daf4d7f71606 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:25.351740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-588f8486-df0c-4746-b251-daf4d7f71606 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:25.352491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-588f8486-df0c-4746-b251-daf4d7f71606 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:25.352947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-588f8486-df0c-4746-b251-daf4d7f71606 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:25.356512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:25.384048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-588f8486-df0c-4746-b251-daf4d7f71606 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045598 Jul 28 20:16:25.384642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 680/1517] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:25.835371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-82ab0843-2d93-452c-948e-02d61d89bd9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:25.835983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-82ab0843-2d93-452c-948e-02d61d89bd9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:25.842537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82ab0843-2d93-452c-948e-02d61d89bd9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:25.842985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82ab0843-2d93-452c-948e-02d61d89bd9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:25.843745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82ab0843-2d93-452c-948e-02d61d89bd9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:25.844180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82ab0843-2d93-452c-948e-02d61d89bd9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:25.905334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-82ab0843-2d93-452c-948e-02d61d89bd9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:25.913760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-82ab0843-2d93-452c-948e-02d61d89bd9c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082740 Jul 28 20:16:25.914316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 838/1518] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:25 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:26.396823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-78887037-df93-4b01-8aa9-7216478bf7eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:26.398766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-78887037-df93-4b01-8aa9-7216478bf7eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:26.405420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78887037-df93-4b01-8aa9-7216478bf7eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:26.405875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78887037-df93-4b01-8aa9-7216478bf7eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:26.406641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78887037-df93-4b01-8aa9-7216478bf7eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:26.407338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78887037-df93-4b01-8aa9-7216478bf7eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:26.436280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-78887037-df93-4b01-8aa9-7216478bf7eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Jul 28 20:16:26.436864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 681/1519] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:26.934339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-32833e5f-940c-4885-b30d-1e835a6c6ab1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:26.934959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-32833e5f-940c-4885-b30d-1e835a6c6ab1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:26.942313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32833e5f-940c-4885-b30d-1e835a6c6ab1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:26.943445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32833e5f-940c-4885-b30d-1e835a6c6ab1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:26.944218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32833e5f-940c-4885-b30d-1e835a6c6ab1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:26.944679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32833e5f-940c-4885-b30d-1e835a6c6ab1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:27.006757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-32833e5f-940c-4885-b30d-1e835a6c6ab1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:27.014252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-32833e5f-940c-4885-b30d-1e835a6c6ab1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083913 Jul 28 20:16:27.014811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 839/1520] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:26 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:27.449485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0f4009ea-e876-4873-a639-0902f80314b7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:27.451663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0f4009ea-e876-4873-a639-0902f80314b7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:27.458159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f4009ea-e876-4873-a639-0902f80314b7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:27.459059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f4009ea-e876-4873-a639-0902f80314b7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:27.459817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f4009ea-e876-4873-a639-0902f80314b7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:27.460251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f4009ea-e876-4873-a639-0902f80314b7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:27.488637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0f4009ea-e876-4873-a639-0902f80314b7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043107 Jul 28 20:16:27.489187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 682/1521] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:28.034883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc28f7a9-1194-4d7a-80f7-5748452a7e43 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:28.035474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc28f7a9-1194-4d7a-80f7-5748452a7e43 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:28.042892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc28f7a9-1194-4d7a-80f7-5748452a7e43 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:28.043339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc28f7a9-1194-4d7a-80f7-5748452a7e43 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:28.044093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc28f7a9-1194-4d7a-80f7-5748452a7e43 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:28.044526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc28f7a9-1194-4d7a-80f7-5748452a7e43 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:28.106053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cc28f7a9-1194-4d7a-80f7-5748452a7e43 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:28.113447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc28f7a9-1194-4d7a-80f7-5748452a7e43 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082794 Jul 28 20:16:28.114011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 840/1522] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:28 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:28.501097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-28500708-34a4-49f9-bad4-2718ae09588e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:28.503236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-28500708-34a4-49f9-bad4-2718ae09588e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:28.512078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28500708-34a4-49f9-bad4-2718ae09588e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:28.512604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28500708-34a4-49f9-bad4-2718ae09588e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:28.513382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28500708-34a4-49f9-bad4-2718ae09588e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:28.513821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28500708-34a4-49f9-bad4-2718ae09588e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:28.543927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-28500708-34a4-49f9-bad4-2718ae09588e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046813 Jul 28 20:16:28.544476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 683/1523] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:29.134673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6c434a06-3081-480c-a78d-74f92ee28575 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:29.135322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6c434a06-3081-480c-a78d-74f92ee28575 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:29.141861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c434a06-3081-480c-a78d-74f92ee28575 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:29.142313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c434a06-3081-480c-a78d-74f92ee28575 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:29.143069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c434a06-3081-480c-a78d-74f92ee28575 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:29.143499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c434a06-3081-480c-a78d-74f92ee28575 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:29.207236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6c434a06-3081-480c-a78d-74f92ee28575 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:29.215088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6c434a06-3081-480c-a78d-74f92ee28575 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084916 Jul 28 20:16:29.215643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 841/1524] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:29 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:29.558583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cf6b9c2a-203f-4023-beea-036e8e446bb0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:29.560730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cf6b9c2a-203f-4023-beea-036e8e446bb0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:29.567243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf6b9c2a-203f-4023-beea-036e8e446bb0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:29.568572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf6b9c2a-203f-4023-beea-036e8e446bb0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:29.569351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf6b9c2a-203f-4023-beea-036e8e446bb0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:29.569798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf6b9c2a-203f-4023-beea-036e8e446bb0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:29.598503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cf6b9c2a-203f-4023-beea-036e8e446bb0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046350 Jul 28 20:16:29.600027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 684/1525] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:29 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:30.235485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d90d7f83-007c-4201-867e-49f971d18d39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:30.236098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d90d7f83-007c-4201-867e-49f971d18d39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:30.242694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d90d7f83-007c-4201-867e-49f971d18d39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:30.243145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d90d7f83-007c-4201-867e-49f971d18d39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:30.243904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d90d7f83-007c-4201-867e-49f971d18d39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:30.244336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d90d7f83-007c-4201-867e-49f971d18d39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:30.308484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d90d7f83-007c-4201-867e-49f971d18d39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:30.316142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d90d7f83-007c-4201-867e-49f971d18d39 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084461 Jul 28 20:16:30.316741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 842/1526] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:30 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:30.611831 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dcddf7ab-5308-4102-a5fa-0d192d961257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:30.614045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dcddf7ab-5308-4102-a5fa-0d192d961257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:30.621134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcddf7ab-5308-4102-a5fa-0d192d961257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:30.621588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcddf7ab-5308-4102-a5fa-0d192d961257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:30.622350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcddf7ab-5308-4102-a5fa-0d192d961257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:30.622790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcddf7ab-5308-4102-a5fa-0d192d961257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:30.651766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dcddf7ab-5308-4102-a5fa-0d192d961257 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Jul 28 20:16:30.652310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 685/1527] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:31.337676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b8a70d67-e6ef-44ac-8656-5424e0f1527f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:31.338402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b8a70d67-e6ef-44ac-8656-5424e0f1527f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:31.345097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8a70d67-e6ef-44ac-8656-5424e0f1527f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:31.345543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8a70d67-e6ef-44ac-8656-5424e0f1527f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:31.346300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8a70d67-e6ef-44ac-8656-5424e0f1527f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:31.346729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8a70d67-e6ef-44ac-8656-5424e0f1527f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:31.351414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:31.407813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8a70d67-e6ef-44ac-8656-5424e0f1527f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:31.416167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b8a70d67-e6ef-44ac-8656-5424e0f1527f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082928 Jul 28 20:16:31.416665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 843/1528] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:31 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:31.664409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e34228cc-0ee2-48e6-a70e-18937da46325 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:31.666703 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e34228cc-0ee2-48e6-a70e-18937da46325 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:31.672835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34228cc-0ee2-48e6-a70e-18937da46325 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:31.673281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34228cc-0ee2-48e6-a70e-18937da46325 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:31.674035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34228cc-0ee2-48e6-a70e-18937da46325 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:31.674467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34228cc-0ee2-48e6-a70e-18937da46325 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:31.704394 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e34228cc-0ee2-48e6-a70e-18937da46325 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Jul 28 20:16:31.704971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 686/1529] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:32.437165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-710eebfd-8bae-43da-bb0b-5e5f34784162 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:32.437705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-710eebfd-8bae-43da-bb0b-5e5f34784162 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:32.444214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-710eebfd-8bae-43da-bb0b-5e5f34784162 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:32.444678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-710eebfd-8bae-43da-bb0b-5e5f34784162 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:32.445422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-710eebfd-8bae-43da-bb0b-5e5f34784162 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:32.445847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-710eebfd-8bae-43da-bb0b-5e5f34784162 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:32.506569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-710eebfd-8bae-43da-bb0b-5e5f34784162 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:32.514054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-710eebfd-8bae-43da-bb0b-5e5f34784162 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080853 Jul 28 20:16:32.514616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 844/1530] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:32 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:32.717114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fb01eb8a-cc56-4e73-b193-222e1335af8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:32.719203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fb01eb8a-cc56-4e73-b193-222e1335af8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:32.726833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb01eb8a-cc56-4e73-b193-222e1335af8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:32.727282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb01eb8a-cc56-4e73-b193-222e1335af8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:32.728043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb01eb8a-cc56-4e73-b193-222e1335af8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:32.728473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb01eb8a-cc56-4e73-b193-222e1335af8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:32.758920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fb01eb8a-cc56-4e73-b193-222e1335af8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045840 Jul 28 20:16:32.759464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 687/1531] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:33.535032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-09034f9b-0e80-4cde-88a8-9b3894fd47f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:33.535584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-09034f9b-0e80-4cde-88a8-9b3894fd47f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:33.542613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-09034f9b-0e80-4cde-88a8-9b3894fd47f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:33.543056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-09034f9b-0e80-4cde-88a8-9b3894fd47f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:33.543810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-09034f9b-0e80-4cde-88a8-9b3894fd47f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:33.544238 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-09034f9b-0e80-4cde-88a8-9b3894fd47f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:33.608144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-09034f9b-0e80-4cde-88a8-9b3894fd47f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:33.615699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-09034f9b-0e80-4cde-88a8-9b3894fd47f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084854 Jul 28 20:16:33.616248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 845/1532] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:33 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:33.772425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-41bd584f-1ff6-4da7-b0a5-354d9c5a6aae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:33.774636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-41bd584f-1ff6-4da7-b0a5-354d9c5a6aae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:33.781115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41bd584f-1ff6-4da7-b0a5-354d9c5a6aae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:33.781562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41bd584f-1ff6-4da7-b0a5-354d9c5a6aae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:33.782567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41bd584f-1ff6-4da7-b0a5-354d9c5a6aae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:33.782999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41bd584f-1ff6-4da7-b0a5-354d9c5a6aae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:33.811582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-41bd584f-1ff6-4da7-b0a5-354d9c5a6aae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Jul 28 20:16:33.812046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 688/1533] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:34.636411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6b514784-aa75-42c5-ba17-6a90f766fbc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:34.637068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6b514784-aa75-42c5-ba17-6a90f766fbc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:34.643539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b514784-aa75-42c5-ba17-6a90f766fbc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:34.643985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b514784-aa75-42c5-ba17-6a90f766fbc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:34.644770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b514784-aa75-42c5-ba17-6a90f766fbc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:34.645203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b514784-aa75-42c5-ba17-6a90f766fbc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:34.706585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6b514784-aa75-42c5-ba17-6a90f766fbc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:34.714188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6b514784-aa75-42c5-ba17-6a90f766fbc4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081766 Jul 28 20:16:34.714746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 846/1534] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:34 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:34.824085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-21458ff8-1084-4419-a41b-c0d535727ff6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:34.826240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-21458ff8-1084-4419-a41b-c0d535727ff6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:34.832681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21458ff8-1084-4419-a41b-c0d535727ff6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:34.833736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21458ff8-1084-4419-a41b-c0d535727ff6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:34.834521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21458ff8-1084-4419-a41b-c0d535727ff6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:34.834945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21458ff8-1084-4419-a41b-c0d535727ff6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:34.864526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-21458ff8-1084-4419-a41b-c0d535727ff6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Jul 28 20:16:34.865090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 689/1535] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:35.734455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-67fa3253-306d-4ca0-ace5-fb6fdcbd0694 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:35.735082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-67fa3253-306d-4ca0-ace5-fb6fdcbd0694 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:35.742131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67fa3253-306d-4ca0-ace5-fb6fdcbd0694 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:35.742574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67fa3253-306d-4ca0-ace5-fb6fdcbd0694 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:35.743322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67fa3253-306d-4ca0-ace5-fb6fdcbd0694 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:35.743748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67fa3253-306d-4ca0-ace5-fb6fdcbd0694 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:35.810964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-67fa3253-306d-4ca0-ace5-fb6fdcbd0694 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:35.819060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-67fa3253-306d-4ca0-ace5-fb6fdcbd0694 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.088512 Jul 28 20:16:35.819601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 847/1536] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:35 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:35.876815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c5bfb187-ecaa-45c4-9df3-95e7dccda6b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:35.878958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c5bfb187-ecaa-45c4-9df3-95e7dccda6b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:35.886079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5bfb187-ecaa-45c4-9df3-95e7dccda6b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:35.886529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5bfb187-ecaa-45c4-9df3-95e7dccda6b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:35.887393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5bfb187-ecaa-45c4-9df3-95e7dccda6b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:35.887833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5bfb187-ecaa-45c4-9df3-95e7dccda6b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:35.916518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c5bfb187-ecaa-45c4-9df3-95e7dccda6b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Jul 28 20:16:35.917099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 690/1537] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:36.839290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e47f592a-678a-4776-8f6d-86a92b8dc5f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:36.839901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e47f592a-678a-4776-8f6d-86a92b8dc5f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:36.846414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47f592a-678a-4776-8f6d-86a92b8dc5f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:36.846862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47f592a-678a-4776-8f6d-86a92b8dc5f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:36.847616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47f592a-678a-4776-8f6d-86a92b8dc5f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:36.848045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47f592a-678a-4776-8f6d-86a92b8dc5f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:36.909888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e47f592a-678a-4776-8f6d-86a92b8dc5f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:36.918152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e47f592a-678a-4776-8f6d-86a92b8dc5f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082683 Jul 28 20:16:36.918696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 848/1538] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:36 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:16:36.929668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cfd19be5-31d3-41c0-b36f-fd6131dff6e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:36.931881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cfd19be5-31d3-41c0-b36f-fd6131dff6e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:36.939003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfd19be5-31d3-41c0-b36f-fd6131dff6e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:36.939439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfd19be5-31d3-41c0-b36f-fd6131dff6e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:36.940256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfd19be5-31d3-41c0-b36f-fd6131dff6e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:36.940672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfd19be5-31d3-41c0-b36f-fd6131dff6e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:36.969249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cfd19be5-31d3-41c0-b36f-fd6131dff6e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044387 Jul 28 20:16:36.969788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 691/1539] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:37.939424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8c255d51-13a3-442d-8e09-b1ef3f9047ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:37.940052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8c255d51-13a3-442d-8e09-b1ef3f9047ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:37.947348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8c255d51-13a3-442d-8e09-b1ef3f9047ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:37.947783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8c255d51-13a3-442d-8e09-b1ef3f9047ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:37.948531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8c255d51-13a3-442d-8e09-b1ef3f9047ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:37.948984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8c255d51-13a3-442d-8e09-b1ef3f9047ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:37.982524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4ce6074c-b601-4d20-b01f-4b5302d08e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:37.984738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4ce6074c-b601-4d20-b01f-4b5302d08e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:37.991751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ce6074c-b601-4d20-b01f-4b5302d08e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:37.992194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ce6074c-b601-4d20-b01f-4b5302d08e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:37.992982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ce6074c-b601-4d20-b01f-4b5302d08e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:37.993413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4ce6074c-b601-4d20-b01f-4b5302d08e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:38.019528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8c255d51-13a3-442d-8e09-b1ef3f9047ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:38.023530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4ce6074c-b601-4d20-b01f-4b5302d08e23 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045278 Jul 28 20:16:38.024086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 692/1540] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:38.027388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8c255d51-13a3-442d-8e09-b1ef3f9047ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.091772 Jul 28 20:16:38.027938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 849/1541] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:37 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:39.035886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-54d2c41b-1c2b-453e-9634-fbe44c5ede8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:39.038051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-54d2c41b-1c2b-453e-9634-fbe44c5ede8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:39.044904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-54d2c41b-1c2b-453e-9634-fbe44c5ede8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:39.045352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-54d2c41b-1c2b-453e-9634-fbe44c5ede8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:39.046113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-54d2c41b-1c2b-453e-9634-fbe44c5ede8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:39.046545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-54d2c41b-1c2b-453e-9634-fbe44c5ede8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:39.047257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2c60eb1d-0fb1-4c04-8ff3-84b9525adb1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:39.047869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2c60eb1d-0fb1-4c04-8ff3-84b9525adb1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:39.054357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c60eb1d-0fb1-4c04-8ff3-84b9525adb1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:39.054801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c60eb1d-0fb1-4c04-8ff3-84b9525adb1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:39.055556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c60eb1d-0fb1-4c04-8ff3-84b9525adb1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:39.055987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c60eb1d-0fb1-4c04-8ff3-84b9525adb1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:39.075865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-54d2c41b-1c2b-453e-9634-fbe44c5ede8d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Jul 28 20:16:39.076421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 693/1542] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:39.117910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2c60eb1d-0fb1-4c04-8ff3-84b9525adb1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:39.125399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2c60eb1d-0fb1-4c04-8ff3-84b9525adb1c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082083 Jul 28 20:16:39.125894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 850/1543] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:39 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:16:40.088778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-648bc9b9-6e47-4c3c-8584-50bdb12a3f2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:40.091025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-648bc9b9-6e47-4c3c-8584-50bdb12a3f2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:40.097547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-648bc9b9-6e47-4c3c-8584-50bdb12a3f2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:40.097999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-648bc9b9-6e47-4c3c-8584-50bdb12a3f2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:40.099506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-648bc9b9-6e47-4c3c-8584-50bdb12a3f2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:40.099963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-648bc9b9-6e47-4c3c-8584-50bdb12a3f2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:40.127904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-648bc9b9-6e47-4c3c-8584-50bdb12a3f2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043099 Jul 28 20:16:40.128451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 694/1544] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:40.146943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7c20ed63-a4d4-4d8c-b5aa-6ed6ae14d322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:40.147563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7c20ed63-a4d4-4d8c-b5aa-6ed6ae14d322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:40.154094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c20ed63-a4d4-4d8c-b5aa-6ed6ae14d322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:40.154534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c20ed63-a4d4-4d8c-b5aa-6ed6ae14d322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:40.155286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c20ed63-a4d4-4d8c-b5aa-6ed6ae14d322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:40.155714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c20ed63-a4d4-4d8c-b5aa-6ed6ae14d322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:40.216774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7c20ed63-a4d4-4d8c-b5aa-6ed6ae14d322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:40.225011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7c20ed63-a4d4-4d8c-b5aa-6ed6ae14d322 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082388 Jul 28 20:16:40.225567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 851/1545] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:40 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:41.140216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0aa800f6-4a06-4a6a-8fb8-5b2339d3d3ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:41.142432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0aa800f6-4a06-4a6a-8fb8-5b2339d3d3ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:41.149025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0aa800f6-4a06-4a6a-8fb8-5b2339d3d3ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:41.149480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0aa800f6-4a06-4a6a-8fb8-5b2339d3d3ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:41.150249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0aa800f6-4a06-4a6a-8fb8-5b2339d3d3ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:41.150687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0aa800f6-4a06-4a6a-8fb8-5b2339d3d3ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:41.181525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0aa800f6-4a06-4a6a-8fb8-5b2339d3d3ab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Jul 28 20:16:41.182097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 695/1546] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:41.245887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8d2c7d00-a70f-4f53-968e-91524945a5d6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:41.246491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8d2c7d00-a70f-4f53-968e-91524945a5d6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:41.252954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d2c7d00-a70f-4f53-968e-91524945a5d6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:41.253387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d2c7d00-a70f-4f53-968e-91524945a5d6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:41.254131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d2c7d00-a70f-4f53-968e-91524945a5d6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:41.254554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8d2c7d00-a70f-4f53-968e-91524945a5d6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:41.314819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8d2c7d00-a70f-4f53-968e-91524945a5d6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:41.322550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8d2c7d00-a70f-4f53-968e-91524945a5d6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080454 Jul 28 20:16:41.323146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 852/1547] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:41 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:42.193845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a73d4c90-c99c-4cbc-b0fa-8c4cbb1b9c5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:42.196565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a73d4c90-c99c-4cbc-b0fa-8c4cbb1b9c5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:42.202940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a73d4c90-c99c-4cbc-b0fa-8c4cbb1b9c5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:42.203382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a73d4c90-c99c-4cbc-b0fa-8c4cbb1b9c5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:42.204127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a73d4c90-c99c-4cbc-b0fa-8c4cbb1b9c5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:42.204578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a73d4c90-c99c-4cbc-b0fa-8c4cbb1b9c5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:42.229296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:42.234532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a73d4c90-c99c-4cbc-b0fa-8c4cbb1b9c5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044702 Jul 28 20:16:42.235072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 696/1548] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:42.343245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-23ff2f8c-ee53-47b5-ad1c-8e195bb719cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:42.343847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-23ff2f8c-ee53-47b5-ad1c-8e195bb719cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:42.351054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23ff2f8c-ee53-47b5-ad1c-8e195bb719cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:42.351491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23ff2f8c-ee53-47b5-ad1c-8e195bb719cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:42.352237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23ff2f8c-ee53-47b5-ad1c-8e195bb719cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:42.352690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23ff2f8c-ee53-47b5-ad1c-8e195bb719cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:42.416069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-23ff2f8c-ee53-47b5-ad1c-8e195bb719cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:42.423537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-23ff2f8c-ee53-47b5-ad1c-8e195bb719cc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084088 Jul 28 20:16:42.424097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 853/1549] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:42 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:43.246961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-becd5010-97f6-41a5-b174-c9eb06574d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:43.249243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-becd5010-97f6-41a5-b174-c9eb06574d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:43.256506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-becd5010-97f6-41a5-b174-c9eb06574d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:43.256984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-becd5010-97f6-41a5-b174-c9eb06574d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:43.257757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-becd5010-97f6-41a5-b174-c9eb06574d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:43.258195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-becd5010-97f6-41a5-b174-c9eb06574d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:43.287079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-becd5010-97f6-41a5-b174-c9eb06574d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044170 Jul 28 20:16:43.287624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 697/1550] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:43.444806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-edd7f896-c85f-4b11-8f5b-55d810369ca9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:43.445342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-edd7f896-c85f-4b11-8f5b-55d810369ca9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:43.452070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edd7f896-c85f-4b11-8f5b-55d810369ca9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:43.452514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edd7f896-c85f-4b11-8f5b-55d810369ca9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:43.453411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edd7f896-c85f-4b11-8f5b-55d810369ca9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:43.453832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-edd7f896-c85f-4b11-8f5b-55d810369ca9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:43.514666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-edd7f896-c85f-4b11-8f5b-55d810369ca9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:43.522526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-edd7f896-c85f-4b11-8f5b-55d810369ca9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081863 Jul 28 20:16:43.523084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 854/1551] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:43 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:44.299422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dc76334f-2b47-4e14-9f06-590c631d8faf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:44.301738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dc76334f-2b47-4e14-9f06-590c631d8faf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:44.309017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc76334f-2b47-4e14-9f06-590c631d8faf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:44.309466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc76334f-2b47-4e14-9f06-590c631d8faf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:44.310251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc76334f-2b47-4e14-9f06-590c631d8faf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:44.310687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc76334f-2b47-4e14-9f06-590c631d8faf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:44.339137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dc76334f-2b47-4e14-9f06-590c631d8faf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Jul 28 20:16:44.339682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 698/1552] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:44.544227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cdc37479-e543-4458-b220-8c15f28fd9c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:44.544948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cdc37479-e543-4458-b220-8c15f28fd9c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:44.551302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc37479-e543-4458-b220-8c15f28fd9c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:44.551755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc37479-e543-4458-b220-8c15f28fd9c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:44.552599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc37479-e543-4458-b220-8c15f28fd9c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:44.553079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdc37479-e543-4458-b220-8c15f28fd9c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:44.614869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cdc37479-e543-4458-b220-8c15f28fd9c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:44.622360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cdc37479-e543-4458-b220-8c15f28fd9c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082298 Jul 28 20:16:44.622913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 855/1553] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:44 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:45.351875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c8634586-cd63-4477-99ad-a6c237c525ad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:45.354323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c8634586-cd63-4477-99ad-a6c237c525ad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:45.356615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=58 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:45.362152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c8634586-cd63-4477-99ad-a6c237c525ad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:45.362598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c8634586-cd63-4477-99ad-a6c237c525ad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:45.363373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c8634586-cd63-4477-99ad-a6c237c525ad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:45.363799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c8634586-cd63-4477-99ad-a6c237c525ad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:45.393272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c8634586-cd63-4477-99ad-a6c237c525ad tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045883 Jul 28 20:16:45.393812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 699/1554] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:45.642812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-90bcee79-6b07-4e60-917c-bcb2e7d668a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:45.643432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-90bcee79-6b07-4e60-917c-bcb2e7d668a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:45.645800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=56 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:45.651868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90bcee79-6b07-4e60-917c-bcb2e7d668a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:45.652316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90bcee79-6b07-4e60-917c-bcb2e7d668a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:45.653105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90bcee79-6b07-4e60-917c-bcb2e7d668a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:45.653537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90bcee79-6b07-4e60-917c-bcb2e7d668a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:45.715026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-90bcee79-6b07-4e60-917c-bcb2e7d668a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:45.722504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-90bcee79-6b07-4e60-917c-bcb2e7d668a1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083648 Jul 28 20:16:45.723080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 856/1555] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:45 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:46.405524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-618f0362-7f6a-454c-9e1f-a60c3cac7181 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:46.407842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-618f0362-7f6a-454c-9e1f-a60c3cac7181 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:46.415325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-618f0362-7f6a-454c-9e1f-a60c3cac7181 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:46.415767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-618f0362-7f6a-454c-9e1f-a60c3cac7181 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:46.416518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-618f0362-7f6a-454c-9e1f-a60c3cac7181 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:46.416982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-618f0362-7f6a-454c-9e1f-a60c3cac7181 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:46.445642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-618f0362-7f6a-454c-9e1f-a60c3cac7181 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Jul 28 20:16:46.446177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 700/1556] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:16:46.745022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-78243302-a310-411f-bc44-e30194fff418 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:46.745540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-78243302-a310-411f-bc44-e30194fff418 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:46.751518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78243302-a310-411f-bc44-e30194fff418 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:46.752027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78243302-a310-411f-bc44-e30194fff418 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:46.752809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78243302-a310-411f-bc44-e30194fff418 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:46.753240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78243302-a310-411f-bc44-e30194fff418 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:46.818724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-78243302-a310-411f-bc44-e30194fff418 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:46.826172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-78243302-a310-411f-bc44-e30194fff418 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086474 Jul 28 20:16:46.826714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 857/1557] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:46 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:47.458003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b916bd6-0a5c-4d53-986f-0f15df571ced tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:47.460167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b916bd6-0a5c-4d53-986f-0f15df571ced tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:47.466568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b916bd6-0a5c-4d53-986f-0f15df571ced tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:47.467010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b916bd6-0a5c-4d53-986f-0f15df571ced tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:47.467757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b916bd6-0a5c-4d53-986f-0f15df571ced tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:47.468184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b916bd6-0a5c-4d53-986f-0f15df571ced tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:47.498171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b916bd6-0a5c-4d53-986f-0f15df571ced tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Jul 28 20:16:47.498713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 701/1558] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:47.846744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7ea0b756-d0d7-4314-9b8d-244af1672ff6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:47.847359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7ea0b756-d0d7-4314-9b8d-244af1672ff6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:47.853927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ea0b756-d0d7-4314-9b8d-244af1672ff6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:47.854373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ea0b756-d0d7-4314-9b8d-244af1672ff6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:47.855136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ea0b756-d0d7-4314-9b8d-244af1672ff6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:47.855568 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ea0b756-d0d7-4314-9b8d-244af1672ff6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:47.916148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7ea0b756-d0d7-4314-9b8d-244af1672ff6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:47.923678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7ea0b756-d0d7-4314-9b8d-244af1672ff6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080875 Jul 28 20:16:47.924243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 858/1559] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:48.510688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-30bcc9a1-75b3-4b2d-87ba-dc37f19617c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:48.512778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-30bcc9a1-75b3-4b2d-87ba-dc37f19617c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:48.519160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30bcc9a1-75b3-4b2d-87ba-dc37f19617c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:48.519604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30bcc9a1-75b3-4b2d-87ba-dc37f19617c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:48.520353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30bcc9a1-75b3-4b2d-87ba-dc37f19617c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:48.520806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30bcc9a1-75b3-4b2d-87ba-dc37f19617c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:48.548956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-30bcc9a1-75b3-4b2d-87ba-dc37f19617c9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042367 Jul 28 20:16:48.549481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 702/1560] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:48.944695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6db81f25-c921-4a47-b394-da5b7d5841a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:48.945337 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6db81f25-c921-4a47-b394-da5b7d5841a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:48.951858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6db81f25-c921-4a47-b394-da5b7d5841a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:48.952307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6db81f25-c921-4a47-b394-da5b7d5841a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:48.953104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6db81f25-c921-4a47-b394-da5b7d5841a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:48.953538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6db81f25-c921-4a47-b394-da5b7d5841a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:49.014169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6db81f25-c921-4a47-b394-da5b7d5841a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:49.017545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:16:49.022968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6db81f25-c921-4a47-b394-da5b7d5841a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082103 Jul 28 20:16:49.023543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 859/1561] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:49.562001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-12ea5480-f051-46b3-a0b5-9096f4709779 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:49.564066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-12ea5480-f051-46b3-a0b5-9096f4709779 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:49.571229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12ea5480-f051-46b3-a0b5-9096f4709779 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:49.571674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12ea5480-f051-46b3-a0b5-9096f4709779 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:49.572423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12ea5480-f051-46b3-a0b5-9096f4709779 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:49.572890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12ea5480-f051-46b3-a0b5-9096f4709779 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:49.601783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-12ea5480-f051-46b3-a0b5-9096f4709779 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Jul 28 20:16:49.602319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 703/1562] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:50.043081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0b3a51c8-f49b-4429-8666-f426f18153e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:50.043725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0b3a51c8-f49b-4429-8666-f426f18153e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:50.050195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b3a51c8-f49b-4429-8666-f426f18153e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:50.050646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b3a51c8-f49b-4429-8666-f426f18153e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:50.051408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b3a51c8-f49b-4429-8666-f426f18153e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:50.051837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0b3a51c8-f49b-4429-8666-f426f18153e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:50.112459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0b3a51c8-f49b-4429-8666-f426f18153e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:50.120593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0b3a51c8-f49b-4429-8666-f426f18153e4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081627 Jul 28 20:16:50.121150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 860/1563] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:50.613758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-919394f8-adfb-4698-b29e-abf4500cf870 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:50.616111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-919394f8-adfb-4698-b29e-abf4500cf870 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:50.622595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-919394f8-adfb-4698-b29e-abf4500cf870 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:50.623046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-919394f8-adfb-4698-b29e-abf4500cf870 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:50.623803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-919394f8-adfb-4698-b29e-abf4500cf870 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:50.624238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-919394f8-adfb-4698-b29e-abf4500cf870 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:50.653515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-919394f8-adfb-4698-b29e-abf4500cf870 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Jul 28 20:16:50.654044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 704/1564] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:51.141951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-949852d3-0cfd-4aa4-b55f-1a487e3a5339 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:51.142563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-949852d3-0cfd-4aa4-b55f-1a487e3a5339 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:51.150491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-949852d3-0cfd-4aa4-b55f-1a487e3a5339 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:51.150940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-949852d3-0cfd-4aa4-b55f-1a487e3a5339 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:51.151709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-949852d3-0cfd-4aa4-b55f-1a487e3a5339 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:51.152141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-949852d3-0cfd-4aa4-b55f-1a487e3a5339 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:51.217688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-949852d3-0cfd-4aa4-b55f-1a487e3a5339 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:51.226957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-949852d3-0cfd-4aa4-b55f-1a487e3a5339 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.089068 Jul 28 20:16:51.227715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 861/1565] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:51 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:51.666256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-76093da3-bbbc-4fd3-b5de-02b000e0730b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:51.668681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-76093da3-bbbc-4fd3-b5de-02b000e0730b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:51.675126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-76093da3-bbbc-4fd3-b5de-02b000e0730b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:51.675566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-76093da3-bbbc-4fd3-b5de-02b000e0730b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:51.676594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-76093da3-bbbc-4fd3-b5de-02b000e0730b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:51.677027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-76093da3-bbbc-4fd3-b5de-02b000e0730b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:51.706931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-76093da3-bbbc-4fd3-b5de-02b000e0730b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 Jul 28 20:16:51.707486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 705/1566] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:52.247876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1fdc91e1-b7c3-4ec0-ad39-f28576875959 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:52.248493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1fdc91e1-b7c3-4ec0-ad39-f28576875959 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:52.254981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1fdc91e1-b7c3-4ec0-ad39-f28576875959 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:52.255435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1fdc91e1-b7c3-4ec0-ad39-f28576875959 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:52.256226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1fdc91e1-b7c3-4ec0-ad39-f28576875959 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:52.257286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1fdc91e1-b7c3-4ec0-ad39-f28576875959 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:52.320177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1fdc91e1-b7c3-4ec0-ad39-f28576875959 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:52.327686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1fdc91e1-b7c3-4ec0-ad39-f28576875959 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083648 Jul 28 20:16:52.328249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 862/1567] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:52 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:52.720520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-67099977-4c4e-41cf-aeea-6c0ad5c17d67 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:52.722693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-67099977-4c4e-41cf-aeea-6c0ad5c17d67 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:52.729731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67099977-4c4e-41cf-aeea-6c0ad5c17d67 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:52.730183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67099977-4c4e-41cf-aeea-6c0ad5c17d67 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:52.730941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67099977-4c4e-41cf-aeea-6c0ad5c17d67 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:52.731372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67099977-4c4e-41cf-aeea-6c0ad5c17d67 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:52.760043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-67099977-4c4e-41cf-aeea-6c0ad5c17d67 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043492 Jul 28 20:16:52.760606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 706/1568] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:53.348382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ff9217aa-3ca1-403c-a72f-c933b012f278 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:53.349014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ff9217aa-3ca1-403c-a72f-c933b012f278 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:53.355759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff9217aa-3ca1-403c-a72f-c933b012f278 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:53.356231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff9217aa-3ca1-403c-a72f-c933b012f278 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:53.357004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff9217aa-3ca1-403c-a72f-c933b012f278 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:53.357428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff9217aa-3ca1-403c-a72f-c933b012f278 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:53.419529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ff9217aa-3ca1-403c-a72f-c933b012f278 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:53.426939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ff9217aa-3ca1-403c-a72f-c933b012f278 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082386 Jul 28 20:16:53.427493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 863/1569] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:53 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:53.772562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a9dfd15d-1ec5-47f0-9da7-0b2c40b7df46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:53.775063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a9dfd15d-1ec5-47f0-9da7-0b2c40b7df46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:53.782204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a9dfd15d-1ec5-47f0-9da7-0b2c40b7df46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:53.782654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a9dfd15d-1ec5-47f0-9da7-0b2c40b7df46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:53.783417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a9dfd15d-1ec5-47f0-9da7-0b2c40b7df46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:53.783856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a9dfd15d-1ec5-47f0-9da7-0b2c40b7df46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:53.813459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a9dfd15d-1ec5-47f0-9da7-0b2c40b7df46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 Jul 28 20:16:53.814023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 707/1570] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:54.448638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6886e5fb-6720-41c9-825d-4f7663041ec4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:54.449259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6886e5fb-6720-41c9-825d-4f7663041ec4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:54.455860 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6886e5fb-6720-41c9-825d-4f7663041ec4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:54.456312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6886e5fb-6720-41c9-825d-4f7663041ec4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:54.457130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6886e5fb-6720-41c9-825d-4f7663041ec4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:54.457642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6886e5fb-6720-41c9-825d-4f7663041ec4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:54.519300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6886e5fb-6720-41c9-825d-4f7663041ec4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:54.527593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6886e5fb-6720-41c9-825d-4f7663041ec4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082803 Jul 28 20:16:54.528149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 864/1571] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:54.825989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-75883314-b658-4a7c-ac18-ad26026bef8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:54.828135 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-75883314-b658-4a7c-ac18-ad26026bef8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:54.834692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75883314-b658-4a7c-ac18-ad26026bef8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:54.835881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75883314-b658-4a7c-ac18-ad26026bef8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:54.836413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75883314-b658-4a7c-ac18-ad26026bef8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:54.836875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75883314-b658-4a7c-ac18-ad26026bef8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:54.864796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-75883314-b658-4a7c-ac18-ad26026bef8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042815 Jul 28 20:16:54.865337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 708/1572] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:55.549125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b8a335a2-1b05-4420-a17d-619e3b75f005 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:55.549772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b8a335a2-1b05-4420-a17d-619e3b75f005 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:55.556989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8a335a2-1b05-4420-a17d-619e3b75f005 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:55.557437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8a335a2-1b05-4420-a17d-619e3b75f005 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:55.558192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8a335a2-1b05-4420-a17d-619e3b75f005 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:55.558626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8a335a2-1b05-4420-a17d-619e3b75f005 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:55.621932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8a335a2-1b05-4420-a17d-619e3b75f005 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:55.629391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b8a335a2-1b05-4420-a17d-619e3b75f005 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084135 Jul 28 20:16:55.629949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 865/1573] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:55.877086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-418abea1-73e6-4d78-b5a1-f6a1fb571066 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:55.879237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-418abea1-73e6-4d78-b5a1-f6a1fb571066 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:55.886289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-418abea1-73e6-4d78-b5a1-f6a1fb571066 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:55.886734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-418abea1-73e6-4d78-b5a1-f6a1fb571066 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:55.887499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-418abea1-73e6-4d78-b5a1-f6a1fb571066 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:55.887932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-418abea1-73e6-4d78-b5a1-f6a1fb571066 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:55.916657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-418abea1-73e6-4d78-b5a1-f6a1fb571066 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Jul 28 20:16:55.917529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 709/1574] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:55 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:56.650305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1386a1bb-ecba-4245-8778-05885d4c4ff4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:56.650918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1386a1bb-ecba-4245-8778-05885d4c4ff4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:56.657788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1386a1bb-ecba-4245-8778-05885d4c4ff4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:56.658236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1386a1bb-ecba-4245-8778-05885d4c4ff4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:56.658973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1386a1bb-ecba-4245-8778-05885d4c4ff4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:56.659397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1386a1bb-ecba-4245-8778-05885d4c4ff4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:56.720746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1386a1bb-ecba-4245-8778-05885d4c4ff4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:56.729737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1386a1bb-ecba-4245-8778-05885d4c4ff4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083670 Jul 28 20:16:56.730308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 866/1575] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:56 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:56.929335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4da79fd5-e544-43a6-b802-512d801acf74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:56.932043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4da79fd5-e544-43a6-b802-512d801acf74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:56.938518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4da79fd5-e544-43a6-b802-512d801acf74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:56.938963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4da79fd5-e544-43a6-b802-512d801acf74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:56.939735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4da79fd5-e544-43a6-b802-512d801acf74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:56.940170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4da79fd5-e544-43a6-b802-512d801acf74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:56.969867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4da79fd5-e544-43a6-b802-512d801acf74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044563 Jul 28 20:16:56.970414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 710/1576] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:57.750113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aba13666-cf70-4bf8-a48d-ee4ef7f5989d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:57.750743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aba13666-cf70-4bf8-a48d-ee4ef7f5989d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:57.757216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aba13666-cf70-4bf8-a48d-ee4ef7f5989d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:57.757750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aba13666-cf70-4bf8-a48d-ee4ef7f5989d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:57.758650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aba13666-cf70-4bf8-a48d-ee4ef7f5989d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:57.759078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aba13666-cf70-4bf8-a48d-ee4ef7f5989d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:57.821745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-aba13666-cf70-4bf8-a48d-ee4ef7f5989d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:57.829173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aba13666-cf70-4bf8-a48d-ee4ef7f5989d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082945 Jul 28 20:16:57.829727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 867/1577] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:57.982999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d3d3e4ea-3a08-4f0c-b593-86d3589c2c20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:57.985191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d3d3e4ea-3a08-4f0c-b593-86d3589c2c20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:57.991553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3d3e4ea-3a08-4f0c-b593-86d3589c2c20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:57.992180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3d3e4ea-3a08-4f0c-b593-86d3589c2c20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:57.993592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3d3e4ea-3a08-4f0c-b593-86d3589c2c20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:57.994028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3d3e4ea-3a08-4f0c-b593-86d3589c2c20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:58.022972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d3d3e4ea-3a08-4f0c-b593-86d3589c2c20 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Jul 28 20:16:58.023964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 711/1578] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:58.580724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:16:58.580992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:16:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:16:58.851398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5e8c0167-e88f-4448-974b-136d2d8c10cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:58.852044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5e8c0167-e88f-4448-974b-136d2d8c10cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:58.859666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e8c0167-e88f-4448-974b-136d2d8c10cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:58.860101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e8c0167-e88f-4448-974b-136d2d8c10cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:58.860911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e8c0167-e88f-4448-974b-136d2d8c10cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:58.861334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e8c0167-e88f-4448-974b-136d2d8c10cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:58.927808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5e8c0167-e88f-4448-974b-136d2d8c10cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:16:58.935750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5e8c0167-e88f-4448-974b-136d2d8c10cd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.088265 Jul 28 20:16:58.936301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 868/1579] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:58 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:16:59.036249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b3724669-ef88-492f-94e5-2596214dd743 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:59.038415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b3724669-ef88-492f-94e5-2596214dd743 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:59.045130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b3724669-ef88-492f-94e5-2596214dd743 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:59.045569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b3724669-ef88-492f-94e5-2596214dd743 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:59.046463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b3724669-ef88-492f-94e5-2596214dd743 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:59.046938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b3724669-ef88-492f-94e5-2596214dd743 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:59.077436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b3724669-ef88-492f-94e5-2596214dd743 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Jul 28 20:16:59.077991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 712/1580] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:16:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:16:59.957169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-81ea561e-0525-40b5-96d6-27d57af96cab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:16:59.957793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-81ea561e-0525-40b5-96d6-27d57af96cab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:16:59.964949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81ea561e-0525-40b5-96d6-27d57af96cab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:59.965396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81ea561e-0525-40b5-96d6-27d57af96cab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:16:59.966146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81ea561e-0525-40b5-96d6-27d57af96cab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:16:59.966570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81ea561e-0525-40b5-96d6-27d57af96cab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:00.029707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-81ea561e-0525-40b5-96d6-27d57af96cab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:00.037395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-81ea561e-0525-40b5-96d6-27d57af96cab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084093 Jul 28 20:17:00.037954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 869/1581] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:16:59 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:00.090415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6bb827df-536d-4f79-843b-931df671b223 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:00.092629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6bb827df-536d-4f79-843b-931df671b223 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:00.099339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bb827df-536d-4f79-843b-931df671b223 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:00.099778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bb827df-536d-4f79-843b-931df671b223 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:00.100574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bb827df-536d-4f79-843b-931df671b223 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:00.100993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bb827df-536d-4f79-843b-931df671b223 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:00.121445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:00.144233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6bb827df-536d-4f79-843b-931df671b223 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058146 Jul 28 20:17:00.145240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 713/1582] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:01.058930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7b8e68d6-0285-482d-a629-254098997aa4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:01.059561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7b8e68d6-0285-482d-a629-254098997aa4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:01.065979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7b8e68d6-0285-482d-a629-254098997aa4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:01.066419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7b8e68d6-0285-482d-a629-254098997aa4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:01.067161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7b8e68d6-0285-482d-a629-254098997aa4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:01.067584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7b8e68d6-0285-482d-a629-254098997aa4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:01.127286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7b8e68d6-0285-482d-a629-254098997aa4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:01.134743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7b8e68d6-0285-482d-a629-254098997aa4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.079993 Jul 28 20:17:01.135297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 870/1583] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:01.156294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8f8f81b4-f8d4-4791-a5ae-7ec5c7c25571 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:01.158753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8f8f81b4-f8d4-4791-a5ae-7ec5c7c25571 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:01.166267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f8f81b4-f8d4-4791-a5ae-7ec5c7c25571 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:01.166267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f8f81b4-f8d4-4791-a5ae-7ec5c7c25571 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:01.166983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f8f81b4-f8d4-4791-a5ae-7ec5c7c25571 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:01.167414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f8f81b4-f8d4-4791-a5ae-7ec5c7c25571 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:01.195902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8f8f81b4-f8d4-4791-a5ae-7ec5c7c25571 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043459 Jul 28 20:17:01.196480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 714/1584] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:02.207924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5c65818f-2df6-47ce-8fdc-4e43782c522b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:02.210078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5c65818f-2df6-47ce-8fdc-4e43782c522b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:02.217441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c65818f-2df6-47ce-8fdc-4e43782c522b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:02.217885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c65818f-2df6-47ce-8fdc-4e43782c522b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:02.218637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c65818f-2df6-47ce-8fdc-4e43782c522b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:02.219068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5c65818f-2df6-47ce-8fdc-4e43782c522b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:02.247324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5c65818f-2df6-47ce-8fdc-4e43782c522b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043384 Jul 28 20:17:02.250776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 715/1585] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:02 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:17:02.328113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-20e9cb35-4080-4781-a716-74da5a44520b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:02.328756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-20e9cb35-4080-4781-a716-74da5a44520b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:02.334674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20e9cb35-4080-4781-a716-74da5a44520b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:02.335118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20e9cb35-4080-4781-a716-74da5a44520b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:02.335868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20e9cb35-4080-4781-a716-74da5a44520b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:02.336300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20e9cb35-4080-4781-a716-74da5a44520b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:02.396786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-20e9cb35-4080-4781-a716-74da5a44520b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:02.405027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-20e9cb35-4080-4781-a716-74da5a44520b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.254262 Jul 28 20:17:02.405613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 871/1586] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:03.258859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9844fb2c-b362-4703-a226-dc019bac1e52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:03.261926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9844fb2c-b362-4703-a226-dc019bac1e52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:03.268492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9844fb2c-b362-4703-a226-dc019bac1e52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:03.268973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9844fb2c-b362-4703-a226-dc019bac1e52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:03.269726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9844fb2c-b362-4703-a226-dc019bac1e52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:03.270155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9844fb2c-b362-4703-a226-dc019bac1e52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:03.299808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9844fb2c-b362-4703-a226-dc019bac1e52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044882 Jul 28 20:17:03.300359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 716/1587] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:17:03.425879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bae13b10-3a27-4745-98f3-24aff321e229 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:03.426442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bae13b10-3a27-4745-98f3-24aff321e229 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:03.433372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bae13b10-3a27-4745-98f3-24aff321e229 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:03.433819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bae13b10-3a27-4745-98f3-24aff321e229 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:03.434569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bae13b10-3a27-4745-98f3-24aff321e229 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:03.435000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bae13b10-3a27-4745-98f3-24aff321e229 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:03.497877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bae13b10-3a27-4745-98f3-24aff321e229 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:03.505423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bae13b10-3a27-4745-98f3-24aff321e229 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083528 Jul 28 20:17:03.505982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 872/1588] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:03 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:04.311605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-59642a51-537a-46c8-81fa-db03c0c376e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:04.313826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-59642a51-537a-46c8-81fa-db03c0c376e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:04.320295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59642a51-537a-46c8-81fa-db03c0c376e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:04.320795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59642a51-537a-46c8-81fa-db03c0c376e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:04.321566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59642a51-537a-46c8-81fa-db03c0c376e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:04.322008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59642a51-537a-46c8-81fa-db03c0c376e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:04.351523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-59642a51-537a-46c8-81fa-db03c0c376e4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Jul 28 20:17:04.352069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 717/1589] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:04.526883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-27bb1210-4a18-48c7-87bf-90083f60f29e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:04.527560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-27bb1210-4a18-48c7-87bf-90083f60f29e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:04.534683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27bb1210-4a18-48c7-87bf-90083f60f29e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:04.535130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27bb1210-4a18-48c7-87bf-90083f60f29e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:04.535896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27bb1210-4a18-48c7-87bf-90083f60f29e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:04.536327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27bb1210-4a18-48c7-87bf-90083f60f29e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:04.600569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-27bb1210-4a18-48c7-87bf-90083f60f29e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:04.608449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-27bb1210-4a18-48c7-87bf-90083f60f29e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086052 Jul 28 20:17:04.609033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 873/1590] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:04 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:05.364020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-367598a1-1ef9-472d-a870-58a0e3655509 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:05.366257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-367598a1-1ef9-472d-a870-58a0e3655509 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:05.373819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-367598a1-1ef9-472d-a870-58a0e3655509 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:05.374288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-367598a1-1ef9-472d-a870-58a0e3655509 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:05.375064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-367598a1-1ef9-472d-a870-58a0e3655509 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:05.375510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-367598a1-1ef9-472d-a870-58a0e3655509 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:05.405159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-367598a1-1ef9-472d-a870-58a0e3655509 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Jul 28 20:17:05.405701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 718/1591] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:05.630760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0ff954a7-7300-4af0-b0a1-0125e0fa1aa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:05.631310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0ff954a7-7300-4af0-b0a1-0125e0fa1aa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:05.638325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ff954a7-7300-4af0-b0a1-0125e0fa1aa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:05.638771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ff954a7-7300-4af0-b0a1-0125e0fa1aa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:05.639527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ff954a7-7300-4af0-b0a1-0125e0fa1aa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:05.639957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ff954a7-7300-4af0-b0a1-0125e0fa1aa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:05.702260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0ff954a7-7300-4af0-b0a1-0125e0fa1aa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:05.709666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0ff954a7-7300-4af0-b0a1-0125e0fa1aa1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082855 Jul 28 20:17:05.710219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 874/1592] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:05 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:06.417873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a2883d46-f73d-4439-8f6a-357a42807da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:06.419941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a2883d46-f73d-4439-8f6a-357a42807da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:06.426410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2883d46-f73d-4439-8f6a-357a42807da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:06.426855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2883d46-f73d-4439-8f6a-357a42807da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:06.427620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2883d46-f73d-4439-8f6a-357a42807da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:06.428063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2883d46-f73d-4439-8f6a-357a42807da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:06.457776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a2883d46-f73d-4439-8f6a-357a42807da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Jul 28 20:17:06.458318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 719/1593] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:06.731600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-879e0242-6c50-41f3-a512-2bb4d37acceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:06.732167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-879e0242-6c50-41f3-a512-2bb4d37acceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:06.738557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-879e0242-6c50-41f3-a512-2bb4d37acceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:06.738994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-879e0242-6c50-41f3-a512-2bb4d37acceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:06.739736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-879e0242-6c50-41f3-a512-2bb4d37acceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:06.740161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-879e0242-6c50-41f3-a512-2bb4d37acceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:06.802186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-879e0242-6c50-41f3-a512-2bb4d37acceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:06.810272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-879e0242-6c50-41f3-a512-2bb4d37acceb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083212 Jul 28 20:17:06.810822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 875/1594] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:06 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:07.470850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3cb4bee1-f625-420f-9383-418f654ab962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:07.472945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3cb4bee1-f625-420f-9383-418f654ab962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:07.479623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3cb4bee1-f625-420f-9383-418f654ab962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:07.480068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3cb4bee1-f625-420f-9383-418f654ab962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:07.480870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3cb4bee1-f625-420f-9383-418f654ab962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:07.481292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3cb4bee1-f625-420f-9383-418f654ab962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:07.509931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3cb4bee1-f625-420f-9383-418f654ab962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042996 Jul 28 20:17:07.511750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 720/1595] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:17:07.830729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b11cba5c-5f38-44d8-a596-903ca67484c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:07.831335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b11cba5c-5f38-44d8-a596-903ca67484c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:07.837748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b11cba5c-5f38-44d8-a596-903ca67484c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:07.838194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b11cba5c-5f38-44d8-a596-903ca67484c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:07.838970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b11cba5c-5f38-44d8-a596-903ca67484c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:07.839387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b11cba5c-5f38-44d8-a596-903ca67484c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:07.857042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:07.900088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b11cba5c-5f38-44d8-a596-903ca67484c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:07.908527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b11cba5c-5f38-44d8-a596-903ca67484c1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081717 Jul 28 20:17:07.909108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 876/1596] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:07 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:07.942790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:17:07.942979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:17:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:17:08.523445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7a8a3192-9997-4609-a554-a26606bc9b7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:08.525573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7a8a3192-9997-4609-a554-a26606bc9b7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:08.532220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a8a3192-9997-4609-a554-a26606bc9b7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:08.532704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a8a3192-9997-4609-a554-a26606bc9b7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:08.533466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a8a3192-9997-4609-a554-a26606bc9b7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:08.533900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a8a3192-9997-4609-a554-a26606bc9b7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:08.562724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7a8a3192-9997-4609-a554-a26606bc9b7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043321 Jul 28 20:17:08.563279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 721/1597] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:08.928910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e136b521-ccf4-4493-909e-4af613fb1404 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:08.929523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e136b521-ccf4-4493-909e-4af613fb1404 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:08.937035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e136b521-ccf4-4493-909e-4af613fb1404 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:08.937473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e136b521-ccf4-4493-909e-4af613fb1404 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:08.938222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e136b521-ccf4-4493-909e-4af613fb1404 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:08.938644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e136b521-ccf4-4493-909e-4af613fb1404 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:09.002113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e136b521-ccf4-4493-909e-4af613fb1404 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:09.009617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e136b521-ccf4-4493-909e-4af613fb1404 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084511 Jul 28 20:17:09.010170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 877/1598] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:08 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:09.578082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4d187e61-41a6-481c-824c-a2adc40cb54d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:09.580264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4d187e61-41a6-481c-824c-a2adc40cb54d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:09.586729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4d187e61-41a6-481c-824c-a2adc40cb54d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:09.587175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4d187e61-41a6-481c-824c-a2adc40cb54d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:09.587946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4d187e61-41a6-481c-824c-a2adc40cb54d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:09.589203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4d187e61-41a6-481c-824c-a2adc40cb54d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:09.622356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4d187e61-41a6-481c-824c-a2adc40cb54d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051391 Jul 28 20:17:09.622903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 722/1599] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:09 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:10.031548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-049c4667-8ed6-4912-b33a-bf93cb64407d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:10.032365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-049c4667-8ed6-4912-b33a-bf93cb64407d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:10.038759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-049c4667-8ed6-4912-b33a-bf93cb64407d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:10.039200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-049c4667-8ed6-4912-b33a-bf93cb64407d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:10.039946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-049c4667-8ed6-4912-b33a-bf93cb64407d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:10.040370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-049c4667-8ed6-4912-b33a-bf93cb64407d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:10.100205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-049c4667-8ed6-4912-b33a-bf93cb64407d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:10.108246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-049c4667-8ed6-4912-b33a-bf93cb64407d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080618 Jul 28 20:17:10.108893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 878/1600] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:10 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:10.220048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:17:10.220262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:17:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:17:10.634653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-756fc5b0-1e18-4556-8b83-ac7b67e34f85 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:10.637317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-756fc5b0-1e18-4556-8b83-ac7b67e34f85 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:10.643849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-756fc5b0-1e18-4556-8b83-ac7b67e34f85 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:10.644309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-756fc5b0-1e18-4556-8b83-ac7b67e34f85 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:10.645111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-756fc5b0-1e18-4556-8b83-ac7b67e34f85 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:10.645555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-756fc5b0-1e18-4556-8b83-ac7b67e34f85 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:10.674976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-756fc5b0-1e18-4556-8b83-ac7b67e34f85 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Jul 28 20:17:10.675510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 723/1601] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:11.133156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d313766c-d432-424a-9d42-e50633c6b725 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:11.133767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d313766c-d432-424a-9d42-e50633c6b725 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:11.140188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d313766c-d432-424a-9d42-e50633c6b725 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:11.140656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d313766c-d432-424a-9d42-e50633c6b725 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:11.141402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d313766c-d432-424a-9d42-e50633c6b725 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:11.141827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d313766c-d432-424a-9d42-e50633c6b725 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:11.203663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d313766c-d432-424a-9d42-e50633c6b725 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:11.211132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d313766c-d432-424a-9d42-e50633c6b725 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085850 Jul 28 20:17:11.211691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 879/1602] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:11 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:11.687274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c53914dc-dda0-43dd-8eac-45cadf50e830 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:11.689478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c53914dc-dda0-43dd-8eac-45cadf50e830 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:11.695927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c53914dc-dda0-43dd-8eac-45cadf50e830 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:11.696426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c53914dc-dda0-43dd-8eac-45cadf50e830 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:11.697300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c53914dc-dda0-43dd-8eac-45cadf50e830 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:11.697809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c53914dc-dda0-43dd-8eac-45cadf50e830 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:11.727654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c53914dc-dda0-43dd-8eac-45cadf50e830 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Jul 28 20:17:11.728259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 724/1603] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:17:12.232498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-743a2abb-482d-4e12-8830-c1749cdab353 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:12.233125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-743a2abb-482d-4e12-8830-c1749cdab353 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:12.239497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-743a2abb-482d-4e12-8830-c1749cdab353 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:12.239938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-743a2abb-482d-4e12-8830-c1749cdab353 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:12.240717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-743a2abb-482d-4e12-8830-c1749cdab353 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:12.241141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-743a2abb-482d-4e12-8830-c1749cdab353 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:12.301699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-743a2abb-482d-4e12-8830-c1749cdab353 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:12.309747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-743a2abb-482d-4e12-8830-c1749cdab353 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081265 Jul 28 20:17:12.310297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 880/1604] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:12 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:12.740674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aa5e2cb2-ba7b-4922-bd06-e283d0f7b719 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:12.742829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aa5e2cb2-ba7b-4922-bd06-e283d0f7b719 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:12.750188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa5e2cb2-ba7b-4922-bd06-e283d0f7b719 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:12.750630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa5e2cb2-ba7b-4922-bd06-e283d0f7b719 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:12.751398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa5e2cb2-ba7b-4922-bd06-e283d0f7b719 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:12.751836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa5e2cb2-ba7b-4922-bd06-e283d0f7b719 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:12.780122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aa5e2cb2-ba7b-4922-bd06-e283d0f7b719 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 Jul 28 20:17:12.780698 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 725/1605] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:13.331113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-991257a4-3b86-4967-bd90-a93b9c7ce7eb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:13.331717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-991257a4-3b86-4967-bd90-a93b9c7ce7eb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:13.338075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-991257a4-3b86-4967-bd90-a93b9c7ce7eb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:13.339070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-991257a4-3b86-4967-bd90-a93b9c7ce7eb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:13.339821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-991257a4-3b86-4967-bd90-a93b9c7ce7eb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:13.340245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-991257a4-3b86-4967-bd90-a93b9c7ce7eb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:13.406098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-991257a4-3b86-4967-bd90-a93b9c7ce7eb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:13.414116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-991257a4-3b86-4967-bd90-a93b9c7ce7eb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086896 Jul 28 20:17:13.414663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 881/1606] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:13 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:13.793279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-87bdb4d1-0cfb-4614-b6b1-2fe7418a1be2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:13.795649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-87bdb4d1-0cfb-4614-b6b1-2fe7418a1be2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:13.802069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87bdb4d1-0cfb-4614-b6b1-2fe7418a1be2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:13.802513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87bdb4d1-0cfb-4614-b6b1-2fe7418a1be2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:13.803267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87bdb4d1-0cfb-4614-b6b1-2fe7418a1be2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:13.803693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87bdb4d1-0cfb-4614-b6b1-2fe7418a1be2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:13.833062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-87bdb4d1-0cfb-4614-b6b1-2fe7418a1be2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Jul 28 20:17:13.833599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 726/1607] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:14.435501 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fdd8d8de-59c4-4c03-88dd-efb3f2407442 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:14.436033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fdd8d8de-59c4-4c03-88dd-efb3f2407442 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:14.442500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdd8d8de-59c4-4c03-88dd-efb3f2407442 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:14.442941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdd8d8de-59c4-4c03-88dd-efb3f2407442 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:14.443694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdd8d8de-59c4-4c03-88dd-efb3f2407442 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:14.444120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdd8d8de-59c4-4c03-88dd-efb3f2407442 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:14.505123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fdd8d8de-59c4-4c03-88dd-efb3f2407442 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:14.512972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fdd8d8de-59c4-4c03-88dd-efb3f2407442 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082115 Jul 28 20:17:14.513525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 882/1608] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:14.845215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0238d730-d317-4f09-8205-d2323178c581 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:14.847342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0238d730-d317-4f09-8205-d2323178c581 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:14.853765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0238d730-d317-4f09-8205-d2323178c581 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:14.854700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0238d730-d317-4f09-8205-d2323178c581 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:14.855547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0238d730-d317-4f09-8205-d2323178c581 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:14.855978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0238d730-d317-4f09-8205-d2323178c581 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:14.884692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0238d730-d317-4f09-8205-d2323178c581 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043419 Jul 28 20:17:14.885454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 727/1609] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:15.534580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a16c5612-f79c-4375-8730-83acbc30e999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:15.535129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a16c5612-f79c-4375-8730-83acbc30e999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:15.542142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a16c5612-f79c-4375-8730-83acbc30e999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:15.542583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a16c5612-f79c-4375-8730-83acbc30e999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:15.543328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a16c5612-f79c-4375-8730-83acbc30e999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:15.543773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a16c5612-f79c-4375-8730-83acbc30e999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:15.606360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a16c5612-f79c-4375-8730-83acbc30e999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:15.613701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a16c5612-f79c-4375-8730-83acbc30e999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083430 Jul 28 20:17:15.614246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 883/1610] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:15 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:15.897100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-81f1bccd-ceec-4b3d-b461-5c7f6ea2c6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:15.899254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-81f1bccd-ceec-4b3d-b461-5c7f6ea2c6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:15.902556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=58 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:15.908015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81f1bccd-ceec-4b3d-b461-5c7f6ea2c6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:15.908461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81f1bccd-ceec-4b3d-b461-5c7f6ea2c6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:15.909245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81f1bccd-ceec-4b3d-b461-5c7f6ea2c6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:15.909677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81f1bccd-ceec-4b3d-b461-5c7f6ea2c6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:15.939581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-81f1bccd-ceec-4b3d-b461-5c7f6ea2c6cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046466 Jul 28 20:17:15.940128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 728/1611] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:16.635900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-614ef98a-b749-4382-a390-4f31c56a6050 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:16.636508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-614ef98a-b749-4382-a390-4f31c56a6050 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:16.638797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=56 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:16.644040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-614ef98a-b749-4382-a390-4f31c56a6050 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:16.644489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-614ef98a-b749-4382-a390-4f31c56a6050 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:16.645271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-614ef98a-b749-4382-a390-4f31c56a6050 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:16.645709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-614ef98a-b749-4382-a390-4f31c56a6050 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:16.707707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-614ef98a-b749-4382-a390-4f31c56a6050 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:16.715373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-614ef98a-b749-4382-a390-4f31c56a6050 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083905 Jul 28 20:17:16.715931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 884/1612] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:16 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:16.952560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eb82c3b9-8b7f-41bb-8ea6-a6876b7bec11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:16.954695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eb82c3b9-8b7f-41bb-8ea6-a6876b7bec11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:16.961147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb82c3b9-8b7f-41bb-8ea6-a6876b7bec11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:16.961594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb82c3b9-8b7f-41bb-8ea6-a6876b7bec11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:16.962352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb82c3b9-8b7f-41bb-8ea6-a6876b7bec11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:16.962788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb82c3b9-8b7f-41bb-8ea6-a6876b7bec11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:16.992511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eb82c3b9-8b7f-41bb-8ea6-a6876b7bec11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044655 Jul 28 20:17:16.993086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 729/1613] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:17.735830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71a0c730-832c-4bb7-9f3f-dcc301460e7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:17.736433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-71a0c730-832c-4bb7-9f3f-dcc301460e7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:17.742952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71a0c730-832c-4bb7-9f3f-dcc301460e7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:17.743386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71a0c730-832c-4bb7-9f3f-dcc301460e7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:17.744229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71a0c730-832c-4bb7-9f3f-dcc301460e7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:17.745286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71a0c730-832c-4bb7-9f3f-dcc301460e7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:17.808651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-71a0c730-832c-4bb7-9f3f-dcc301460e7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:17.816185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-71a0c730-832c-4bb7-9f3f-dcc301460e7a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084184 Jul 28 20:17:17.816766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 885/1614] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:17 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:18.005071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1fefa9a2-e5e8-40b5-a0d7-1f3194775389 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:18.007150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1fefa9a2-e5e8-40b5-a0d7-1f3194775389 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:18.013867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1fefa9a2-e5e8-40b5-a0d7-1f3194775389 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:18.014319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1fefa9a2-e5e8-40b5-a0d7-1f3194775389 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:18.015081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1fefa9a2-e5e8-40b5-a0d7-1f3194775389 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:18.015515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1fefa9a2-e5e8-40b5-a0d7-1f3194775389 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:18.019199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:18.045209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1fefa9a2-e5e8-40b5-a0d7-1f3194775389 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Jul 28 20:17:18.045754 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 730/1615] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:18.837096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-be2bc5f4-ff01-42d6-805c-9e5fb40569ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:18.837714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-be2bc5f4-ff01-42d6-805c-9e5fb40569ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:18.844138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be2bc5f4-ff01-42d6-805c-9e5fb40569ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:18.844672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be2bc5f4-ff01-42d6-805c-9e5fb40569ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:18.845434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be2bc5f4-ff01-42d6-805c-9e5fb40569ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:18.845870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be2bc5f4-ff01-42d6-805c-9e5fb40569ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:18.906479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-be2bc5f4-ff01-42d6-805c-9e5fb40569ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:18.915076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-be2bc5f4-ff01-42d6-805c-9e5fb40569ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081878 Jul 28 20:17:18.915666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 886/1616] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:18 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:19.057751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a5be2689-7288-4d8c-850d-567058b946df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:19.059939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a5be2689-7288-4d8c-850d-567058b946df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:19.066375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5be2689-7288-4d8c-850d-567058b946df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:19.066818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5be2689-7288-4d8c-850d-567058b946df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:19.067565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5be2689-7288-4d8c-850d-567058b946df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:19.067995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5be2689-7288-4d8c-850d-567058b946df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:19.098341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a5be2689-7288-4d8c-850d-567058b946df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 Jul 28 20:17:19.098807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 731/1617] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:19.937442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f7b7897-cb4e-4318-9ffa-9813969d5630 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:19.938052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f7b7897-cb4e-4318-9ffa-9813969d5630 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:19.944415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f7b7897-cb4e-4318-9ffa-9813969d5630 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:19.944888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f7b7897-cb4e-4318-9ffa-9813969d5630 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:19.945631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f7b7897-cb4e-4318-9ffa-9813969d5630 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:19.946056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f7b7897-cb4e-4318-9ffa-9813969d5630 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:20.008039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2f7b7897-cb4e-4318-9ffa-9813969d5630 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:20.016379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f7b7897-cb4e-4318-9ffa-9813969d5630 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082735 Jul 28 20:17:20.016973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 887/1618] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:19 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:20.110867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2206a9c7-e2fb-4279-b9d3-65a73064164f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:20.113110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2206a9c7-e2fb-4279-b9d3-65a73064164f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:20.120685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2206a9c7-e2fb-4279-b9d3-65a73064164f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:20.121136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2206a9c7-e2fb-4279-b9d3-65a73064164f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:20.121899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2206a9c7-e2fb-4279-b9d3-65a73064164f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:20.122331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2206a9c7-e2fb-4279-b9d3-65a73064164f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:20.150977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2206a9c7-e2fb-4279-b9d3-65a73064164f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Jul 28 20:17:20.151617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 732/1619] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:21.037326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7dc4dd98-0264-4894-aab5-4c5fe7eb8616 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:21.038026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7dc4dd98-0264-4894-aab5-4c5fe7eb8616 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:21.044949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dc4dd98-0264-4894-aab5-4c5fe7eb8616 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:21.045395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dc4dd98-0264-4894-aab5-4c5fe7eb8616 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:21.046151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dc4dd98-0264-4894-aab5-4c5fe7eb8616 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:21.046582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7dc4dd98-0264-4894-aab5-4c5fe7eb8616 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:21.108924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7dc4dd98-0264-4894-aab5-4c5fe7eb8616 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:21.116263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7dc4dd98-0264-4894-aab5-4c5fe7eb8616 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082769 Jul 28 20:17:21.116849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 888/1620] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:21 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:21.163387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e76799b8-a53c-4a35-91ba-72c56e695aea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:21.165607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e76799b8-a53c-4a35-91ba-72c56e695aea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:21.172369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e76799b8-a53c-4a35-91ba-72c56e695aea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:21.172858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e76799b8-a53c-4a35-91ba-72c56e695aea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:21.173613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e76799b8-a53c-4a35-91ba-72c56e695aea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:21.174040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e76799b8-a53c-4a35-91ba-72c56e695aea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:21.203134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e76799b8-a53c-4a35-91ba-72c56e695aea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 Jul 28 20:17:21.203677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 733/1621] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:22.136836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a6648868-cd41-456a-b7a0-d20b57aaeb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:22.137451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a6648868-cd41-456a-b7a0-d20b57aaeb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:22.143953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6648868-cd41-456a-b7a0-d20b57aaeb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:22.144400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6648868-cd41-456a-b7a0-d20b57aaeb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:22.145186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6648868-cd41-456a-b7a0-d20b57aaeb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:22.145618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6648868-cd41-456a-b7a0-d20b57aaeb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:22.209186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a6648868-cd41-456a-b7a0-d20b57aaeb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:22.215286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-97133e66-3fbf-4da1-b88b-022cfde7621c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:22.217511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-97133e66-3fbf-4da1-b88b-022cfde7621c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:22.217691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a6648868-cd41-456a-b7a0-d20b57aaeb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084776 Jul 28 20:17:22.218402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 889/1622] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:22 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:22.223755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97133e66-3fbf-4da1-b88b-022cfde7621c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:22.224197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97133e66-3fbf-4da1-b88b-022cfde7621c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:22.224972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97133e66-3fbf-4da1-b88b-022cfde7621c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:22.225400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97133e66-3fbf-4da1-b88b-022cfde7621c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:22.255106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-97133e66-3fbf-4da1-b88b-022cfde7621c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044228 Jul 28 20:17:22.255643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 734/1623] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:22 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:17:23.238769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2c2d5d1c-ccc4-46bb-b6f3-3f67660dcdc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:23.239371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2c2d5d1c-ccc4-46bb-b6f3-3f67660dcdc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:23.246604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c2d5d1c-ccc4-46bb-b6f3-3f67660dcdc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:23.247040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c2d5d1c-ccc4-46bb-b6f3-3f67660dcdc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:23.247787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c2d5d1c-ccc4-46bb-b6f3-3f67660dcdc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:23.248215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2c2d5d1c-ccc4-46bb-b6f3-3f67660dcdc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:23.267682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b15b485f-7057-4243-9f5c-ae926c59007e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:23.269835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b15b485f-7057-4243-9f5c-ae926c59007e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:23.276438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b15b485f-7057-4243-9f5c-ae926c59007e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:23.276955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b15b485f-7057-4243-9f5c-ae926c59007e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:23.277728 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b15b485f-7057-4243-9f5c-ae926c59007e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:23.278166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b15b485f-7057-4243-9f5c-ae926c59007e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:23.308799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b15b485f-7057-4243-9f5c-ae926c59007e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Jul 28 20:17:23.309365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 735/1624] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:17:23.309580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2c2d5d1c-ccc4-46bb-b6f3-3f67660dcdc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:23.316892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2c2d5d1c-ccc4-46bb-b6f3-3f67660dcdc0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081895 Jul 28 20:17:23.317432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 890/1625] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:23 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:24.320512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-47b7c63e-fe13-40ff-897e-6ec49b969f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:24.322730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-47b7c63e-fe13-40ff-897e-6ec49b969f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:24.330416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47b7c63e-fe13-40ff-897e-6ec49b969f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:24.330860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47b7c63e-fe13-40ff-897e-6ec49b969f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:24.331621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47b7c63e-fe13-40ff-897e-6ec49b969f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:24.332055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47b7c63e-fe13-40ff-897e-6ec49b969f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:24.337085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-97ee46e2-7007-4dfe-89e6-75917744ff45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:24.337701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-97ee46e2-7007-4dfe-89e6-75917744ff45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:24.344111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-97ee46e2-7007-4dfe-89e6-75917744ff45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:24.344577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-97ee46e2-7007-4dfe-89e6-75917744ff45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:24.345340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-97ee46e2-7007-4dfe-89e6-75917744ff45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:24.345771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-97ee46e2-7007-4dfe-89e6-75917744ff45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:24.363561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-47b7c63e-fe13-40ff-897e-6ec49b969f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046976 Jul 28 20:17:24.364145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 736/1626] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:24.412572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-97ee46e2-7007-4dfe-89e6-75917744ff45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:24.420110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-97ee46e2-7007-4dfe-89e6-75917744ff45 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086925 Jul 28 20:17:24.420688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 891/1627] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:24 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:17:25.376917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e33b6127-27c2-4690-afec-221d90481f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:25.379093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e33b6127-27c2-4690-afec-221d90481f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:25.386006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e33b6127-27c2-4690-afec-221d90481f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:25.386476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e33b6127-27c2-4690-afec-221d90481f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:25.387243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e33b6127-27c2-4690-afec-221d90481f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:25.387674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e33b6127-27c2-4690-afec-221d90481f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:25.416388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e33b6127-27c2-4690-afec-221d90481f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Jul 28 20:17:25.417114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 737/1628] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:25.440507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c4518fd9-e3e1-4da7-9a44-61abfce291fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:25.441187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c4518fd9-e3e1-4da7-9a44-61abfce291fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:25.447618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c4518fd9-e3e1-4da7-9a44-61abfce291fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:25.448068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c4518fd9-e3e1-4da7-9a44-61abfce291fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:25.448866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c4518fd9-e3e1-4da7-9a44-61abfce291fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:25.449323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c4518fd9-e3e1-4da7-9a44-61abfce291fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:25.512314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c4518fd9-e3e1-4da7-9a44-61abfce291fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:25.519880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c4518fd9-e3e1-4da7-9a44-61abfce291fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083244 Jul 28 20:17:25.520439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 892/1629] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:25 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:26.429446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-44484324-8044-40ea-9bb6-75dd4d2ba796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:26.431509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-44484324-8044-40ea-9bb6-75dd4d2ba796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:26.438293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-44484324-8044-40ea-9bb6-75dd4d2ba796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:26.438734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-44484324-8044-40ea-9bb6-75dd4d2ba796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:26.439484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-44484324-8044-40ea-9bb6-75dd4d2ba796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:26.439910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-44484324-8044-40ea-9bb6-75dd4d2ba796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:26.468890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-44484324-8044-40ea-9bb6-75dd4d2ba796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Jul 28 20:17:26.469419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 738/1630] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:26.540403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6c2c17e-fec2-4747-b0fc-688a9d43f61b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:26.541042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b6c2c17e-fec2-4747-b0fc-688a9d43f61b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:26.548224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6c2c17e-fec2-4747-b0fc-688a9d43f61b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:26.548708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6c2c17e-fec2-4747-b0fc-688a9d43f61b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:26.549467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6c2c17e-fec2-4747-b0fc-688a9d43f61b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:26.549900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6c2c17e-fec2-4747-b0fc-688a9d43f61b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:26.553794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:26.614015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b6c2c17e-fec2-4747-b0fc-688a9d43f61b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:26.622403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b6c2c17e-fec2-4747-b0fc-688a9d43f61b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085391 Jul 28 20:17:26.623219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 893/1631] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:26 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:27.481134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-af290e84-8fb6-42a5-8999-c71d4d6cf1bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:27.483176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-af290e84-8fb6-42a5-8999-c71d4d6cf1bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:27.489630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af290e84-8fb6-42a5-8999-c71d4d6cf1bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:27.490069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af290e84-8fb6-42a5-8999-c71d4d6cf1bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:27.490815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af290e84-8fb6-42a5-8999-c71d4d6cf1bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:27.491240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af290e84-8fb6-42a5-8999-c71d4d6cf1bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:27.520237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-af290e84-8fb6-42a5-8999-c71d4d6cf1bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043140 Jul 28 20:17:27.520801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 739/1632] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:27.643835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5543b469-9da1-4f4a-8900-036d748f79ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:27.644434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5543b469-9da1-4f4a-8900-036d748f79ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:27.650853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5543b469-9da1-4f4a-8900-036d748f79ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:27.651302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5543b469-9da1-4f4a-8900-036d748f79ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:27.652063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5543b469-9da1-4f4a-8900-036d748f79ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:27.653485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5543b469-9da1-4f4a-8900-036d748f79ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:27.716085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5543b469-9da1-4f4a-8900-036d748f79ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:27.723505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5543b469-9da1-4f4a-8900-036d748f79ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083512 Jul 28 20:17:27.724063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 894/1633] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:27 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:28.532775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e671662d-19f3-43c3-9f8b-f832adfb8b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:28.534854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e671662d-19f3-43c3-9f8b-f832adfb8b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:28.541312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e671662d-19f3-43c3-9f8b-f832adfb8b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:28.541762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e671662d-19f3-43c3-9f8b-f832adfb8b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:28.542525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e671662d-19f3-43c3-9f8b-f832adfb8b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:28.543499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e671662d-19f3-43c3-9f8b-f832adfb8b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:28.572455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e671662d-19f3-43c3-9f8b-f832adfb8b36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Jul 28 20:17:28.573028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 740/1634] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:28.743900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0cc06ba2-ca98-4863-bc7b-bfbd43234293 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:28.744509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0cc06ba2-ca98-4863-bc7b-bfbd43234293 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:28.751392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0cc06ba2-ca98-4863-bc7b-bfbd43234293 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:28.751833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0cc06ba2-ca98-4863-bc7b-bfbd43234293 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:28.752613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0cc06ba2-ca98-4863-bc7b-bfbd43234293 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:28.753044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0cc06ba2-ca98-4863-bc7b-bfbd43234293 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:28.813787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0cc06ba2-ca98-4863-bc7b-bfbd43234293 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:28.821298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0cc06ba2-ca98-4863-bc7b-bfbd43234293 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081204 Jul 28 20:17:28.821854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 895/1635] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:28 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:29.584949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e93f0c1a-d776-4c30-8dff-511c3d5668de tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:29.587095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e93f0c1a-d776-4c30-8dff-511c3d5668de tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:29.593655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e93f0c1a-d776-4c30-8dff-511c3d5668de tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:29.594103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e93f0c1a-d776-4c30-8dff-511c3d5668de tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:29.594860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e93f0c1a-d776-4c30-8dff-511c3d5668de tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:29.595290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e93f0c1a-d776-4c30-8dff-511c3d5668de tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:29.623895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e93f0c1a-d776-4c30-8dff-511c3d5668de tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042972 Jul 28 20:17:29.624427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 741/1636] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:29 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:29.842536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-94e87509-d4f6-4fdb-b01e-20856f79110e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:29.843069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-94e87509-d4f6-4fdb-b01e-20856f79110e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:29.849592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94e87509-d4f6-4fdb-b01e-20856f79110e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:29.850041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94e87509-d4f6-4fdb-b01e-20856f79110e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:29.850787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94e87509-d4f6-4fdb-b01e-20856f79110e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:29.851217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94e87509-d4f6-4fdb-b01e-20856f79110e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:29.912341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-94e87509-d4f6-4fdb-b01e-20856f79110e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:29.923168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-94e87509-d4f6-4fdb-b01e-20856f79110e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084774 Jul 28 20:17:29.927002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 896/1637] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:29 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:30.636291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-513f5da0-78bb-4c6c-bd09-1d2f84c3957e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:30.638977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-513f5da0-78bb-4c6c-bd09-1d2f84c3957e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:30.645469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-513f5da0-78bb-4c6c-bd09-1d2f84c3957e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:30.645915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-513f5da0-78bb-4c6c-bd09-1d2f84c3957e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:30.646664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-513f5da0-78bb-4c6c-bd09-1d2f84c3957e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:30.647093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-513f5da0-78bb-4c6c-bd09-1d2f84c3957e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:30.676775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-513f5da0-78bb-4c6c-bd09-1d2f84c3957e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Jul 28 20:17:30.677308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 742/1638] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:30.944826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7bc9c8dd-81dd-4f27-a9d4-91111943d8d9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:30.945386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7bc9c8dd-81dd-4f27-a9d4-91111943d8d9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:30.952619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bc9c8dd-81dd-4f27-a9d4-91111943d8d9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:30.953061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bc9c8dd-81dd-4f27-a9d4-91111943d8d9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:30.953796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bc9c8dd-81dd-4f27-a9d4-91111943d8d9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:30.954216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bc9c8dd-81dd-4f27-a9d4-91111943d8d9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:31.016699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7bc9c8dd-81dd-4f27-a9d4-91111943d8d9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:31.024069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7bc9c8dd-81dd-4f27-a9d4-91111943d8d9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083204 Jul 28 20:17:31.024643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 897/1639] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:30 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:31.689279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d989e074-3a68-4e51-8aea-070b38429fcb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:31.691459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d989e074-3a68-4e51-8aea-070b38429fcb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:31.697765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d989e074-3a68-4e51-8aea-070b38429fcb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:31.698258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d989e074-3a68-4e51-8aea-070b38429fcb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:31.699142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d989e074-3a68-4e51-8aea-070b38429fcb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:31.700248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d989e074-3a68-4e51-8aea-070b38429fcb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:31.729720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d989e074-3a68-4e51-8aea-070b38429fcb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Jul 28 20:17:31.730342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 743/1640] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:17:32.045831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f2df7fc3-6a51-4966-8487-cb2278e48476 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:32.046389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f2df7fc3-6a51-4966-8487-cb2278e48476 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:32.052832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2df7fc3-6a51-4966-8487-cb2278e48476 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:32.053272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2df7fc3-6a51-4966-8487-cb2278e48476 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:32.054170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2df7fc3-6a51-4966-8487-cb2278e48476 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:32.054608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2df7fc3-6a51-4966-8487-cb2278e48476 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:32.114697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f2df7fc3-6a51-4966-8487-cb2278e48476 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:32.122927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f2df7fc3-6a51-4966-8487-cb2278e48476 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082091 Jul 28 20:17:32.123475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 898/1641] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:32 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:32.742797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7662419f-443b-419c-a2ad-9fbb880c3983 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:32.744970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7662419f-443b-419c-a2ad-9fbb880c3983 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:32.751469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7662419f-443b-419c-a2ad-9fbb880c3983 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:32.751908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7662419f-443b-419c-a2ad-9fbb880c3983 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:32.752685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7662419f-443b-419c-a2ad-9fbb880c3983 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:32.753111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7662419f-443b-419c-a2ad-9fbb880c3983 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:32.782131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7662419f-443b-419c-a2ad-9fbb880c3983 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 Jul 28 20:17:32.782672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 744/1642] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:33.143589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2b49206f-e86f-4b6b-af53-0cdbf6b1ac74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:33.144193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2b49206f-e86f-4b6b-af53-0cdbf6b1ac74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:33.150382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b49206f-e86f-4b6b-af53-0cdbf6b1ac74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:33.150864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b49206f-e86f-4b6b-af53-0cdbf6b1ac74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:33.151587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b49206f-e86f-4b6b-af53-0cdbf6b1ac74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:33.152008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b49206f-e86f-4b6b-af53-0cdbf6b1ac74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:33.212189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2b49206f-e86f-4b6b-af53-0cdbf6b1ac74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:33.220086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2b49206f-e86f-4b6b-af53-0cdbf6b1ac74 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080319 Jul 28 20:17:33.220658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 899/1643] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:33 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:33.794470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5095a76b-3838-4f50-8cc5-25e466161d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:33.796648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5095a76b-3838-4f50-8cc5-25e466161d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:33.803075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5095a76b-3838-4f50-8cc5-25e466161d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:33.803520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5095a76b-3838-4f50-8cc5-25e466161d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:33.804272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5095a76b-3838-4f50-8cc5-25e466161d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:33.804747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5095a76b-3838-4f50-8cc5-25e466161d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:33.833811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5095a76b-3838-4f50-8cc5-25e466161d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Jul 28 20:17:33.834353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 745/1644] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:34.241336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-564d9c15-95ca-480f-b3e1-26e853ea214f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:34.241941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-564d9c15-95ca-480f-b3e1-26e853ea214f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:34.249283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-564d9c15-95ca-480f-b3e1-26e853ea214f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:34.249727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-564d9c15-95ca-480f-b3e1-26e853ea214f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:34.250474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-564d9c15-95ca-480f-b3e1-26e853ea214f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:34.250899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-564d9c15-95ca-480f-b3e1-26e853ea214f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:34.311625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-564d9c15-95ca-480f-b3e1-26e853ea214f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:34.319018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-564d9c15-95ca-480f-b3e1-26e853ea214f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081489 Jul 28 20:17:34.319570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 900/1645] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:34 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:34.846952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-259d6314-ffae-49e6-8477-94eb8e57637f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:34.849155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-259d6314-ffae-49e6-8477-94eb8e57637f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:34.856248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-259d6314-ffae-49e6-8477-94eb8e57637f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:34.856742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-259d6314-ffae-49e6-8477-94eb8e57637f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:34.857501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-259d6314-ffae-49e6-8477-94eb8e57637f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:34.857932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-259d6314-ffae-49e6-8477-94eb8e57637f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:34.882242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:34.887264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-259d6314-ffae-49e6-8477-94eb8e57637f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Jul 28 20:17:34.887810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 746/1646] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:35.339435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bc207d77-4a10-480e-90c1-d24064e4effe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:35.340890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bc207d77-4a10-480e-90c1-d24064e4effe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:35.346996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc207d77-4a10-480e-90c1-d24064e4effe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:35.347437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc207d77-4a10-480e-90c1-d24064e4effe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:35.348179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc207d77-4a10-480e-90c1-d24064e4effe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:35.348635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc207d77-4a10-480e-90c1-d24064e4effe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:35.417355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bc207d77-4a10-480e-90c1-d24064e4effe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:35.424899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bc207d77-4a10-480e-90c1-d24064e4effe tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.089269 Jul 28 20:17:35.425448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 901/1647] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:35 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:35.899600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e09411d7-c413-4549-bd79-5924ee083485 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:35.901862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e09411d7-c413-4549-bd79-5924ee083485 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:35.909478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e09411d7-c413-4549-bd79-5924ee083485 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:35.909930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e09411d7-c413-4549-bd79-5924ee083485 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:35.910688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e09411d7-c413-4549-bd79-5924ee083485 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:35.911119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e09411d7-c413-4549-bd79-5924ee083485 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:35.940396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e09411d7-c413-4549-bd79-5924ee083485 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Jul 28 20:17:35.940961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 747/1648] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:36.445958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1d6e09cf-088b-469f-a582-0604bcfb2ddf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:36.446504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1d6e09cf-088b-469f-a582-0604bcfb2ddf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:36.454581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d6e09cf-088b-469f-a582-0604bcfb2ddf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:36.455029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d6e09cf-088b-469f-a582-0604bcfb2ddf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:36.455781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d6e09cf-088b-469f-a582-0604bcfb2ddf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:36.456211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d6e09cf-088b-469f-a582-0604bcfb2ddf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:36.522495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1d6e09cf-088b-469f-a582-0604bcfb2ddf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:36.530853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1d6e09cf-088b-469f-a582-0604bcfb2ddf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.088810 Jul 28 20:17:36.531403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 902/1649] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:36 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:36.953874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7927a830-4394-44a3-8b6c-35685de2d37f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:36.956075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7927a830-4394-44a3-8b6c-35685de2d37f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:36.962543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7927a830-4394-44a3-8b6c-35685de2d37f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:36.963021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7927a830-4394-44a3-8b6c-35685de2d37f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:36.963785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7927a830-4394-44a3-8b6c-35685de2d37f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:36.964224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7927a830-4394-44a3-8b6c-35685de2d37f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:36.993568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7927a830-4394-44a3-8b6c-35685de2d37f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045547 Jul 28 20:17:36.994116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 748/1650] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:37.559454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-92de2924-07fb-4b16-9b5c-6d4dd57ed2f4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:37.560004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-92de2924-07fb-4b16-9b5c-6d4dd57ed2f4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:37.566504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92de2924-07fb-4b16-9b5c-6d4dd57ed2f4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:37.566949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92de2924-07fb-4b16-9b5c-6d4dd57ed2f4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:37.567700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92de2924-07fb-4b16-9b5c-6d4dd57ed2f4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:37.568130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92de2924-07fb-4b16-9b5c-6d4dd57ed2f4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:37.629562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-92de2924-07fb-4b16-9b5c-6d4dd57ed2f4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:37.637102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-92de2924-07fb-4b16-9b5c-6d4dd57ed2f4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082317 Jul 28 20:17:37.637655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 903/1651] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:37 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:38.007225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-acb85444-0e7c-4a6d-be14-45b9fa98f246 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:38.009573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-acb85444-0e7c-4a6d-be14-45b9fa98f246 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:38.016551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-acb85444-0e7c-4a6d-be14-45b9fa98f246 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:38.017006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-acb85444-0e7c-4a6d-be14-45b9fa98f246 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:38.017761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-acb85444-0e7c-4a6d-be14-45b9fa98f246 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:38.018208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-acb85444-0e7c-4a6d-be14-45b9fa98f246 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:38.047692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-acb85444-0e7c-4a6d-be14-45b9fa98f246 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Jul 28 20:17:38.048225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 749/1652] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:38.657696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-934136f3-f706-4722-8505-59706c43454f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:38.658312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-934136f3-f706-4722-8505-59706c43454f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:38.664723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-934136f3-f706-4722-8505-59706c43454f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:38.665171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-934136f3-f706-4722-8505-59706c43454f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:38.665928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-934136f3-f706-4722-8505-59706c43454f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:38.666361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-934136f3-f706-4722-8505-59706c43454f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:38.727947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-934136f3-f706-4722-8505-59706c43454f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:38.736155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-934136f3-f706-4722-8505-59706c43454f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082611 Jul 28 20:17:38.736738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 904/1653] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:38 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:39.060634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0e8afd5d-2905-4e61-aa13-86f6ad1cc0d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:39.063113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0e8afd5d-2905-4e61-aa13-86f6ad1cc0d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:39.069577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e8afd5d-2905-4e61-aa13-86f6ad1cc0d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:39.070028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e8afd5d-2905-4e61-aa13-86f6ad1cc0d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:39.071400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e8afd5d-2905-4e61-aa13-86f6ad1cc0d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:39.072017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e8afd5d-2905-4e61-aa13-86f6ad1cc0d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:39.102483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0e8afd5d-2905-4e61-aa13-86f6ad1cc0d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Jul 28 20:17:39.102945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 750/1654] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:39.757425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-be63b237-812f-4a9c-88fe-39048006370d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:39.758035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-be63b237-812f-4a9c-88fe-39048006370d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:39.765128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be63b237-812f-4a9c-88fe-39048006370d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:39.765577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be63b237-812f-4a9c-88fe-39048006370d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:39.766336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be63b237-812f-4a9c-88fe-39048006370d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:39.766763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be63b237-812f-4a9c-88fe-39048006370d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:39.831154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-be63b237-812f-4a9c-88fe-39048006370d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:39.838541 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-be63b237-812f-4a9c-88fe-39048006370d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085021 Jul 28 20:17:39.839087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 905/1655] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:39 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:40.115286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-27a3c78c-76e9-474f-bdba-7037d2af7fb3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:40.117478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-27a3c78c-76e9-474f-bdba-7037d2af7fb3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:40.123807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27a3c78c-76e9-474f-bdba-7037d2af7fb3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:40.124242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27a3c78c-76e9-474f-bdba-7037d2af7fb3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:40.125011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27a3c78c-76e9-474f-bdba-7037d2af7fb3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:40.125436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27a3c78c-76e9-474f-bdba-7037d2af7fb3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:40.154651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-27a3c78c-76e9-474f-bdba-7037d2af7fb3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043277 Jul 28 20:17:40.155198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 751/1656] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:40.859339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-131d71bb-f6f6-4745-81e2-aa6a1bb8d449 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:40.859948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-131d71bb-f6f6-4745-81e2-aa6a1bb8d449 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:40.866667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-131d71bb-f6f6-4745-81e2-aa6a1bb8d449 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:40.867105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-131d71bb-f6f6-4745-81e2-aa6a1bb8d449 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:40.867902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-131d71bb-f6f6-4745-81e2-aa6a1bb8d449 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:40.868355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-131d71bb-f6f6-4745-81e2-aa6a1bb8d449 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:40.928527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-131d71bb-f6f6-4745-81e2-aa6a1bb8d449 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:40.936411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-131d71bb-f6f6-4745-81e2-aa6a1bb8d449 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080910 Jul 28 20:17:40.936993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 906/1657] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:40 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:41.166907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-68e45ba3-f454-45bd-8c1a-44052dcfe152 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:41.169608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-68e45ba3-f454-45bd-8c1a-44052dcfe152 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:41.176010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-68e45ba3-f454-45bd-8c1a-44052dcfe152 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:41.176456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-68e45ba3-f454-45bd-8c1a-44052dcfe152 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:41.177254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-68e45ba3-f454-45bd-8c1a-44052dcfe152 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:41.177686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-68e45ba3-f454-45bd-8c1a-44052dcfe152 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:41.206408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-68e45ba3-f454-45bd-8c1a-44052dcfe152 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 Jul 28 20:17:41.206948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 752/1658] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:41.957328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6285455f-b9b9-49e9-9439-b5c2fe1dd1f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:41.957912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6285455f-b9b9-49e9-9439-b5c2fe1dd1f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:41.964385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6285455f-b9b9-49e9-9439-b5c2fe1dd1f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:41.964992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6285455f-b9b9-49e9-9439-b5c2fe1dd1f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:41.965741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6285455f-b9b9-49e9-9439-b5c2fe1dd1f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:41.966169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6285455f-b9b9-49e9-9439-b5c2fe1dd1f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:42.026523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6285455f-b9b9-49e9-9439-b5c2fe1dd1f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:42.034231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6285455f-b9b9-49e9-9439-b5c2fe1dd1f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080819 Jul 28 20:17:42.034782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 907/1659] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:41 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:42.219326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-099d556a-7ab6-4086-ba3c-119d6f0e6796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:42.221434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-099d556a-7ab6-4086-ba3c-119d6f0e6796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:42.227921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-099d556a-7ab6-4086-ba3c-119d6f0e6796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:42.228365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-099d556a-7ab6-4086-ba3c-119d6f0e6796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:42.229152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-099d556a-7ab6-4086-ba3c-119d6f0e6796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:42.229582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-099d556a-7ab6-4086-ba3c-119d6f0e6796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:42.258492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-099d556a-7ab6-4086-ba3c-119d6f0e6796 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043222 Jul 28 20:17:42.259414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 753/1660] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:43.054988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1e2597ba-4def-4116-8449-0fd4d9c52500 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:43.055604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1e2597ba-4def-4116-8449-0fd4d9c52500 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:43.062331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e2597ba-4def-4116-8449-0fd4d9c52500 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:43.062779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e2597ba-4def-4116-8449-0fd4d9c52500 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:43.063538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e2597ba-4def-4116-8449-0fd4d9c52500 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:43.063968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e2597ba-4def-4116-8449-0fd4d9c52500 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:43.125613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1e2597ba-4def-4116-8449-0fd4d9c52500 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:43.132912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1e2597ba-4def-4116-8449-0fd4d9c52500 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081733 Jul 28 20:17:43.133472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 908/1661] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:43 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:43.270709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-580e0815-e913-4298-8a09-f8545d18c288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:43.272902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-580e0815-e913-4298-8a09-f8545d18c288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:43.279951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-580e0815-e913-4298-8a09-f8545d18c288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:43.280393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-580e0815-e913-4298-8a09-f8545d18c288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:43.281172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-580e0815-e913-4298-8a09-f8545d18c288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:43.281851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-580e0815-e913-4298-8a09-f8545d18c288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:43.310732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-580e0815-e913-4298-8a09-f8545d18c288 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Jul 28 20:17:43.311236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 754/1662] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:44.153777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5cf8bc84-6c4a-47b8-a199-bede576ee3f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:44.154365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5cf8bc84-6c4a-47b8-a199-bede576ee3f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:44.161129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf8bc84-6c4a-47b8-a199-bede576ee3f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:44.161585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf8bc84-6c4a-47b8-a199-bede576ee3f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:44.162319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf8bc84-6c4a-47b8-a199-bede576ee3f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:44.162740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cf8bc84-6c4a-47b8-a199-bede576ee3f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:44.227385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5cf8bc84-6c4a-47b8-a199-bede576ee3f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:44.231458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:44.236149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5cf8bc84-6c4a-47b8-a199-bede576ee3f8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086258 Jul 28 20:17:44.236733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 909/1663] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:44 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:44.322964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6ef8893f-78dc-4b4f-bf7b-7167bce35ea2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:44.325213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6ef8893f-78dc-4b4f-bf7b-7167bce35ea2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:44.331660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6ef8893f-78dc-4b4f-bf7b-7167bce35ea2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:44.332106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6ef8893f-78dc-4b4f-bf7b-7167bce35ea2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:44.332904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6ef8893f-78dc-4b4f-bf7b-7167bce35ea2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:44.333339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6ef8893f-78dc-4b4f-bf7b-7167bce35ea2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:44.362350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6ef8893f-78dc-4b4f-bf7b-7167bce35ea2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Jul 28 20:17:44.362894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 755/1664] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:45.257742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-df071fcb-5f62-45ef-b3b0-0edb4d5fd056 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:45.258345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-df071fcb-5f62-45ef-b3b0-0edb4d5fd056 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:45.265374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df071fcb-5f62-45ef-b3b0-0edb4d5fd056 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:45.265827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df071fcb-5f62-45ef-b3b0-0edb4d5fd056 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:45.266576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df071fcb-5f62-45ef-b3b0-0edb4d5fd056 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:45.267007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df071fcb-5f62-45ef-b3b0-0edb4d5fd056 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:45.329718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-df071fcb-5f62-45ef-b3b0-0edb4d5fd056 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:45.337152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-df071fcb-5f62-45ef-b3b0-0edb4d5fd056 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083468 Jul 28 20:17:45.337702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 910/1665] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:45 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:17:45.374553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0228a4cc-f6e8-442d-9af0-efc8d39a871a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:45.376778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0228a4cc-f6e8-442d-9af0-efc8d39a871a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:45.385371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0228a4cc-f6e8-442d-9af0-efc8d39a871a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:45.385830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0228a4cc-f6e8-442d-9af0-efc8d39a871a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:45.386649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0228a4cc-f6e8-442d-9af0-efc8d39a871a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:45.387209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0228a4cc-f6e8-442d-9af0-efc8d39a871a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:45.421142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0228a4cc-f6e8-442d-9af0-efc8d39a871a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050361 Jul 28 20:17:45.421614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 756/1666] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:46.357917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0a6df821-64e1-4177-a92b-cc59a832916a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:46.358519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0a6df821-64e1-4177-a92b-cc59a832916a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:46.365102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a6df821-64e1-4177-a92b-cc59a832916a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:46.365552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a6df821-64e1-4177-a92b-cc59a832916a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:46.366310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a6df821-64e1-4177-a92b-cc59a832916a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:46.366742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a6df821-64e1-4177-a92b-cc59a832916a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:46.428075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0a6df821-64e1-4177-a92b-cc59a832916a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:46.434461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5ad19db0-ff6f-48b7-910c-034a3d772c2a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:46.436243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0a6df821-64e1-4177-a92b-cc59a832916a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082703 Jul 28 20:17:46.436628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5ad19db0-ff6f-48b7-910c-034a3d772c2a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:46.436841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 911/1667] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:46 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:46.439198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=58 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:46.444388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ad19db0-ff6f-48b7-910c-034a3d772c2a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:46.444874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ad19db0-ff6f-48b7-910c-034a3d772c2a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:46.445640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ad19db0-ff6f-48b7-910c-034a3d772c2a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:46.446073 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ad19db0-ff6f-48b7-910c-034a3d772c2a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:46.474726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5ad19db0-ff6f-48b7-910c-034a3d772c2a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Jul 28 20:17:46.475266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 757/1668] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:17:47.457281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-83182ec8-7d22-403a-988a-fd9c35b95990 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:47.457801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-83182ec8-7d22-403a-988a-fd9c35b95990 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:47.460070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=56 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:47.465941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83182ec8-7d22-403a-988a-fd9c35b95990 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:47.466377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83182ec8-7d22-403a-988a-fd9c35b95990 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:47.467123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83182ec8-7d22-403a-988a-fd9c35b95990 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:47.467545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83182ec8-7d22-403a-988a-fd9c35b95990 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:47.487278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e554c090-b5a2-4ec6-b9c5-23cdb60568cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:47.489459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e554c090-b5a2-4ec6-b9c5-23cdb60568cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:47.496018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e554c090-b5a2-4ec6-b9c5-23cdb60568cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:47.496473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e554c090-b5a2-4ec6-b9c5-23cdb60568cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:47.497272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e554c090-b5a2-4ec6-b9c5-23cdb60568cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:47.497714 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e554c090-b5a2-4ec6-b9c5-23cdb60568cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:47.527339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e554c090-b5a2-4ec6-b9c5-23cdb60568cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043391 Jul 28 20:17:47.527901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 758/1669] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:17:47.529231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-83182ec8-7d22-403a-988a-fd9c35b95990 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:47.536963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-83182ec8-7d22-403a-988a-fd9c35b95990 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083562 Jul 28 20:17:47.537519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 912/1670] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:48.539956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8fea638f-c5ac-46ee-8f02-be635f8098ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:48.542070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8fea638f-c5ac-46ee-8f02-be635f8098ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:48.548664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fea638f-c5ac-46ee-8f02-be635f8098ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:48.549131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fea638f-c5ac-46ee-8f02-be635f8098ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:48.549860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fea638f-c5ac-46ee-8f02-be635f8098ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:48.550291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fea638f-c5ac-46ee-8f02-be635f8098ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:48.558750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6886c509-8afd-43d2-a9a8-4adf121c3b51 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:48.559361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6886c509-8afd-43d2-a9a8-4adf121c3b51 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:48.565803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6886c509-8afd-43d2-a9a8-4adf121c3b51 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:48.566258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6886c509-8afd-43d2-a9a8-4adf121c3b51 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:48.567011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6886c509-8afd-43d2-a9a8-4adf121c3b51 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:48.567437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6886c509-8afd-43d2-a9a8-4adf121c3b51 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:48.579404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8fea638f-c5ac-46ee-8f02-be635f8098ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Jul 28 20:17:48.579956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 759/1671] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:48.632296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6886c509-8afd-43d2-a9a8-4adf121c3b51 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:48.640362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6886c509-8afd-43d2-a9a8-4adf121c3b51 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085876 Jul 28 20:17:48.640941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 913/1672] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:17:49.592390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5e16097c-5480-4654-bd09-0c49401ff5aa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:49.594592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5e16097c-5480-4654-bd09-0c49401ff5aa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:49.601008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e16097c-5480-4654-bd09-0c49401ff5aa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:49.601458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e16097c-5480-4654-bd09-0c49401ff5aa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:49.602232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e16097c-5480-4654-bd09-0c49401ff5aa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:49.602686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e16097c-5480-4654-bd09-0c49401ff5aa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:49.631806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5e16097c-5480-4654-bd09-0c49401ff5aa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Jul 28 20:17:49.632350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 760/1673] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:49.662328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-413e7123-c1cd-4de3-b360-b0550411d2ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:49.662949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-413e7123-c1cd-4de3-b360-b0550411d2ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:49.670261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-413e7123-c1cd-4de3-b360-b0550411d2ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:49.670714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-413e7123-c1cd-4de3-b360-b0550411d2ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:49.671477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-413e7123-c1cd-4de3-b360-b0550411d2ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:49.671911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-413e7123-c1cd-4de3-b360-b0550411d2ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:49.737256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-413e7123-c1cd-4de3-b360-b0550411d2ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:49.744725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-413e7123-c1cd-4de3-b360-b0550411d2ce tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086324 Jul 28 20:17:49.745302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 914/1674] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:49 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:50.644117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-658ed6bf-71b9-43b9-bfe5-9b573645d5d2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:50.646367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-658ed6bf-71b9-43b9-bfe5-9b573645d5d2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:50.653297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-658ed6bf-71b9-43b9-bfe5-9b573645d5d2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:50.653741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-658ed6bf-71b9-43b9-bfe5-9b573645d5d2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:50.654490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-658ed6bf-71b9-43b9-bfe5-9b573645d5d2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:50.654921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-658ed6bf-71b9-43b9-bfe5-9b573645d5d2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:50.684046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-658ed6bf-71b9-43b9-bfe5-9b573645d5d2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Jul 28 20:17:50.684668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 761/1675] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:50.766079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f319a3ec-9853-4936-aff0-f30408de4916 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:50.766694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f319a3ec-9853-4936-aff0-f30408de4916 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:50.773189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f319a3ec-9853-4936-aff0-f30408de4916 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:50.773634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f319a3ec-9853-4936-aff0-f30408de4916 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:50.774389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f319a3ec-9853-4936-aff0-f30408de4916 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:50.774822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f319a3ec-9853-4936-aff0-f30408de4916 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:50.834033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f319a3ec-9853-4936-aff0-f30408de4916 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:50.842156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f319a3ec-9853-4936-aff0-f30408de4916 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.079977 Jul 28 20:17:50.842710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 915/1676] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:51.696525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-031b196c-8d09-4508-a5fc-e04973183637 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:51.698898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-031b196c-8d09-4508-a5fc-e04973183637 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:51.706567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-031b196c-8d09-4508-a5fc-e04973183637 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:51.707010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-031b196c-8d09-4508-a5fc-e04973183637 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:51.707802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-031b196c-8d09-4508-a5fc-e04973183637 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:51.708229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-031b196c-8d09-4508-a5fc-e04973183637 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:51.738605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-031b196c-8d09-4508-a5fc-e04973183637 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Jul 28 20:17:51.739160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 762/1677] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:51.862994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-39323d82-c6f6-4b52-bc01-aae316ca505f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:51.863594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-39323d82-c6f6-4b52-bc01-aae316ca505f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:51.870024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39323d82-c6f6-4b52-bc01-aae316ca505f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:51.870519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39323d82-c6f6-4b52-bc01-aae316ca505f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:51.871593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39323d82-c6f6-4b52-bc01-aae316ca505f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:51.872071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39323d82-c6f6-4b52-bc01-aae316ca505f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:51.932744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-39323d82-c6f6-4b52-bc01-aae316ca505f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:51.940256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-39323d82-c6f6-4b52-bc01-aae316ca505f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081050 Jul 28 20:17:51.940839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 916/1678] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:51 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:52.750025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-da786e24-41ee-4f43-ade3-dc18162c0c92 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:52.752175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-da786e24-41ee-4f43-ade3-dc18162c0c92 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:52.758710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da786e24-41ee-4f43-ade3-dc18162c0c92 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:52.759151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da786e24-41ee-4f43-ade3-dc18162c0c92 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:52.759902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da786e24-41ee-4f43-ade3-dc18162c0c92 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:52.760357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da786e24-41ee-4f43-ade3-dc18162c0c92 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:52.777172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:17:52.790411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-da786e24-41ee-4f43-ade3-dc18162c0c92 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Jul 28 20:17:52.790947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 763/1679] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:52.961056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ed4df852-6a3c-4014-9c63-bec341403a5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:52.961697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ed4df852-6a3c-4014-9c63-bec341403a5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:52.968918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed4df852-6a3c-4014-9c63-bec341403a5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:52.969365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed4df852-6a3c-4014-9c63-bec341403a5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:52.970108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed4df852-6a3c-4014-9c63-bec341403a5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:52.970534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed4df852-6a3c-4014-9c63-bec341403a5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:53.033520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ed4df852-6a3c-4014-9c63-bec341403a5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:53.040963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ed4df852-6a3c-4014-9c63-bec341403a5b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083637 Jul 28 20:17:53.041511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 917/1680] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:52 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:53.803339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ef1bf18d-3548-4fe6-9074-b04f6bf2f708 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:53.805446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ef1bf18d-3548-4fe6-9074-b04f6bf2f708 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:53.813163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef1bf18d-3548-4fe6-9074-b04f6bf2f708 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:53.813611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef1bf18d-3548-4fe6-9074-b04f6bf2f708 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:53.814362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef1bf18d-3548-4fe6-9074-b04f6bf2f708 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:53.814791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef1bf18d-3548-4fe6-9074-b04f6bf2f708 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:53.843740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ef1bf18d-3548-4fe6-9074-b04f6bf2f708 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Jul 28 20:17:53.844276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 764/1681] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:54.062440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-50ec8cb7-d4d3-49bc-a370-1c2b21b48d71 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:54.063176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-50ec8cb7-d4d3-49bc-a370-1c2b21b48d71 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:54.071018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50ec8cb7-d4d3-49bc-a370-1c2b21b48d71 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:54.071461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50ec8cb7-d4d3-49bc-a370-1c2b21b48d71 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:54.072208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50ec8cb7-d4d3-49bc-a370-1c2b21b48d71 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:54.072660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-50ec8cb7-d4d3-49bc-a370-1c2b21b48d71 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:54.133134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-50ec8cb7-d4d3-49bc-a370-1c2b21b48d71 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:54.140623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-50ec8cb7-d4d3-49bc-a370-1c2b21b48d71 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083039 Jul 28 20:17:54.141178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 918/1682] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:54.856810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c6806c1b-28f2-4e1b-bc5a-154efbe96d2c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:54.859009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c6806c1b-28f2-4e1b-bc5a-154efbe96d2c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:54.865452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c6806c1b-28f2-4e1b-bc5a-154efbe96d2c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:54.865897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c6806c1b-28f2-4e1b-bc5a-154efbe96d2c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:54.866642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c6806c1b-28f2-4e1b-bc5a-154efbe96d2c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:54.867069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c6806c1b-28f2-4e1b-bc5a-154efbe96d2c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:54.895765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c6806c1b-28f2-4e1b-bc5a-154efbe96d2c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043837 Jul 28 20:17:54.896301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 765/1683] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:55.161988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c9dd8491-a8ca-4c3d-91a8-e24f29036745 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:55.162509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c9dd8491-a8ca-4c3d-91a8-e24f29036745 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:55.170146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9dd8491-a8ca-4c3d-91a8-e24f29036745 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:55.170588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9dd8491-a8ca-4c3d-91a8-e24f29036745 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:55.171336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9dd8491-a8ca-4c3d-91a8-e24f29036745 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:55.171761 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9dd8491-a8ca-4c3d-91a8-e24f29036745 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:55.233184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c9dd8491-a8ca-4c3d-91a8-e24f29036745 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:55.240453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c9dd8491-a8ca-4c3d-91a8-e24f29036745 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082413 Jul 28 20:17:55.241033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 919/1684] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:55.908115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-60150d81-421d-4406-af03-4e5cf2e642eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:55.910286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-60150d81-421d-4406-af03-4e5cf2e642eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:55.916708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60150d81-421d-4406-af03-4e5cf2e642eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:55.917150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60150d81-421d-4406-af03-4e5cf2e642eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:55.917903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60150d81-421d-4406-af03-4e5cf2e642eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:55.918325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60150d81-421d-4406-af03-4e5cf2e642eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:55.946559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-60150d81-421d-4406-af03-4e5cf2e642eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042642 Jul 28 20:17:55.947093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 766/1685] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:55 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:56.261662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-05eced64-db3d-475d-beab-626231e8eaca tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:56.262415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-05eced64-db3d-475d-beab-626231e8eaca tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:56.268855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05eced64-db3d-475d-beab-626231e8eaca tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:56.269304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05eced64-db3d-475d-beab-626231e8eaca tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:56.270064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05eced64-db3d-475d-beab-626231e8eaca tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:56.270495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05eced64-db3d-475d-beab-626231e8eaca tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:56.333827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-05eced64-db3d-475d-beab-626231e8eaca tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:56.342213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-05eced64-db3d-475d-beab-626231e8eaca tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084942 Jul 28 20:17:56.342771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 920/1686] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:56 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:56.959840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d4aa361f-901f-4665-9f56-2a0d0f861a0e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:56.962054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d4aa361f-901f-4665-9f56-2a0d0f861a0e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:56.968833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4aa361f-901f-4665-9f56-2a0d0f861a0e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:56.969286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4aa361f-901f-4665-9f56-2a0d0f861a0e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:56.970051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4aa361f-901f-4665-9f56-2a0d0f861a0e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:56.970489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4aa361f-901f-4665-9f56-2a0d0f861a0e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:56.999847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d4aa361f-901f-4665-9f56-2a0d0f861a0e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Jul 28 20:17:57.000404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 767/1687] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:57.362676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-575e51b3-79b5-4ae2-9a40-737ad8500785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:57.363292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-575e51b3-79b5-4ae2-9a40-737ad8500785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:57.369834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-575e51b3-79b5-4ae2-9a40-737ad8500785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:57.370280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-575e51b3-79b5-4ae2-9a40-737ad8500785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:57.371044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-575e51b3-79b5-4ae2-9a40-737ad8500785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:57.371480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-575e51b3-79b5-4ae2-9a40-737ad8500785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:57.437143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-575e51b3-79b5-4ae2-9a40-737ad8500785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:57.444618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-575e51b3-79b5-4ae2-9a40-737ad8500785 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085782 Jul 28 20:17:57.445197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 921/1688] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:58.011808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ba39139b-7f72-42eb-b039-a7244141ca72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:58.014026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ba39139b-7f72-42eb-b039-a7244141ca72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:58.020521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba39139b-7f72-42eb-b039-a7244141ca72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:58.021017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba39139b-7f72-42eb-b039-a7244141ca72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:58.021780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba39139b-7f72-42eb-b039-a7244141ca72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:58.022215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba39139b-7f72-42eb-b039-a7244141ca72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:58.051871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ba39139b-7f72-42eb-b039-a7244141ca72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Jul 28 20:17:58.052410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 768/1689] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:58 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:58.467029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d996054b-53b9-4b13-8d27-11137deecf15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:58.467637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d996054b-53b9-4b13-8d27-11137deecf15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:58.474128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d996054b-53b9-4b13-8d27-11137deecf15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:58.474574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d996054b-53b9-4b13-8d27-11137deecf15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:58.475322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d996054b-53b9-4b13-8d27-11137deecf15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:58.475751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d996054b-53b9-4b13-8d27-11137deecf15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:58.536966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d996054b-53b9-4b13-8d27-11137deecf15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:58.544850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d996054b-53b9-4b13-8d27-11137deecf15 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082626 Jul 28 20:17:58.545403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 922/1690] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:58 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:17:59.065010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-885433ef-9240-4429-9655-0631b2754fe1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:59.067141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-885433ef-9240-4429-9655-0631b2754fe1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:59.073721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-885433ef-9240-4429-9655-0631b2754fe1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:59.074163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-885433ef-9240-4429-9655-0631b2754fe1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:59.074916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-885433ef-9240-4429-9655-0631b2754fe1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:59.075344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-885433ef-9240-4429-9655-0631b2754fe1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:59.103232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-885433ef-9240-4429-9655-0631b2754fe1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042249 Jul 28 20:17:59.103768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 769/1691] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:17:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:17:59.565217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-776ad663-7895-42b5-95ec-fdc68ea9db28 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:17:59.565819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-776ad663-7895-42b5-95ec-fdc68ea9db28 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:17:59.572202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-776ad663-7895-42b5-95ec-fdc68ea9db28 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:59.572674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-776ad663-7895-42b5-95ec-fdc68ea9db28 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:59.573425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-776ad663-7895-42b5-95ec-fdc68ea9db28 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:17:59.573894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-776ad663-7895-42b5-95ec-fdc68ea9db28 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:17:59.634133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-776ad663-7895-42b5-95ec-fdc68ea9db28 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:17:59.641699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-776ad663-7895-42b5-95ec-fdc68ea9db28 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080352 Jul 28 20:17:59.642248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 923/1692] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:17:59 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:00.115359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-43f593a2-f04f-4b31-8a08-0375176220e6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:00.117543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-43f593a2-f04f-4b31-8a08-0375176220e6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:00.124181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43f593a2-f04f-4b31-8a08-0375176220e6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:00.124668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43f593a2-f04f-4b31-8a08-0375176220e6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:00.125417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43f593a2-f04f-4b31-8a08-0375176220e6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:00.125845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43f593a2-f04f-4b31-8a08-0375176220e6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:00.154262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-43f593a2-f04f-4b31-8a08-0375176220e6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 Jul 28 20:18:00.154795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 770/1693] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:00.663220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d7de88b4-176e-4253-8a16-205937707eb7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:00.663855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d7de88b4-176e-4253-8a16-205937707eb7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:00.670369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7de88b4-176e-4253-8a16-205937707eb7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:00.670811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7de88b4-176e-4253-8a16-205937707eb7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:00.671556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7de88b4-176e-4253-8a16-205937707eb7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:00.671977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d7de88b4-176e-4253-8a16-205937707eb7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:00.732835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d7de88b4-176e-4253-8a16-205937707eb7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:00.740355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d7de88b4-176e-4253-8a16-205937707eb7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081037 Jul 28 20:18:00.740956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 924/1694] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:00 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:01.169229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-423f924b-f39d-4158-8df6-7cfd25eebdfd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:01.171432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-423f924b-f39d-4158-8df6-7cfd25eebdfd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:01.177786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-423f924b-f39d-4158-8df6-7cfd25eebdfd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:01.178240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-423f924b-f39d-4158-8df6-7cfd25eebdfd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:01.179013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-423f924b-f39d-4158-8df6-7cfd25eebdfd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:01.179445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-423f924b-f39d-4158-8df6-7cfd25eebdfd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:01.212526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-423f924b-f39d-4158-8df6-7cfd25eebdfd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049564 Jul 28 20:18:01.213115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 771/1695] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:01.761649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c702ae55-c889-42f3-bfe9-66321f2ae624 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:01.762247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c702ae55-c889-42f3-bfe9-66321f2ae624 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:01.768785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c702ae55-c889-42f3-bfe9-66321f2ae624 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:01.769233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c702ae55-c889-42f3-bfe9-66321f2ae624 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:01.769983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c702ae55-c889-42f3-bfe9-66321f2ae624 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:01.770417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c702ae55-c889-42f3-bfe9-66321f2ae624 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:01.833961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c702ae55-c889-42f3-bfe9-66321f2ae624 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:01.841658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c702ae55-c889-42f3-bfe9-66321f2ae624 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084745 Jul 28 20:18:01.842212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 925/1696] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:02.225992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2a858963-39dc-406b-b4b5-bb5f0718d1a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:02.228131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2a858963-39dc-406b-b4b5-bb5f0718d1a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:02.234586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a858963-39dc-406b-b4b5-bb5f0718d1a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:02.235026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a858963-39dc-406b-b4b5-bb5f0718d1a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:02.235772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a858963-39dc-406b-b4b5-bb5f0718d1a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:02.236204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a858963-39dc-406b-b4b5-bb5f0718d1a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:02.265137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2a858963-39dc-406b-b4b5-bb5f0718d1a7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043194 Jul 28 20:18:02.265678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 772/1697] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:02 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:02.862243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8680a91b-6cf0-4bc3-b92e-c628c070a1d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:02.863335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8680a91b-6cf0-4bc3-b92e-c628c070a1d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:02.870734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8680a91b-6cf0-4bc3-b92e-c628c070a1d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:02.871202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8680a91b-6cf0-4bc3-b92e-c628c070a1d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:02.872344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8680a91b-6cf0-4bc3-b92e-c628c070a1d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:02.872815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8680a91b-6cf0-4bc3-b92e-c628c070a1d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:02.890745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:02.935254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8680a91b-6cf0-4bc3-b92e-c628c070a1d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:02.942606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8680a91b-6cf0-4bc3-b92e-c628c070a1d3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084399 Jul 28 20:18:02.943160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 926/1698] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:03.278581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c656d7d1-6a78-43a7-88c0-2d04e1f0bc4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:03.280756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c656d7d1-6a78-43a7-88c0-2d04e1f0bc4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:03.287551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c656d7d1-6a78-43a7-88c0-2d04e1f0bc4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:03.287994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c656d7d1-6a78-43a7-88c0-2d04e1f0bc4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:03.288804 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c656d7d1-6a78-43a7-88c0-2d04e1f0bc4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:03.289240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c656d7d1-6a78-43a7-88c0-2d04e1f0bc4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:03.319047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c656d7d1-6a78-43a7-88c0-2d04e1f0bc4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Jul 28 20:18:03.319587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 773/1699] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:03.916134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1bbd54ae-f01c-409e-b431-49cfe11a3fed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:03.916646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1bbd54ae-f01c-409e-b431-49cfe11a3fed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:03.923707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bbd54ae-f01c-409e-b431-49cfe11a3fed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:03.924154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bbd54ae-f01c-409e-b431-49cfe11a3fed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:03.924954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bbd54ae-f01c-409e-b431-49cfe11a3fed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:03.925389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bbd54ae-f01c-409e-b431-49cfe11a3fed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:03.950272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1bbd54ae-f01c-409e-b431-49cfe11a3fed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Going to try to terminate instance {{(pid=117969) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:18:03.963071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b1f9353-391c-41ea-98cc-e2062cac41ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:03.963676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b1f9353-391c-41ea-98cc-e2062cac41ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:03.970855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b1f9353-391c-41ea-98cc-e2062cac41ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:03.971358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b1f9353-391c-41ea-98cc-e2062cac41ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:03.972148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b1f9353-391c-41ea-98cc-e2062cac41ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:03.972611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b1f9353-391c-41ea-98cc-e2062cac41ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:04.038284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b1f9353-391c-41ea-98cc-e2062cac41ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:04.040267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1bbd54ae-f01c-409e-b431-49cfe11a3fed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 204 len: 0 microversion: 2.1 time: 0.127682 Jul 28 20:18:04.044707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 927/1700] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:18:03 2022] DELETE /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:18:04.050431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e6494602-a32f-4b30-ad6a-3c0cdff3c2a4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:04.051230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e6494602-a32f-4b30-ad6a-3c0cdff3c2a4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:04.051347 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b1f9353-391c-41ea-98cc-e2062cac41ab tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.091933 Jul 28 20:18:04.051871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 774/1701] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:03 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:04.057179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6494602-a32f-4b30-ad6a-3c0cdff3c2a4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:04.057618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6494602-a32f-4b30-ad6a-3c0cdff3c2a4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:04.058521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6494602-a32f-4b30-ad6a-3c0cdff3c2a4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:04.059027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6494602-a32f-4b30-ad6a-3c0cdff3c2a4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:04.189885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e6494602-a32f-4b30-ad6a-3c0cdff3c2a4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:04.197955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e6494602-a32f-4b30-ad6a-3c0cdff3c2a4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151823 Jul 28 20:18:04.199010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 928/1702] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:04 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:04.331108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-43c4f4c3-3019-4574-9ae4-c797689a1c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:04.333265 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-43c4f4c3-3019-4574-9ae4-c797689a1c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:04.340411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43c4f4c3-3019-4574-9ae4-c797689a1c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:04.340877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43c4f4c3-3019-4574-9ae4-c797689a1c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:04.341629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43c4f4c3-3019-4574-9ae4-c797689a1c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:04.342056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43c4f4c3-3019-4574-9ae4-c797689a1c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:04.370654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-43c4f4c3-3019-4574-9ae4-c797689a1c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 Jul 28 20:18:04.371180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 775/1703] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:05.072309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e71e2afb-5982-49b6-8016-286f5627f066 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:05.072942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e71e2afb-5982-49b6-8016-286f5627f066 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:05.079567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e71e2afb-5982-49b6-8016-286f5627f066 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:05.080006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e71e2afb-5982-49b6-8016-286f5627f066 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:05.080775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e71e2afb-5982-49b6-8016-286f5627f066 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:05.081201 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e71e2afb-5982-49b6-8016-286f5627f066 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:05.141112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e71e2afb-5982-49b6-8016-286f5627f066 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:05.148566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e71e2afb-5982-49b6-8016-286f5627f066 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080059 Jul 28 20:18:05.149130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 929/1704] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:05 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:05.219895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8e8460b5-7393-46c5-8233-2cacd965fc60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:05.220516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8e8460b5-7393-46c5-8233-2cacd965fc60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:05.226848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8e8460b5-7393-46c5-8233-2cacd965fc60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:05.227298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8e8460b5-7393-46c5-8233-2cacd965fc60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:05.228057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8e8460b5-7393-46c5-8233-2cacd965fc60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:05.228490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8e8460b5-7393-46c5-8233-2cacd965fc60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:05.383677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8e8460b5-7393-46c5-8233-2cacd965fc60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:05.384436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b73ef4be-91bf-4416-a459-8dea15b756bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:05.387575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b73ef4be-91bf-4416-a459-8dea15b756bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:05.395581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8e8460b5-7393-46c5-8233-2cacd965fc60 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.179613 Jul 28 20:18:05.396164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 776/1705] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:05 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:05.404934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b73ef4be-91bf-4416-a459-8dea15b756bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:05.405377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b73ef4be-91bf-4416-a459-8dea15b756bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:05.406144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b73ef4be-91bf-4416-a459-8dea15b756bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:05.406845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b73ef4be-91bf-4416-a459-8dea15b756bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:05.441144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b73ef4be-91bf-4416-a459-8dea15b756bb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060964 Jul 28 20:18:05.441700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 930/1706] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:05.810680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:18:05.810926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:18:06.177113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dface1e0-945f-44fb-ac22-7d6c20e62f05 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:06.177721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dface1e0-945f-44fb-ac22-7d6c20e62f05 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:06.184478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dface1e0-945f-44fb-ac22-7d6c20e62f05 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:06.184945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dface1e0-945f-44fb-ac22-7d6c20e62f05 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:06.185696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dface1e0-945f-44fb-ac22-7d6c20e62f05 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:06.186153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dface1e0-945f-44fb-ac22-7d6c20e62f05 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:06.249772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dface1e0-945f-44fb-ac22-7d6c20e62f05 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:06.257255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dface1e0-945f-44fb-ac22-7d6c20e62f05 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083984 Jul 28 20:18:06.257803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 777/1707] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:06 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:06.419367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9814faf6-0c81-4f7a-9529-707fc9f6c237 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:06.419915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9814faf6-0c81-4f7a-9529-707fc9f6c237 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:06.426287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9814faf6-0c81-4f7a-9529-707fc9f6c237 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:06.426730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9814faf6-0c81-4f7a-9529-707fc9f6c237 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:06.427480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9814faf6-0c81-4f7a-9529-707fc9f6c237 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:06.427904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9814faf6-0c81-4f7a-9529-707fc9f6c237 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:06.453992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-be03c43c-1c73-4f84-aa5f-db81e0034733 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:06.456144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-be03c43c-1c73-4f84-aa5f-db81e0034733 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:06.462619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-be03c43c-1c73-4f84-aa5f-db81e0034733 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:06.463071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-be03c43c-1c73-4f84-aa5f-db81e0034733 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:06.463835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-be03c43c-1c73-4f84-aa5f-db81e0034733 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:06.464301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-be03c43c-1c73-4f84-aa5f-db81e0034733 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:06.494632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-be03c43c-1c73-4f84-aa5f-db81e0034733 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044635 Jul 28 20:18:06.495190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 778/1708] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:06.557595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9814faf6-0c81-4f7a-9529-707fc9f6c237 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:06.566399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9814faf6-0c81-4f7a-9529-707fc9f6c237 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150936 Jul 28 20:18:06.566954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 931/1709] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:06 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:07.279184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5387c74d-8be1-42b9-a386-00a5ecc2397e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:07.279795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5387c74d-8be1-42b9-a386-00a5ecc2397e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:07.286196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5387c74d-8be1-42b9-a386-00a5ecc2397e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:07.286648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5387c74d-8be1-42b9-a386-00a5ecc2397e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:07.287409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5387c74d-8be1-42b9-a386-00a5ecc2397e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:07.287842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5387c74d-8be1-42b9-a386-00a5ecc2397e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:07.349139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5387c74d-8be1-42b9-a386-00a5ecc2397e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:07.356498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5387c74d-8be1-42b9-a386-00a5ecc2397e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081803 Jul 28 20:18:07.357132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 779/1710] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:07 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:07.508283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5f3bf70f-ad4b-48cd-9b46-c121f315143f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:07.510551 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5f3bf70f-ad4b-48cd-9b46-c121f315143f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:07.520869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f3bf70f-ad4b-48cd-9b46-c121f315143f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:07.521317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f3bf70f-ad4b-48cd-9b46-c121f315143f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:07.522081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f3bf70f-ad4b-48cd-9b46-c121f315143f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:07.522544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f3bf70f-ad4b-48cd-9b46-c121f315143f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:07.555871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5f3bf70f-ad4b-48cd-9b46-c121f315143f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052346 Jul 28 20:18:07.556421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 932/1711] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:07.587630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eebd2adc-f2f3-436e-84fe-9e98f65d999a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:07.588242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eebd2adc-f2f3-436e-84fe-9e98f65d999a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:07.594762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eebd2adc-f2f3-436e-84fe-9e98f65d999a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:07.595209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eebd2adc-f2f3-436e-84fe-9e98f65d999a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:07.595957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eebd2adc-f2f3-436e-84fe-9e98f65d999a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:07.596381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eebd2adc-f2f3-436e-84fe-9e98f65d999a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:07.600285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:07.724248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-eebd2adc-f2f3-436e-84fe-9e98f65d999a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:07.732114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eebd2adc-f2f3-436e-84fe-9e98f65d999a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148508 Jul 28 20:18:07.732687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 780/1712] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:07 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:08.377272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-86a1d48a-5689-4abf-94c1-c17df863ce2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:08.377872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-86a1d48a-5689-4abf-94c1-c17df863ce2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:08.383811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86a1d48a-5689-4abf-94c1-c17df863ce2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:08.384252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86a1d48a-5689-4abf-94c1-c17df863ce2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:08.385015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86a1d48a-5689-4abf-94c1-c17df863ce2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:08.385438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86a1d48a-5689-4abf-94c1-c17df863ce2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:08.446350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-86a1d48a-5689-4abf-94c1-c17df863ce2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:08.453855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-86a1d48a-5689-4abf-94c1-c17df863ce2f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080396 Jul 28 20:18:08.454407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 933/1713] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:08 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:08.568772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f1763c8b-79cc-4a79-b79d-968d01ad989b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:08.570937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f1763c8b-79cc-4a79-b79d-968d01ad989b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:08.577166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1763c8b-79cc-4a79-b79d-968d01ad989b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:08.577622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1763c8b-79cc-4a79-b79d-968d01ad989b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:08.578386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1763c8b-79cc-4a79-b79d-968d01ad989b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:08.578825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1763c8b-79cc-4a79-b79d-968d01ad989b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:08.609113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f1763c8b-79cc-4a79-b79d-968d01ad989b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Jul 28 20:18:08.609749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 781/1714] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:08.754222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-847be877-16ff-43a9-b629-4fc6e7ff3236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:08.754745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-847be877-16ff-43a9-b629-4fc6e7ff3236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:08.761710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-847be877-16ff-43a9-b629-4fc6e7ff3236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:08.762252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-847be877-16ff-43a9-b629-4fc6e7ff3236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:08.763070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-847be877-16ff-43a9-b629-4fc6e7ff3236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:08.763508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-847be877-16ff-43a9-b629-4fc6e7ff3236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:08.889516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-847be877-16ff-43a9-b629-4fc6e7ff3236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:08.897441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-847be877-16ff-43a9-b629-4fc6e7ff3236 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147164 Jul 28 20:18:08.897997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 934/1715] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:08 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:09.474991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8812dd45-90ba-414d-8472-3a7bbb7b8866 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:09.475520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8812dd45-90ba-414d-8472-3a7bbb7b8866 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:09.482251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8812dd45-90ba-414d-8472-3a7bbb7b8866 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:09.482705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8812dd45-90ba-414d-8472-3a7bbb7b8866 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:09.483461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8812dd45-90ba-414d-8472-3a7bbb7b8866 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:09.483896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8812dd45-90ba-414d-8472-3a7bbb7b8866 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:09.551686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8812dd45-90ba-414d-8472-3a7bbb7b8866 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:09.559903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8812dd45-90ba-414d-8472-3a7bbb7b8866 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.088945 Jul 28 20:18:09.560452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 782/1716] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:09 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:09.621973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-05497453-1532-4374-afea-2e037167740d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:09.624089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-05497453-1532-4374-afea-2e037167740d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:09.630162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05497453-1532-4374-afea-2e037167740d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:09.630605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05497453-1532-4374-afea-2e037167740d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:09.631348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05497453-1532-4374-afea-2e037167740d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:09.631772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05497453-1532-4374-afea-2e037167740d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:09.661927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-05497453-1532-4374-afea-2e037167740d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Jul 28 20:18:09.662466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 935/1717] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:09 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:09.920302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-286162ae-1828-4e5a-8251-0c26d2996117 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:09.920960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-286162ae-1828-4e5a-8251-0c26d2996117 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:09.927384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-286162ae-1828-4e5a-8251-0c26d2996117 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:09.927830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-286162ae-1828-4e5a-8251-0c26d2996117 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:09.928614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-286162ae-1828-4e5a-8251-0c26d2996117 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:09.929048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-286162ae-1828-4e5a-8251-0c26d2996117 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:10.054790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-286162ae-1828-4e5a-8251-0c26d2996117 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:10.062902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-286162ae-1828-4e5a-8251-0c26d2996117 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147190 Jul 28 20:18:10.063461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 783/1718] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:09 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:10.580202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-935f308a-9ed8-4b67-98fd-182ede1e1ff0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:10.580834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-935f308a-9ed8-4b67-98fd-182ede1e1ff0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:10.587375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-935f308a-9ed8-4b67-98fd-182ede1e1ff0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:10.587813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-935f308a-9ed8-4b67-98fd-182ede1e1ff0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:10.588584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-935f308a-9ed8-4b67-98fd-182ede1e1ff0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:10.589684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-935f308a-9ed8-4b67-98fd-182ede1e1ff0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:10.649003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-935f308a-9ed8-4b67-98fd-182ede1e1ff0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:10.657156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-935f308a-9ed8-4b67-98fd-182ede1e1ff0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080768 Jul 28 20:18:10.657706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 936/1719] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:10 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:10.674581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ea198977-431c-4c47-9c15-5458eb5f0626 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:10.676757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ea198977-431c-4c47-9c15-5458eb5f0626 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:10.682716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea198977-431c-4c47-9c15-5458eb5f0626 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:10.683346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea198977-431c-4c47-9c15-5458eb5f0626 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:10.684103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea198977-431c-4c47-9c15-5458eb5f0626 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:10.684531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea198977-431c-4c47-9c15-5458eb5f0626 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:10.712321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ea198977-431c-4c47-9c15-5458eb5f0626 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041647 Jul 28 20:18:10.712886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 784/1720] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:11.084440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-01f42d0d-8a01-4249-9195-1c0c5d187a2c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:11.085082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-01f42d0d-8a01-4249-9195-1c0c5d187a2c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:11.091645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-01f42d0d-8a01-4249-9195-1c0c5d187a2c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:11.092094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-01f42d0d-8a01-4249-9195-1c0c5d187a2c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:11.092888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-01f42d0d-8a01-4249-9195-1c0c5d187a2c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:11.093317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-01f42d0d-8a01-4249-9195-1c0c5d187a2c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:11.220393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-01f42d0d-8a01-4249-9195-1c0c5d187a2c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:11.228379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-01f42d0d-8a01-4249-9195-1c0c5d187a2c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147800 Jul 28 20:18:11.228956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 937/1721] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:11 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:11.678589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-41516614-9a71-474f-a899-eb782e0ddb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:11.679246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-41516614-9a71-474f-a899-eb782e0ddb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:11.685626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41516614-9a71-474f-a899-eb782e0ddb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:11.686067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41516614-9a71-474f-a899-eb782e0ddb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:11.686807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41516614-9a71-474f-a899-eb782e0ddb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:11.687233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41516614-9a71-474f-a899-eb782e0ddb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:11.725146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6c562a5f-6b4c-4252-8d71-79e4bbd74305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:11.727452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6c562a5f-6b4c-4252-8d71-79e4bbd74305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:11.734216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c562a5f-6b4c-4252-8d71-79e4bbd74305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:11.734665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c562a5f-6b4c-4252-8d71-79e4bbd74305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:11.735436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c562a5f-6b4c-4252-8d71-79e4bbd74305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:11.735870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c562a5f-6b4c-4252-8d71-79e4bbd74305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:11.748467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-41516614-9a71-474f-a899-eb782e0ddb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:11.755954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-41516614-9a71-474f-a899-eb782e0ddb6f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081185 Jul 28 20:18:11.756563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 785/1722] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:11 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:11.765401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6c562a5f-6b4c-4252-8d71-79e4bbd74305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Jul 28 20:18:11.765951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 938/1723] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:12.249536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fd1d16d5-4759-44c4-8893-d0f1e5eb8017 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:12.250148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fd1d16d5-4759-44c4-8893-d0f1e5eb8017 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:12.256143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd1d16d5-4759-44c4-8893-d0f1e5eb8017 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:12.256617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd1d16d5-4759-44c4-8893-d0f1e5eb8017 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:12.257380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd1d16d5-4759-44c4-8893-d0f1e5eb8017 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:12.257812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fd1d16d5-4759-44c4-8893-d0f1e5eb8017 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:12.382078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fd1d16d5-4759-44c4-8893-d0f1e5eb8017 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:12.390112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fd1d16d5-4759-44c4-8893-d0f1e5eb8017 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.144427 Jul 28 20:18:12.390671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 786/1724] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:12 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:12.778449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ef5684cf-5fbd-4319-b4e3-bf0bb14b7607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:12.779026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9b33513c-5d59-4a1b-912a-932ce9da67b7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:12.779507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9b33513c-5d59-4a1b-912a-932ce9da67b7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:12.780616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ef5684cf-5fbd-4319-b4e3-bf0bb14b7607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:12.785796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b33513c-5d59-4a1b-912a-932ce9da67b7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:12.786240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b33513c-5d59-4a1b-912a-932ce9da67b7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:12.786991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b33513c-5d59-4a1b-912a-932ce9da67b7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:12.787302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef5684cf-5fbd-4319-b4e3-bf0bb14b7607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:12.787434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b33513c-5d59-4a1b-912a-932ce9da67b7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:12.787749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef5684cf-5fbd-4319-b4e3-bf0bb14b7607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:12.788504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef5684cf-5fbd-4319-b4e3-bf0bb14b7607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:12.788960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef5684cf-5fbd-4319-b4e3-bf0bb14b7607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:12.819716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ef5684cf-5fbd-4319-b4e3-bf0bb14b7607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Jul 28 20:18:12.820268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 939/1725] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:12.852942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9b33513c-5d59-4a1b-912a-932ce9da67b7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:12.861437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9b33513c-5d59-4a1b-912a-932ce9da67b7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087494 Jul 28 20:18:12.861988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 787/1726] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:12 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:13.411444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3e8cfd7a-4f13-47f0-ba9d-3410e0e3831f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:13.412049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3e8cfd7a-4f13-47f0-ba9d-3410e0e3831f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:13.418704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e8cfd7a-4f13-47f0-ba9d-3410e0e3831f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:13.419120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e8cfd7a-4f13-47f0-ba9d-3410e0e3831f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:13.419884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e8cfd7a-4f13-47f0-ba9d-3410e0e3831f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:13.420313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e8cfd7a-4f13-47f0-ba9d-3410e0e3831f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:13.545734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3e8cfd7a-4f13-47f0-ba9d-3410e0e3831f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:13.553597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3e8cfd7a-4f13-47f0-ba9d-3410e0e3831f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146039 Jul 28 20:18:13.554153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 940/1727] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:13 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:13.832227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-81614d54-4cd0-4bbf-80cf-aff36139cb40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:13.834470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-81614d54-4cd0-4bbf-80cf-aff36139cb40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:13.841478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81614d54-4cd0-4bbf-80cf-aff36139cb40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:13.841921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81614d54-4cd0-4bbf-80cf-aff36139cb40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:13.842668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81614d54-4cd0-4bbf-80cf-aff36139cb40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:13.843094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81614d54-4cd0-4bbf-80cf-aff36139cb40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:13.871390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-81614d54-4cd0-4bbf-80cf-aff36139cb40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043099 Jul 28 20:18:13.871917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 788/1728] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:13.881983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ddd69fc4-5f7a-457f-829d-9b0b0ce665cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:13.882594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ddd69fc4-5f7a-457f-829d-9b0b0ce665cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:13.890142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddd69fc4-5f7a-457f-829d-9b0b0ce665cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:13.890585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddd69fc4-5f7a-457f-829d-9b0b0ce665cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:13.891334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddd69fc4-5f7a-457f-829d-9b0b0ce665cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:13.891765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddd69fc4-5f7a-457f-829d-9b0b0ce665cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:13.909721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:13.955394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ddd69fc4-5f7a-457f-829d-9b0b0ce665cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:13.962879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ddd69fc4-5f7a-457f-829d-9b0b0ce665cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084698 Jul 28 20:18:13.963420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 941/1729] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:13 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:14.574987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e6b864d6-262f-4a1d-b2a9-253ce11200a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:14.575609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e6b864d6-262f-4a1d-b2a9-253ce11200a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:14.581966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6b864d6-262f-4a1d-b2a9-253ce11200a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:14.582416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6b864d6-262f-4a1d-b2a9-253ce11200a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:14.583177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6b864d6-262f-4a1d-b2a9-253ce11200a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:14.583611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6b864d6-262f-4a1d-b2a9-253ce11200a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:14.717814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e6b864d6-262f-4a1d-b2a9-253ce11200a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:14.725667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e6b864d6-262f-4a1d-b2a9-253ce11200a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.154557 Jul 28 20:18:14.726224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 789/1730] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:14 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:14.883312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1eed2a48-c3a1-481d-aa1d-0f0cf535569a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:14.885450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1eed2a48-c3a1-481d-aa1d-0f0cf535569a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:14.891959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1eed2a48-c3a1-481d-aa1d-0f0cf535569a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:14.892399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1eed2a48-c3a1-481d-aa1d-0f0cf535569a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:14.893185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1eed2a48-c3a1-481d-aa1d-0f0cf535569a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:14.893612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1eed2a48-c3a1-481d-aa1d-0f0cf535569a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:14.922888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1eed2a48-c3a1-481d-aa1d-0f0cf535569a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043524 Jul 28 20:18:14.923434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 942/1731] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:14.983675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-46c08cd7-7ece-4064-a846-fd12bb10a0bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:14.984286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-46c08cd7-7ece-4064-a846-fd12bb10a0bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:14.990741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46c08cd7-7ece-4064-a846-fd12bb10a0bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:14.991185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46c08cd7-7ece-4064-a846-fd12bb10a0bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:14.991944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46c08cd7-7ece-4064-a846-fd12bb10a0bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:14.992372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-46c08cd7-7ece-4064-a846-fd12bb10a0bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:15.056087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-46c08cd7-7ece-4064-a846-fd12bb10a0bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:15.064211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-46c08cd7-7ece-4064-a846-fd12bb10a0bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085077 Jul 28 20:18:15.064807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 790/1732] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:15.747263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7c7b89d4-93ac-4649-badb-6f811e45a8fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:15.747877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7c7b89d4-93ac-4649-badb-6f811e45a8fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:15.753965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c7b89d4-93ac-4649-badb-6f811e45a8fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:15.754408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c7b89d4-93ac-4649-badb-6f811e45a8fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:15.755155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c7b89d4-93ac-4649-badb-6f811e45a8fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:15.755588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c7b89d4-93ac-4649-badb-6f811e45a8fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:15.881203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7c7b89d4-93ac-4649-badb-6f811e45a8fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:15.889034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7c7b89d4-93ac-4649-badb-6f811e45a8fb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.145731 Jul 28 20:18:15.889618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 943/1733] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:15 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:15.935601 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-028f6ac5-534a-4d1e-a987-9fb5975e2863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:15.937781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-028f6ac5-534a-4d1e-a987-9fb5975e2863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:15.943851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-028f6ac5-534a-4d1e-a987-9fb5975e2863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:15.944299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-028f6ac5-534a-4d1e-a987-9fb5975e2863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:15.945100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-028f6ac5-534a-4d1e-a987-9fb5975e2863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:15.945531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-028f6ac5-534a-4d1e-a987-9fb5975e2863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:15.974182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-028f6ac5-534a-4d1e-a987-9fb5975e2863 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Jul 28 20:18:15.974719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 791/1734] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:16.084218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-00de0ecf-d1ea-4b3c-998a-de69bb1bde30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:16.084866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-00de0ecf-d1ea-4b3c-998a-de69bb1bde30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:16.091652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00de0ecf-d1ea-4b3c-998a-de69bb1bde30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:16.092089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00de0ecf-d1ea-4b3c-998a-de69bb1bde30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:16.092867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00de0ecf-d1ea-4b3c-998a-de69bb1bde30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:16.093291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-00de0ecf-d1ea-4b3c-998a-de69bb1bde30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:16.158312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-00de0ecf-d1ea-4b3c-998a-de69bb1bde30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:16.165884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-00de0ecf-d1ea-4b3c-998a-de69bb1bde30 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085461 Jul 28 20:18:16.166441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 944/1735] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:16 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:16.911422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-97f69edd-5179-436f-b20c-04034840fae2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:16.912065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-97f69edd-5179-436f-b20c-04034840fae2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:16.914379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=70 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:16.919654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97f69edd-5179-436f-b20c-04034840fae2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:16.920120 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97f69edd-5179-436f-b20c-04034840fae2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:16.920895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97f69edd-5179-436f-b20c-04034840fae2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:16.921323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97f69edd-5179-436f-b20c-04034840fae2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:16.986702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-049f523b-a74c-442c-a179-f196bd8a0cde tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:16.988915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-049f523b-a74c-442c-a179-f196bd8a0cde tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:16.994959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-049f523b-a74c-442c-a179-f196bd8a0cde tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:16.996768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-049f523b-a74c-442c-a179-f196bd8a0cde tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:16.997543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-049f523b-a74c-442c-a179-f196bd8a0cde tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:16.997980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-049f523b-a74c-442c-a179-f196bd8a0cde tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:17.027091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-049f523b-a74c-442c-a179-f196bd8a0cde tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044355 Jul 28 20:18:17.027759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 945/1736] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:17.050972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-97f69edd-5179-436f-b20c-04034840fae2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:17.059615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-97f69edd-5179-436f-b20c-04034840fae2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152037 Jul 28 20:18:17.060163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 792/1737] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:16 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:17.187311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4c25a946-b0e4-4c0c-ade3-a1be86219d8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:17.187945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4c25a946-b0e4-4c0c-ade3-a1be86219d8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:17.194382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c25a946-b0e4-4c0c-ade3-a1be86219d8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:17.194922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c25a946-b0e4-4c0c-ade3-a1be86219d8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:17.195675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c25a946-b0e4-4c0c-ade3-a1be86219d8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:17.196102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c25a946-b0e4-4c0c-ade3-a1be86219d8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:17.256600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4c25a946-b0e4-4c0c-ade3-a1be86219d8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:17.264079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4c25a946-b0e4-4c0c-ade3-a1be86219d8f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081487 Jul 28 20:18:17.264655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 946/1738] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:17 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:18.038894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4c503cb7-bf90-4049-a170-9a3fa8a73b64 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:18.041094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4c503cb7-bf90-4049-a170-9a3fa8a73b64 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:18.048292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4c503cb7-bf90-4049-a170-9a3fa8a73b64 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:18.048772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4c503cb7-bf90-4049-a170-9a3fa8a73b64 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:18.049527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4c503cb7-bf90-4049-a170-9a3fa8a73b64 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:18.049956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4c503cb7-bf90-4049-a170-9a3fa8a73b64 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:18.078665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4c503cb7-bf90-4049-a170-9a3fa8a73b64 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043763 Jul 28 20:18:18.079204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 793/1739] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:18.082196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cbebc0ba-7015-41a8-b3d3-5fc32a7398ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:18.082811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cbebc0ba-7015-41a8-b3d3-5fc32a7398ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:18.084715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:18.090489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbebc0ba-7015-41a8-b3d3-5fc32a7398ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:18.090932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbebc0ba-7015-41a8-b3d3-5fc32a7398ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:18.091694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbebc0ba-7015-41a8-b3d3-5fc32a7398ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:18.092122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbebc0ba-7015-41a8-b3d3-5fc32a7398ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:18.221890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cbebc0ba-7015-41a8-b3d3-5fc32a7398ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:18.230515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cbebc0ba-7015-41a8-b3d3-5fc32a7398ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152238 Jul 28 20:18:18.231079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 947/1740] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:18 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:18.283745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8f845079-bc46-4b98-a162-4dc38948a738 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:18.284351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8f845079-bc46-4b98-a162-4dc38948a738 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:18.290373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f845079-bc46-4b98-a162-4dc38948a738 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:18.290756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f845079-bc46-4b98-a162-4dc38948a738 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:18.291501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f845079-bc46-4b98-a162-4dc38948a738 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:18.292087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f845079-bc46-4b98-a162-4dc38948a738 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:18.352015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8f845079-bc46-4b98-a162-4dc38948a738 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:18.360076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8f845079-bc46-4b98-a162-4dc38948a738 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080396 Jul 28 20:18:18.360645 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 794/1741] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:18 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:19.091582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2e386380-88a7-41de-a6ad-4bfb30c75d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:19.093791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2e386380-88a7-41de-a6ad-4bfb30c75d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:19.099787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e386380-88a7-41de-a6ad-4bfb30c75d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:19.100222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e386380-88a7-41de-a6ad-4bfb30c75d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:19.101231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e386380-88a7-41de-a6ad-4bfb30c75d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:19.101660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e386380-88a7-41de-a6ad-4bfb30c75d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:19.130497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2e386380-88a7-41de-a6ad-4bfb30c75d6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 Jul 28 20:18:19.131023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 948/1742] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:19.251752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bd2f9b58-fd16-4645-bf55-44db30a4581f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:19.252368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bd2f9b58-fd16-4645-bf55-44db30a4581f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:19.258829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bd2f9b58-fd16-4645-bf55-44db30a4581f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:19.259276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bd2f9b58-fd16-4645-bf55-44db30a4581f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:19.260035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bd2f9b58-fd16-4645-bf55-44db30a4581f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:19.260468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bd2f9b58-fd16-4645-bf55-44db30a4581f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:19.380504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-24ff89f7-f10e-4640-bbe4-80e325cd817b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:19.381055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-24ff89f7-f10e-4640-bbe4-80e325cd817b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:19.388394 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bd2f9b58-fd16-4645-bf55-44db30a4581f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:19.390939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-24ff89f7-f10e-4640-bbe4-80e325cd817b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:19.391505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-24ff89f7-f10e-4640-bbe4-80e325cd817b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:19.392499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-24ff89f7-f10e-4640-bbe4-80e325cd817b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:19.392981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-24ff89f7-f10e-4640-bbe4-80e325cd817b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:19.396612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bd2f9b58-fd16-4645-bf55-44db30a4581f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148717 Jul 28 20:18:19.397365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 795/1743] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:19 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:19.457196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-24ff89f7-f10e-4640-bbe4-80e325cd817b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:19.465350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-24ff89f7-f10e-4640-bbe4-80e325cd817b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.089638 Jul 28 20:18:19.465916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 949/1744] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:19 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:20.142094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ba3ab734-131c-4100-bdaf-657cce67369d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:20.144301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ba3ab734-131c-4100-bdaf-657cce67369d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:20.150337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba3ab734-131c-4100-bdaf-657cce67369d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:20.150788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba3ab734-131c-4100-bdaf-657cce67369d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:20.151668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba3ab734-131c-4100-bdaf-657cce67369d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:20.152111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba3ab734-131c-4100-bdaf-657cce67369d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:20.177664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:20.183412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ba3ab734-131c-4100-bdaf-657cce67369d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Jul 28 20:18:20.184095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 796/1745] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:20.419783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d8714774-6939-4b1e-bb26-f45711aec6bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:20.420297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d8714774-6939-4b1e-bb26-f45711aec6bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:20.426950 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d8714774-6939-4b1e-bb26-f45711aec6bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:20.427400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d8714774-6939-4b1e-bb26-f45711aec6bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:20.428153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d8714774-6939-4b1e-bb26-f45711aec6bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:20.428608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d8714774-6939-4b1e-bb26-f45711aec6bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:20.486995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c248b2e8-0e03-46b0-9f41-e929fa5721fb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:20.487700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c248b2e8-0e03-46b0-9f41-e929fa5721fb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:20.495936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c248b2e8-0e03-46b0-9f41-e929fa5721fb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:20.496381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c248b2e8-0e03-46b0-9f41-e929fa5721fb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:20.497173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c248b2e8-0e03-46b0-9f41-e929fa5721fb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:20.500029 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c248b2e8-0e03-46b0-9f41-e929fa5721fb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:20.569651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c248b2e8-0e03-46b0-9f41-e929fa5721fb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:20.577519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c248b2e8-0e03-46b0-9f41-e929fa5721fb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.094758 Jul 28 20:18:20.578089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 797/1746] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:20 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:20.590818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d8714774-6939-4b1e-bb26-f45711aec6bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:20.599806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d8714774-6939-4b1e-bb26-f45711aec6bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.184502 Jul 28 20:18:20.600387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 950/1747] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:20 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:21.195461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3cd2ebc5-3176-47b8-8e31-90821da4b9c6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:21.197662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3cd2ebc5-3176-47b8-8e31-90821da4b9c6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:21.203762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3cd2ebc5-3176-47b8-8e31-90821da4b9c6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:21.204207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3cd2ebc5-3176-47b8-8e31-90821da4b9c6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:21.204996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3cd2ebc5-3176-47b8-8e31-90821da4b9c6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:21.205425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3cd2ebc5-3176-47b8-8e31-90821da4b9c6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:21.234879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3cd2ebc5-3176-47b8-8e31-90821da4b9c6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043407 Jul 28 20:18:21.235425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 798/1748] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:21.598833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-27fdd531-2716-4cad-9f6d-bbde4b8426fa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:21.599440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-27fdd531-2716-4cad-9f6d-bbde4b8426fa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:21.606280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27fdd531-2716-4cad-9f6d-bbde4b8426fa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:21.606720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27fdd531-2716-4cad-9f6d-bbde4b8426fa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:21.607467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27fdd531-2716-4cad-9f6d-bbde4b8426fa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:21.607893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27fdd531-2716-4cad-9f6d-bbde4b8426fa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:21.622561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2857cc3a-9aea-459a-b87b-f756afc7d2e6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:21.623188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2857cc3a-9aea-459a-b87b-f756afc7d2e6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:21.629579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2857cc3a-9aea-459a-b87b-f756afc7d2e6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:21.630022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2857cc3a-9aea-459a-b87b-f756afc7d2e6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:21.630786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2857cc3a-9aea-459a-b87b-f756afc7d2e6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:21.631219 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2857cc3a-9aea-459a-b87b-f756afc7d2e6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:21.674266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-27fdd531-2716-4cad-9f6d-bbde4b8426fa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:21.682028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-27fdd531-2716-4cad-9f6d-bbde4b8426fa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087069 Jul 28 20:18:21.682662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 951/1749] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:21 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:21.773093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2857cc3a-9aea-459a-b87b-f756afc7d2e6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:21.781988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2857cc3a-9aea-459a-b87b-f756afc7d2e6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.163609 Jul 28 20:18:21.782547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 799/1750] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:21 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:22.247896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d5775701-f284-4c47-84c8-503443d92d65 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:22.250051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d5775701-f284-4c47-84c8-503443d92d65 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:22.256087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5775701-f284-4c47-84c8-503443d92d65 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:22.256535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5775701-f284-4c47-84c8-503443d92d65 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:22.257315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5775701-f284-4c47-84c8-503443d92d65 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:22.257747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5775701-f284-4c47-84c8-503443d92d65 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:22.289057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d5775701-f284-4c47-84c8-503443d92d65 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Jul 28 20:18:22.289641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 952/1751] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:22 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:22.705318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6295855f-a77d-4733-b85d-d15dfc224910 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:22.705934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6295855f-a77d-4733-b85d-d15dfc224910 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:22.712480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6295855f-a77d-4733-b85d-d15dfc224910 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:22.712956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6295855f-a77d-4733-b85d-d15dfc224910 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:22.714233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6295855f-a77d-4733-b85d-d15dfc224910 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:22.714674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6295855f-a77d-4733-b85d-d15dfc224910 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:22.777272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6295855f-a77d-4733-b85d-d15dfc224910 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:22.785003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6295855f-a77d-4733-b85d-d15dfc224910 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083480 Jul 28 20:18:22.785549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 800/1752] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:22 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:22.802988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4b021549-7021-45a4-8f9e-01dd42eb6894 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:22.803593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4b021549-7021-45a4-8f9e-01dd42eb6894 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:22.810791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b021549-7021-45a4-8f9e-01dd42eb6894 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:22.811233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b021549-7021-45a4-8f9e-01dd42eb6894 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:22.811972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b021549-7021-45a4-8f9e-01dd42eb6894 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:22.812393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4b021549-7021-45a4-8f9e-01dd42eb6894 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:23.089050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4b021549-7021-45a4-8f9e-01dd42eb6894 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:23.097030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4b021549-7021-45a4-8f9e-01dd42eb6894 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.297752 Jul 28 20:18:23.097584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 953/1753] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:22 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:23.301541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-42b79438-2721-48d3-bcf5-dfe351730381 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:23.303647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-42b79438-2721-48d3-bcf5-dfe351730381 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:23.310346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42b79438-2721-48d3-bcf5-dfe351730381 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:23.310788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42b79438-2721-48d3-bcf5-dfe351730381 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:23.311539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42b79438-2721-48d3-bcf5-dfe351730381 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:23.311969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42b79438-2721-48d3-bcf5-dfe351730381 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:23.340421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-42b79438-2721-48d3-bcf5-dfe351730381 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Jul 28 20:18:23.340985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 801/1754] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:23.805004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c9e9f0d3-eff0-494d-b197-472f1a2b60aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:23.805608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c9e9f0d3-eff0-494d-b197-472f1a2b60aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:23.812815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9e9f0d3-eff0-494d-b197-472f1a2b60aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:23.813265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9e9f0d3-eff0-494d-b197-472f1a2b60aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:23.814020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9e9f0d3-eff0-494d-b197-472f1a2b60aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:23.814451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9e9f0d3-eff0-494d-b197-472f1a2b60aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:23.878059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c9e9f0d3-eff0-494d-b197-472f1a2b60aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:23.885651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c9e9f0d3-eff0-494d-b197-472f1a2b60aa tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084479 Jul 28 20:18:23.886245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 954/1755] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:23 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:24.118977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aae4b99b-ec5e-42f6-860c-61922b80142a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:24.119615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aae4b99b-ec5e-42f6-860c-61922b80142a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:24.126292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aae4b99b-ec5e-42f6-860c-61922b80142a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:24.126733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aae4b99b-ec5e-42f6-860c-61922b80142a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:24.127479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aae4b99b-ec5e-42f6-860c-61922b80142a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:24.127908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aae4b99b-ec5e-42f6-860c-61922b80142a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:24.253980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aae4b99b-ec5e-42f6-860c-61922b80142a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:24.262922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aae4b99b-ec5e-42f6-860c-61922b80142a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147745 Jul 28 20:18:24.263489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 802/1756] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:24.352518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4a32fee8-b45e-4326-a3bf-15d6130d368c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:24.355264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4a32fee8-b45e-4326-a3bf-15d6130d368c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:24.361245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a32fee8-b45e-4326-a3bf-15d6130d368c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:24.361683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a32fee8-b45e-4326-a3bf-15d6130d368c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:24.362436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a32fee8-b45e-4326-a3bf-15d6130d368c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:24.362864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a32fee8-b45e-4326-a3bf-15d6130d368c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:24.391284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4a32fee8-b45e-4326-a3bf-15d6130d368c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042633 Jul 28 20:18:24.391748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 955/1757] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:24.907173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-12286079-2610-49d3-a81a-1b061a7f1817 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:24.907788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-12286079-2610-49d3-a81a-1b061a7f1817 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:24.914252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12286079-2610-49d3-a81a-1b061a7f1817 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:24.914700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12286079-2610-49d3-a81a-1b061a7f1817 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:24.915455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12286079-2610-49d3-a81a-1b061a7f1817 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:24.915887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12286079-2610-49d3-a81a-1b061a7f1817 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:24.980779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-12286079-2610-49d3-a81a-1b061a7f1817 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:24.988156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-12286079-2610-49d3-a81a-1b061a7f1817 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085142 Jul 28 20:18:24.988737 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 803/1758] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:24 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:25.285054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-42768873-6432-4b4b-ae9f-f10e3157adcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:25.285659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-42768873-6432-4b4b-ae9f-f10e3157adcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:25.292146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42768873-6432-4b4b-ae9f-f10e3157adcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:25.292623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42768873-6432-4b4b-ae9f-f10e3157adcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:25.293366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42768873-6432-4b4b-ae9f-f10e3157adcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:25.293793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42768873-6432-4b4b-ae9f-f10e3157adcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:25.404993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-55a35f4c-b4ad-4c06-bce4-65cb3ef8f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:25.407418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-55a35f4c-b4ad-4c06-bce4-65cb3ef8f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:25.413894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-55a35f4c-b4ad-4c06-bce4-65cb3ef8f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:25.414348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-55a35f4c-b4ad-4c06-bce4-65cb3ef8f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:25.415168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-55a35f4c-b4ad-4c06-bce4-65cb3ef8f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:25.415567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-55a35f4c-b4ad-4c06-bce4-65cb3ef8f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:25.423942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-42768873-6432-4b4b-ae9f-f10e3157adcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:25.431860 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-42768873-6432-4b4b-ae9f-f10e3157adcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150902 Jul 28 20:18:25.432415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 956/1759] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:25.451137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-55a35f4c-b4ad-4c06-bce4-65cb3ef8f1d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051363 Jul 28 20:18:25.451692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 804/1760] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:26.009136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7e4a202c-c00b-4921-98a0-db921c64fcc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:26.009740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7e4a202c-c00b-4921-98a0-db921c64fcc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:26.015932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e4a202c-c00b-4921-98a0-db921c64fcc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:26.016379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e4a202c-c00b-4921-98a0-db921c64fcc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:26.017186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e4a202c-c00b-4921-98a0-db921c64fcc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:26.017618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e4a202c-c00b-4921-98a0-db921c64fcc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:26.078447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7e4a202c-c00b-4921-98a0-db921c64fcc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:26.085858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7e4a202c-c00b-4921-98a0-db921c64fcc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080607 Jul 28 20:18:26.086403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 957/1761] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:26 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:26.453650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8b52a1bd-b613-4786-811c-ecb83d00bd77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:26.454269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8b52a1bd-b613-4786-811c-ecb83d00bd77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:26.461061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b52a1bd-b613-4786-811c-ecb83d00bd77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:26.461514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b52a1bd-b613-4786-811c-ecb83d00bd77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:26.462286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b52a1bd-b613-4786-811c-ecb83d00bd77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:26.462724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b52a1bd-b613-4786-811c-ecb83d00bd77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:26.463178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2815f09b-7292-47ed-b32c-04f9051723d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:26.465854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2815f09b-7292-47ed-b32c-04f9051723d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:26.472153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2815f09b-7292-47ed-b32c-04f9051723d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:26.472623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2815f09b-7292-47ed-b32c-04f9051723d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:26.473381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2815f09b-7292-47ed-b32c-04f9051723d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:26.473808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2815f09b-7292-47ed-b32c-04f9051723d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:26.477442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:26.505591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2815f09b-7292-47ed-b32c-04f9051723d3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046374 Jul 28 20:18:26.506441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 958/1762] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:26.593477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8b52a1bd-b613-4786-811c-ecb83d00bd77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:26.601391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8b52a1bd-b613-4786-811c-ecb83d00bd77 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151610 Jul 28 20:18:26.601951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 805/1763] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:27.107340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-be79b930-620c-4300-aeed-50db93c43601 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:27.107971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-be79b930-620c-4300-aeed-50db93c43601 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:27.113993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be79b930-620c-4300-aeed-50db93c43601 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:27.114439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be79b930-620c-4300-aeed-50db93c43601 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:27.115191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be79b930-620c-4300-aeed-50db93c43601 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:27.115624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be79b930-620c-4300-aeed-50db93c43601 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:27.181712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-be79b930-620c-4300-aeed-50db93c43601 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:27.189655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-be79b930-620c-4300-aeed-50db93c43601 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086782 Jul 28 20:18:27.190196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 959/1764] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:27 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:27.517923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7afa42c7-ae2e-4251-a43e-81cdae0133b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:27.519993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7afa42c7-ae2e-4251-a43e-81cdae0133b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:27.527289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7afa42c7-ae2e-4251-a43e-81cdae0133b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:27.527752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7afa42c7-ae2e-4251-a43e-81cdae0133b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:27.528480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7afa42c7-ae2e-4251-a43e-81cdae0133b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:27.528932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7afa42c7-ae2e-4251-a43e-81cdae0133b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:27.557071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7afa42c7-ae2e-4251-a43e-81cdae0133b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Jul 28 20:18:27.557957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 806/1765] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:27.623294 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4aa91a3a-303f-492b-b2e1-78089e414105 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:27.623898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4aa91a3a-303f-492b-b2e1-78089e414105 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:27.630254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4aa91a3a-303f-492b-b2e1-78089e414105 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:27.630688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4aa91a3a-303f-492b-b2e1-78089e414105 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:27.631432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4aa91a3a-303f-492b-b2e1-78089e414105 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:27.631854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4aa91a3a-303f-492b-b2e1-78089e414105 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:27.756607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4aa91a3a-303f-492b-b2e1-78089e414105 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:27.764930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4aa91a3a-303f-492b-b2e1-78089e414105 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.145404 Jul 28 20:18:27.765485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 960/1766] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:27 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:28.210184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-385c0de8-a1cf-4a01-905c-ad23e45aeddc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:28.210791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-385c0de8-a1cf-4a01-905c-ad23e45aeddc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:28.217138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-385c0de8-a1cf-4a01-905c-ad23e45aeddc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:28.217575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-385c0de8-a1cf-4a01-905c-ad23e45aeddc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:28.218323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-385c0de8-a1cf-4a01-905c-ad23e45aeddc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:28.218746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-385c0de8-a1cf-4a01-905c-ad23e45aeddc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:28.278841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-385c0de8-a1cf-4a01-905c-ad23e45aeddc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:28.286752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-385c0de8-a1cf-4a01-905c-ad23e45aeddc tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080352 Jul 28 20:18:28.287310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 807/1767] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:28 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:28.303438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:18:28.303583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:18:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:18:28.569533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-250e9b57-b1ff-4a42-a963-8c3164dd03f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:28.571649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-250e9b57-b1ff-4a42-a963-8c3164dd03f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:28.578286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-250e9b57-b1ff-4a42-a963-8c3164dd03f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:28.578728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-250e9b57-b1ff-4a42-a963-8c3164dd03f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:28.579507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-250e9b57-b1ff-4a42-a963-8c3164dd03f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:28.579915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-250e9b57-b1ff-4a42-a963-8c3164dd03f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:28.608954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-250e9b57-b1ff-4a42-a963-8c3164dd03f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043293 Jul 28 20:18:28.609484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 961/1768] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:28.786963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-524bdc15-3d64-4b88-9068-591ddf242769 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:28.787570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-524bdc15-3d64-4b88-9068-591ddf242769 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:28.794652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-524bdc15-3d64-4b88-9068-591ddf242769 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:28.795102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-524bdc15-3d64-4b88-9068-591ddf242769 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:28.795854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-524bdc15-3d64-4b88-9068-591ddf242769 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:28.796283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-524bdc15-3d64-4b88-9068-591ddf242769 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:28.924987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-524bdc15-3d64-4b88-9068-591ddf242769 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:28.932884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-524bdc15-3d64-4b88-9068-591ddf242769 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149694 Jul 28 20:18:28.933444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 808/1769] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:28 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:29.308737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-96c60893-dd3c-4e88-85b6-4ea5bf1d4850 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:29.309338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-96c60893-dd3c-4e88-85b6-4ea5bf1d4850 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:29.315826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96c60893-dd3c-4e88-85b6-4ea5bf1d4850 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:29.316265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96c60893-dd3c-4e88-85b6-4ea5bf1d4850 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:29.317033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96c60893-dd3c-4e88-85b6-4ea5bf1d4850 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:29.317455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96c60893-dd3c-4e88-85b6-4ea5bf1d4850 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:29.378908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-96c60893-dd3c-4e88-85b6-4ea5bf1d4850 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:29.387037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-96c60893-dd3c-4e88-85b6-4ea5bf1d4850 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083156 Jul 28 20:18:29.387581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 962/1770] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:29 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:29.622087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-df3b8e0f-08ce-4251-9362-b9d61c9458e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:29.624209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-df3b8e0f-08ce-4251-9362-b9d61c9458e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:29.630208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df3b8e0f-08ce-4251-9362-b9d61c9458e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:29.630656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df3b8e0f-08ce-4251-9362-b9d61c9458e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:29.631415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df3b8e0f-08ce-4251-9362-b9d61c9458e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:29.631854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df3b8e0f-08ce-4251-9362-b9d61c9458e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:29.660531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-df3b8e0f-08ce-4251-9362-b9d61c9458e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043374 Jul 28 20:18:29.661086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 809/1771] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:29 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:29.954835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8e6c5efa-0298-4184-8540-c5e73fa276e7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:29.955385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8e6c5efa-0298-4184-8540-c5e73fa276e7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:29.961433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6c5efa-0298-4184-8540-c5e73fa276e7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:29.961880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6c5efa-0298-4184-8540-c5e73fa276e7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:29.962626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6c5efa-0298-4184-8540-c5e73fa276e7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:29.963055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e6c5efa-0298-4184-8540-c5e73fa276e7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:30.088515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e6c5efa-0298-4184-8540-c5e73fa276e7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:30.096607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8e6c5efa-0298-4184-8540-c5e73fa276e7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.145763 Jul 28 20:18:30.097159 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 963/1772] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:29 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:30.407954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7ba84291-18ff-430b-b6d7-540f71991284 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:30.408598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7ba84291-18ff-430b-b6d7-540f71991284 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:30.415138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ba84291-18ff-430b-b6d7-540f71991284 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:30.415583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ba84291-18ff-430b-b6d7-540f71991284 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:30.416339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ba84291-18ff-430b-b6d7-540f71991284 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:30.416806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ba84291-18ff-430b-b6d7-540f71991284 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:30.480022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7ba84291-18ff-430b-b6d7-540f71991284 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:30.488266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7ba84291-18ff-430b-b6d7-540f71991284 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084470 Jul 28 20:18:30.488867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 810/1773] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:30 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:30.673196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7579249e-dd13-4aac-aa78-03dce1540f9c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:30.675267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7579249e-dd13-4aac-aa78-03dce1540f9c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:30.681799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7579249e-dd13-4aac-aa78-03dce1540f9c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:30.682248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7579249e-dd13-4aac-aa78-03dce1540f9c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:30.683076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7579249e-dd13-4aac-aa78-03dce1540f9c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:30.684279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7579249e-dd13-4aac-aa78-03dce1540f9c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:30.712110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7579249e-dd13-4aac-aa78-03dce1540f9c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042997 Jul 28 20:18:30.712664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 964/1774] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:31.118492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d4ce6381-0be7-4c8b-af2b-07f353d90410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:31.119131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d4ce6381-0be7-4c8b-af2b-07f353d90410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:31.125550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4ce6381-0be7-4c8b-af2b-07f353d90410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:31.126000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4ce6381-0be7-4c8b-af2b-07f353d90410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:31.126760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4ce6381-0be7-4c8b-af2b-07f353d90410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:31.127196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4ce6381-0be7-4c8b-af2b-07f353d90410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:31.257892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d4ce6381-0be7-4c8b-af2b-07f353d90410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:31.266835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d4ce6381-0be7-4c8b-af2b-07f353d90410 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152190 Jul 28 20:18:31.267398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 811/1775] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:31.509207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5401f617-46ec-4b81-944d-f425e017508b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:31.509766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5401f617-46ec-4b81-944d-f425e017508b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:31.516435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5401f617-46ec-4b81-944d-f425e017508b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:31.516918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5401f617-46ec-4b81-944d-f425e017508b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:31.517675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5401f617-46ec-4b81-944d-f425e017508b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:31.518110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5401f617-46ec-4b81-944d-f425e017508b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:31.578302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5401f617-46ec-4b81-944d-f425e017508b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:31.585748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5401f617-46ec-4b81-944d-f425e017508b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080441 Jul 28 20:18:31.586303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 965/1776] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:31 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:31.724300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-204a840f-5cef-4fa1-be62-bd8f7dfc17b6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:31.726480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-204a840f-5cef-4fa1-be62-bd8f7dfc17b6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:31.732569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-204a840f-5cef-4fa1-be62-bd8f7dfc17b6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:31.733025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-204a840f-5cef-4fa1-be62-bd8f7dfc17b6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:31.733781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-204a840f-5cef-4fa1-be62-bd8f7dfc17b6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:31.734214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-204a840f-5cef-4fa1-be62-bd8f7dfc17b6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:31.763817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-204a840f-5cef-4fa1-be62-bd8f7dfc17b6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Jul 28 20:18:31.764277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 812/1777] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:32.019821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:18:32.020038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:18:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:18:32.289118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2a4f27fc-e42b-422b-ba1d-828b60175889 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:32.289655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2a4f27fc-e42b-422b-ba1d-828b60175889 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:32.296946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a4f27fc-e42b-422b-ba1d-828b60175889 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:32.297402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a4f27fc-e42b-422b-ba1d-828b60175889 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:32.298166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a4f27fc-e42b-422b-ba1d-828b60175889 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:32.298603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2a4f27fc-e42b-422b-ba1d-828b60175889 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:32.427506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2a4f27fc-e42b-422b-ba1d-828b60175889 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:32.435491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2a4f27fc-e42b-422b-ba1d-828b60175889 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150286 Jul 28 20:18:32.436027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 966/1778] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:32.606904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-654d8e31-9029-402d-8a30-c0ffbcc4d10e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:32.607548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-654d8e31-9029-402d-8a30-c0ffbcc4d10e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:32.614053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-654d8e31-9029-402d-8a30-c0ffbcc4d10e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:32.614501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-654d8e31-9029-402d-8a30-c0ffbcc4d10e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:32.615265 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-654d8e31-9029-402d-8a30-c0ffbcc4d10e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:32.615702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-654d8e31-9029-402d-8a30-c0ffbcc4d10e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:32.634072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:32.678762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-654d8e31-9029-402d-8a30-c0ffbcc4d10e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:32.686251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-654d8e31-9029-402d-8a30-c0ffbcc4d10e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083822 Jul 28 20:18:32.686807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 813/1779] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:32 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:32.775435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-99191612-f89d-44e3-9317-183043b7b57e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:32.778466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-99191612-f89d-44e3-9317-183043b7b57e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:32.784845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99191612-f89d-44e3-9317-183043b7b57e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:32.785299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99191612-f89d-44e3-9317-183043b7b57e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:32.786038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99191612-f89d-44e3-9317-183043b7b57e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:32.786464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-99191612-f89d-44e3-9317-183043b7b57e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:32.818220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-99191612-f89d-44e3-9317-183043b7b57e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 Jul 28 20:18:32.818760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 967/1780] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:33.456684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-df424bb9-cae9-4f03-bd05-53a84d72081b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:33.457234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-df424bb9-cae9-4f03-bd05-53a84d72081b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:33.463341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df424bb9-cae9-4f03-bd05-53a84d72081b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:33.463794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df424bb9-cae9-4f03-bd05-53a84d72081b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:33.464645 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df424bb9-cae9-4f03-bd05-53a84d72081b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:33.465214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df424bb9-cae9-4f03-bd05-53a84d72081b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:33.594299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-df424bb9-cae9-4f03-bd05-53a84d72081b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:33.602226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-df424bb9-cae9-4f03-bd05-53a84d72081b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149523 Jul 28 20:18:33.602773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 814/1781] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:33.706951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-91be03b4-1a84-407a-a762-49e635ddeb86 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:33.707495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-91be03b4-1a84-407a-a762-49e635ddeb86 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:33.713515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91be03b4-1a84-407a-a762-49e635ddeb86 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:33.713964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91be03b4-1a84-407a-a762-49e635ddeb86 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:33.714732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91be03b4-1a84-407a-a762-49e635ddeb86 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:33.715160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91be03b4-1a84-407a-a762-49e635ddeb86 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:33.778711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-91be03b4-1a84-407a-a762-49e635ddeb86 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:33.786836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-91be03b4-1a84-407a-a762-49e635ddeb86 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083991 Jul 28 20:18:33.787390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 968/1782] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:33 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:33.830810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6c885334-b05b-4fe8-99c5-db6a38aebb5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:33.832976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6c885334-b05b-4fe8-99c5-db6a38aebb5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:33.839277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c885334-b05b-4fe8-99c5-db6a38aebb5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:33.840280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c885334-b05b-4fe8-99c5-db6a38aebb5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:33.841353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c885334-b05b-4fe8-99c5-db6a38aebb5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:33.841787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c885334-b05b-4fe8-99c5-db6a38aebb5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:33.870421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6c885334-b05b-4fe8-99c5-db6a38aebb5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043519 Jul 28 20:18:33.871043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 815/1783] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:34.624211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-88813411-31ba-47e6-9e46-69147dafe8ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:34.624839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-88813411-31ba-47e6-9e46-69147dafe8ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:34.630839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88813411-31ba-47e6-9e46-69147dafe8ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:34.631281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88813411-31ba-47e6-9e46-69147dafe8ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:34.632027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88813411-31ba-47e6-9e46-69147dafe8ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:34.632456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88813411-31ba-47e6-9e46-69147dafe8ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:34.757382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-88813411-31ba-47e6-9e46-69147dafe8ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:34.766130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-88813411-31ba-47e6-9e46-69147dafe8ef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146215 Jul 28 20:18:34.766624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 969/1784] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:34 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:34.807622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-01b2fd39-d6c4-4f81-82cb-e595be467bea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:34.808776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-01b2fd39-d6c4-4f81-82cb-e595be467bea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:34.815261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01b2fd39-d6c4-4f81-82cb-e595be467bea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:34.815705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01b2fd39-d6c4-4f81-82cb-e595be467bea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:34.816480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01b2fd39-d6c4-4f81-82cb-e595be467bea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:34.816931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01b2fd39-d6c4-4f81-82cb-e595be467bea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:34.876730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-01b2fd39-d6c4-4f81-82cb-e595be467bea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:34.882546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eed60643-f7be-4037-bb82-815e120ff321 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:34.884271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-01b2fd39-d6c4-4f81-82cb-e595be467bea tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080434 Jul 28 20:18:34.884741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eed60643-f7be-4037-bb82-815e120ff321 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:34.884867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 816/1785] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:34 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:34.891755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eed60643-f7be-4037-bb82-815e120ff321 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:34.892201 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eed60643-f7be-4037-bb82-815e120ff321 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:34.893002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eed60643-f7be-4037-bb82-815e120ff321 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:34.893434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eed60643-f7be-4037-bb82-815e120ff321 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:34.922954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eed60643-f7be-4037-bb82-815e120ff321 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Jul 28 20:18:34.923499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 970/1786] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:35.787035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e9a5a6b0-2c70-456e-8e3c-7d8742382664 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:35.787638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e9a5a6b0-2c70-456e-8e3c-7d8742382664 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:35.794300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9a5a6b0-2c70-456e-8e3c-7d8742382664 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:35.794735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9a5a6b0-2c70-456e-8e3c-7d8742382664 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:35.795480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9a5a6b0-2c70-456e-8e3c-7d8742382664 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:35.795906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9a5a6b0-2c70-456e-8e3c-7d8742382664 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:35.905656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1a653a03-f5b1-4f82-be60-d77bcaca83bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:35.906557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1a653a03-f5b1-4f82-be60-d77bcaca83bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:35.913061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a653a03-f5b1-4f82-be60-d77bcaca83bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:35.913503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a653a03-f5b1-4f82-be60-d77bcaca83bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:35.914255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a653a03-f5b1-4f82-be60-d77bcaca83bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:35.914679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a653a03-f5b1-4f82-be60-d77bcaca83bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:35.925855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e9a5a6b0-2c70-456e-8e3c-7d8742382664 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:35.934900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e9a5a6b0-2c70-456e-8e3c-7d8742382664 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151612 Jul 28 20:18:35.935464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 817/1787] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:35 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:35.940006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cc4354b4-9a3f-4c03-a9de-9117ff7f3de5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:35.942156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cc4354b4-9a3f-4c03-a9de-9117ff7f3de5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:35.947956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc4354b4-9a3f-4c03-a9de-9117ff7f3de5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:35.948399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc4354b4-9a3f-4c03-a9de-9117ff7f3de5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:35.949559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc4354b4-9a3f-4c03-a9de-9117ff7f3de5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:35.950338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc4354b4-9a3f-4c03-a9de-9117ff7f3de5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:35.979650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cc4354b4-9a3f-4c03-a9de-9117ff7f3de5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 Jul 28 20:18:35.980839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 818/1788] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:35.983209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1a653a03-f5b1-4f82-be60-d77bcaca83bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:35.994296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1a653a03-f5b1-4f82-be60-d77bcaca83bf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.092949 Jul 28 20:18:35.994881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 971/1789] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:35 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:36.956700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9f93143f-1beb-4ab1-b2de-321066bc5294 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:36.957335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9f93143f-1beb-4ab1-b2de-321066bc5294 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:36.963738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f93143f-1beb-4ab1-b2de-321066bc5294 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:36.964181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f93143f-1beb-4ab1-b2de-321066bc5294 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:36.965576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f93143f-1beb-4ab1-b2de-321066bc5294 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:36.966009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f93143f-1beb-4ab1-b2de-321066bc5294 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:36.991705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-28e91242-0917-43c2-a567-780f3162260b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:36.993854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-28e91242-0917-43c2-a567-780f3162260b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:37.000591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28e91242-0917-43c2-a567-780f3162260b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:37.001050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28e91242-0917-43c2-a567-780f3162260b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:37.001848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28e91242-0917-43c2-a567-780f3162260b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:37.002287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28e91242-0917-43c2-a567-780f3162260b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:37.033227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-28e91242-0917-43c2-a567-780f3162260b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045546 Jul 28 20:18:37.033784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 972/1790] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:37.038295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4bb57894-a8d5-40ab-8954-85abf0f006b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:37.038897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4bb57894-a8d5-40ab-8954-85abf0f006b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:37.045651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4bb57894-a8d5-40ab-8954-85abf0f006b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:37.046096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4bb57894-a8d5-40ab-8954-85abf0f006b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:37.046847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4bb57894-a8d5-40ab-8954-85abf0f006b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:37.047274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4bb57894-a8d5-40ab-8954-85abf0f006b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:37.119286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4bb57894-a8d5-40ab-8954-85abf0f006b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:37.122830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9f93143f-1beb-4ab1-b2de-321066bc5294 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:37.126796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4bb57894-a8d5-40ab-8954-85abf0f006b0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.092056 Jul 28 20:18:37.127356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 973/1791] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:37 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:37.130707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9f93143f-1beb-4ab1-b2de-321066bc5294 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.178138 Jul 28 20:18:37.131262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 819/1792] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:36 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:38.045440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6f98cb6b-0e79-4d07-9ace-8c967c215c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:38.047589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6f98cb6b-0e79-4d07-9ace-8c967c215c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:38.054116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f98cb6b-0e79-4d07-9ace-8c967c215c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:38.054562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f98cb6b-0e79-4d07-9ace-8c967c215c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:38.055326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f98cb6b-0e79-4d07-9ace-8c967c215c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:38.055757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f98cb6b-0e79-4d07-9ace-8c967c215c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:38.080282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:38.085085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6f98cb6b-0e79-4d07-9ace-8c967c215c10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Jul 28 20:18:38.085621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 974/1793] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:38.147576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e35e7758-7f27-4e4d-92b3-7b6e739a39ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:38.148210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e35e7758-7f27-4e4d-92b3-7b6e739a39ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:38.150916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cebc61d9-eebe-4e5f-8a0d-7df42261a78d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:38.151526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cebc61d9-eebe-4e5f-8a0d-7df42261a78d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:38.154972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e35e7758-7f27-4e4d-92b3-7b6e739a39ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:38.155417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e35e7758-7f27-4e4d-92b3-7b6e739a39ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:38.156430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e35e7758-7f27-4e4d-92b3-7b6e739a39ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:38.156884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e35e7758-7f27-4e4d-92b3-7b6e739a39ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:38.157689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebc61d9-eebe-4e5f-8a0d-7df42261a78d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:38.158136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebc61d9-eebe-4e5f-8a0d-7df42261a78d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:38.158895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebc61d9-eebe-4e5f-8a0d-7df42261a78d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:38.159330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebc61d9-eebe-4e5f-8a0d-7df42261a78d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:38.241497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e35e7758-7f27-4e4d-92b3-7b6e739a39ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:38.249775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e35e7758-7f27-4e4d-92b3-7b6e739a39ef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.106272 Jul 28 20:18:38.250333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 820/1794] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:38 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:38.312336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cebc61d9-eebe-4e5f-8a0d-7df42261a78d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:38.320639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cebc61d9-eebe-4e5f-8a0d-7df42261a78d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.173445 Jul 28 20:18:38.322014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 975/1795] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:39.097845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2141c59e-852a-4190-9b6e-9dff867bcc83 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:39.100056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2141c59e-852a-4190-9b6e-9dff867bcc83 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:39.106756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2141c59e-852a-4190-9b6e-9dff867bcc83 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:39.107209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2141c59e-852a-4190-9b6e-9dff867bcc83 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:39.107961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2141c59e-852a-4190-9b6e-9dff867bcc83 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:39.108395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2141c59e-852a-4190-9b6e-9dff867bcc83 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:39.136266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2141c59e-852a-4190-9b6e-9dff867bcc83 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 Jul 28 20:18:39.136827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 821/1796] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:39.272121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-452be55e-c40b-47c6-9c6f-6e8c1281a6db tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:39.272847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-452be55e-c40b-47c6-9c6f-6e8c1281a6db tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:39.279755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-452be55e-c40b-47c6-9c6f-6e8c1281a6db tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:39.280195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-452be55e-c40b-47c6-9c6f-6e8c1281a6db tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:39.280981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-452be55e-c40b-47c6-9c6f-6e8c1281a6db tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:39.281675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-452be55e-c40b-47c6-9c6f-6e8c1281a6db tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:39.343597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-175faae8-1112-47c0-be6f-19d1267e25a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:39.344201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-175faae8-1112-47c0-be6f-19d1267e25a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:39.348262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-452be55e-c40b-47c6-9c6f-6e8c1281a6db tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:39.350610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-175faae8-1112-47c0-be6f-19d1267e25a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:39.351057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-175faae8-1112-47c0-be6f-19d1267e25a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:39.351860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-175faae8-1112-47c0-be6f-19d1267e25a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:39.352369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-175faae8-1112-47c0-be6f-19d1267e25a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:39.356321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-452be55e-c40b-47c6-9c6f-6e8c1281a6db tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087883 Jul 28 20:18:39.356998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 976/1797] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:39 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:39.688375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-175faae8-1112-47c0-be6f-19d1267e25a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:39.696290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-175faae8-1112-47c0-be6f-19d1267e25a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.356812 Jul 28 20:18:39.696894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 822/1798] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:39 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:40.148464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fb1b1efc-95ef-4797-967f-c490dde6ba90 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:40.150647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fb1b1efc-95ef-4797-967f-c490dde6ba90 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:40.157857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb1b1efc-95ef-4797-967f-c490dde6ba90 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:40.158309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb1b1efc-95ef-4797-967f-c490dde6ba90 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:40.159078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb1b1efc-95ef-4797-967f-c490dde6ba90 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:40.159520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fb1b1efc-95ef-4797-967f-c490dde6ba90 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:40.191641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fb1b1efc-95ef-4797-967f-c490dde6ba90 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047049 Jul 28 20:18:40.192438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 977/1799] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:40.377485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-22164cb3-2b81-4b42-a3cc-ed04495b1e01 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:40.378093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-22164cb3-2b81-4b42-a3cc-ed04495b1e01 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:40.384617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-22164cb3-2b81-4b42-a3cc-ed04495b1e01 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:40.385126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-22164cb3-2b81-4b42-a3cc-ed04495b1e01 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:40.385828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-22164cb3-2b81-4b42-a3cc-ed04495b1e01 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:40.386256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-22164cb3-2b81-4b42-a3cc-ed04495b1e01 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:40.451621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-22164cb3-2b81-4b42-a3cc-ed04495b1e01 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:40.459133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-22164cb3-2b81-4b42-a3cc-ed04495b1e01 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085572 Jul 28 20:18:40.459757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 823/1800] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:40 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:40.719190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-55b1a967-55df-4e2d-abb5-6a955b2c79d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:40.719780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-55b1a967-55df-4e2d-abb5-6a955b2c79d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:40.726478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55b1a967-55df-4e2d-abb5-6a955b2c79d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:40.726926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55b1a967-55df-4e2d-abb5-6a955b2c79d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:40.727685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55b1a967-55df-4e2d-abb5-6a955b2c79d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:40.728113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-55b1a967-55df-4e2d-abb5-6a955b2c79d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:40.862891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-55b1a967-55df-4e2d-abb5-6a955b2c79d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:40.870743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-55b1a967-55df-4e2d-abb5-6a955b2c79d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.156553 Jul 28 20:18:40.871317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 978/1801] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:41.204442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f3dbf7ef-6084-4212-80ee-022b7175184e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:41.206641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f3dbf7ef-6084-4212-80ee-022b7175184e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:41.212661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3dbf7ef-6084-4212-80ee-022b7175184e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:41.213110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3dbf7ef-6084-4212-80ee-022b7175184e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:41.213862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3dbf7ef-6084-4212-80ee-022b7175184e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:41.214293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3dbf7ef-6084-4212-80ee-022b7175184e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:41.242859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f3dbf7ef-6084-4212-80ee-022b7175184e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042364 Jul 28 20:18:41.243396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 824/1802] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:41.479147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-be1a0de0-69ab-4ae9-9f97-d7a7e29e80b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:41.479670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-be1a0de0-69ab-4ae9-9f97-d7a7e29e80b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:41.485812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be1a0de0-69ab-4ae9-9f97-d7a7e29e80b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:41.486250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be1a0de0-69ab-4ae9-9f97-d7a7e29e80b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:41.486995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be1a0de0-69ab-4ae9-9f97-d7a7e29e80b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:41.487421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be1a0de0-69ab-4ae9-9f97-d7a7e29e80b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:41.546707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-be1a0de0-69ab-4ae9-9f97-d7a7e29e80b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:41.554074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-be1a0de0-69ab-4ae9-9f97-d7a7e29e80b5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.078798 Jul 28 20:18:41.554640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 979/1803] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:41 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:41.891607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7197bb35-ebcf-4fe5-bb6e-11650e3d3347 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:41.892224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7197bb35-ebcf-4fe5-bb6e-11650e3d3347 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:41.898777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7197bb35-ebcf-4fe5-bb6e-11650e3d3347 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:41.899220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7197bb35-ebcf-4fe5-bb6e-11650e3d3347 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:41.899969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7197bb35-ebcf-4fe5-bb6e-11650e3d3347 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:41.900400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7197bb35-ebcf-4fe5-bb6e-11650e3d3347 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:42.026837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7197bb35-ebcf-4fe5-bb6e-11650e3d3347 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:42.035547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7197bb35-ebcf-4fe5-bb6e-11650e3d3347 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147779 Jul 28 20:18:42.036105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 825/1804] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:41 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:42.255342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-baaf7d8d-e1be-4d6c-a790-adf5052d07f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:42.257937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-baaf7d8d-e1be-4d6c-a790-adf5052d07f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:42.264712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-baaf7d8d-e1be-4d6c-a790-adf5052d07f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:42.265157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-baaf7d8d-e1be-4d6c-a790-adf5052d07f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:42.265909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-baaf7d8d-e1be-4d6c-a790-adf5052d07f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:42.266336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-baaf7d8d-e1be-4d6c-a790-adf5052d07f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:42.296502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-baaf7d8d-e1be-4d6c-a790-adf5052d07f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045215 Jul 28 20:18:42.297084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 980/1805] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:42.575299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-43824b9b-1ac0-4739-9b0d-953ea1329329 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:42.575911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-43824b9b-1ac0-4739-9b0d-953ea1329329 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:42.581883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43824b9b-1ac0-4739-9b0d-953ea1329329 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:42.582322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43824b9b-1ac0-4739-9b0d-953ea1329329 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:42.583069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43824b9b-1ac0-4739-9b0d-953ea1329329 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:42.583497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43824b9b-1ac0-4739-9b0d-953ea1329329 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:42.646275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-43824b9b-1ac0-4739-9b0d-953ea1329329 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:42.653909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-43824b9b-1ac0-4739-9b0d-953ea1329329 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082747 Jul 28 20:18:42.654460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 826/1806] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:42 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:43.057717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fa573a3f-4dbd-4101-856f-a09f8a3d32d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:43.058247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fa573a3f-4dbd-4101-856f-a09f8a3d32d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:43.065549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fa573a3f-4dbd-4101-856f-a09f8a3d32d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:43.065996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fa573a3f-4dbd-4101-856f-a09f8a3d32d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:43.066751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fa573a3f-4dbd-4101-856f-a09f8a3d32d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:43.067207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fa573a3f-4dbd-4101-856f-a09f8a3d32d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:43.195092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fa573a3f-4dbd-4101-856f-a09f8a3d32d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:43.203289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fa573a3f-4dbd-4101-856f-a09f8a3d32d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149516 Jul 28 20:18:43.203841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 981/1807] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:43 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:43.309704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-40a12cfd-c2aa-48a5-9bc7-7bfb4a0dbfee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:43.311547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-40a12cfd-c2aa-48a5-9bc7-7bfb4a0dbfee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:43.318053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40a12cfd-c2aa-48a5-9bc7-7bfb4a0dbfee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:43.318500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40a12cfd-c2aa-48a5-9bc7-7bfb4a0dbfee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:43.319257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40a12cfd-c2aa-48a5-9bc7-7bfb4a0dbfee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:43.319764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40a12cfd-c2aa-48a5-9bc7-7bfb4a0dbfee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:43.348318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-40a12cfd-c2aa-48a5-9bc7-7bfb4a0dbfee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043515 Jul 28 20:18:43.348900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 827/1808] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:43.675348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0dc28923-b57d-4207-a513-7b809fe524c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:43.676019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0dc28923-b57d-4207-a513-7b809fe524c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:43.682464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0dc28923-b57d-4207-a513-7b809fe524c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:43.682907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0dc28923-b57d-4207-a513-7b809fe524c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:43.683660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0dc28923-b57d-4207-a513-7b809fe524c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:43.684090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0dc28923-b57d-4207-a513-7b809fe524c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:43.743581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0dc28923-b57d-4207-a513-7b809fe524c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:43.751257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0dc28923-b57d-4207-a513-7b809fe524c7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.079839 Jul 28 20:18:43.751807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 982/1809] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:43 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:44.224616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-feb5818b-e481-4894-aa81-1b4fd6a78340 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:44.225299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-feb5818b-e481-4894-aa81-1b4fd6a78340 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:44.231864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-feb5818b-e481-4894-aa81-1b4fd6a78340 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:44.232311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-feb5818b-e481-4894-aa81-1b4fd6a78340 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:44.233103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-feb5818b-e481-4894-aa81-1b4fd6a78340 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:44.233536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-feb5818b-e481-4894-aa81-1b4fd6a78340 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:44.360618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-455cec20-3948-47de-855c-df993ec46b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:44.362855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-455cec20-3948-47de-855c-df993ec46b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:44.365734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-feb5818b-e481-4894-aa81-1b4fd6a78340 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:44.369043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-455cec20-3948-47de-855c-df993ec46b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:44.369498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-455cec20-3948-47de-855c-df993ec46b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:44.370273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-455cec20-3948-47de-855c-df993ec46b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:44.370711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-455cec20-3948-47de-855c-df993ec46b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:44.374147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-feb5818b-e481-4894-aa81-1b4fd6a78340 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.153405 Jul 28 20:18:44.374696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 828/1810] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:44 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:44.405305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-455cec20-3948-47de-855c-df993ec46b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048611 Jul 28 20:18:44.405861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 983/1811] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:44.772403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-86a2e35f-22f8-4dc3-b2d4-c2c7c724ad5c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:44.773046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-86a2e35f-22f8-4dc3-b2d4-c2c7c724ad5c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:44.779112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86a2e35f-22f8-4dc3-b2d4-c2c7c724ad5c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:44.779548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86a2e35f-22f8-4dc3-b2d4-c2c7c724ad5c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:44.780294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86a2e35f-22f8-4dc3-b2d4-c2c7c724ad5c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:44.780752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86a2e35f-22f8-4dc3-b2d4-c2c7c724ad5c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:44.840700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-86a2e35f-22f8-4dc3-b2d4-c2c7c724ad5c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:44.848181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-86a2e35f-22f8-4dc3-b2d4-c2c7c724ad5c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.079656 Jul 28 20:18:44.848764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 829/1812] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:44 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:45.396123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9222cd85-d011-45d3-b3c7-7ad986b24744 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:45.396875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9222cd85-d011-45d3-b3c7-7ad986b24744 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:45.403307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9222cd85-d011-45d3-b3c7-7ad986b24744 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:45.403878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9222cd85-d011-45d3-b3c7-7ad986b24744 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:45.404521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9222cd85-d011-45d3-b3c7-7ad986b24744 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:45.405049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9222cd85-d011-45d3-b3c7-7ad986b24744 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:45.417246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7959a6aa-a43a-40f8-8924-0825ced8f6c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:45.420359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7959a6aa-a43a-40f8-8924-0825ced8f6c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:45.426902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7959a6aa-a43a-40f8-8924-0825ced8f6c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:45.427350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7959a6aa-a43a-40f8-8924-0825ced8f6c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:45.428167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7959a6aa-a43a-40f8-8924-0825ced8f6c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:45.428620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7959a6aa-a43a-40f8-8924-0825ced8f6c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:45.432284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:45.458610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7959a6aa-a43a-40f8-8924-0825ced8f6c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Jul 28 20:18:45.459192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 830/1813] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:45.533447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9222cd85-d011-45d3-b3c7-7ad986b24744 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:45.541476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9222cd85-d011-45d3-b3c7-7ad986b24744 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149328 Jul 28 20:18:45.542032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 984/1814] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:45.869327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c0680f88-a77b-43d2-9d3d-b80a37613205 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:45.869967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c0680f88-a77b-43d2-9d3d-b80a37613205 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:45.875971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c0680f88-a77b-43d2-9d3d-b80a37613205 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:45.876419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c0680f88-a77b-43d2-9d3d-b80a37613205 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:45.877207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c0680f88-a77b-43d2-9d3d-b80a37613205 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:45.877644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c0680f88-a77b-43d2-9d3d-b80a37613205 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:45.941751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c0680f88-a77b-43d2-9d3d-b80a37613205 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:45.949347 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c0680f88-a77b-43d2-9d3d-b80a37613205 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084044 Jul 28 20:18:45.949904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 831/1815] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:45 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:46.471662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-28b375af-bb1c-4882-88e7-86f49f576c49 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:46.473737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-28b375af-bb1c-4882-88e7-86f49f576c49 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:46.480411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b375af-bb1c-4882-88e7-86f49f576c49 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:46.480902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b375af-bb1c-4882-88e7-86f49f576c49 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:46.481938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b375af-bb1c-4882-88e7-86f49f576c49 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:46.482273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28b375af-bb1c-4882-88e7-86f49f576c49 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:46.511862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-28b375af-bb1c-4882-88e7-86f49f576c49 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Jul 28 20:18:46.512443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 985/1816] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:46.570487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6fc5cd5e-d0b1-4b70-b988-1c515cc6f61a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:46.571099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6fc5cd5e-d0b1-4b70-b988-1c515cc6f61a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:46.578267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fc5cd5e-d0b1-4b70-b988-1c515cc6f61a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:46.578706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fc5cd5e-d0b1-4b70-b988-1c515cc6f61a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:46.579471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fc5cd5e-d0b1-4b70-b988-1c515cc6f61a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:46.579906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fc5cd5e-d0b1-4b70-b988-1c515cc6f61a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:46.709978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6fc5cd5e-d0b1-4b70-b988-1c515cc6f61a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:46.718021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6fc5cd5e-d0b1-4b70-b988-1c515cc6f61a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151467 Jul 28 20:18:46.718574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 832/1817] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:46.970006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-67f360fd-b6de-4aee-981a-6ccc67e1b6c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:46.970624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-67f360fd-b6de-4aee-981a-6ccc67e1b6c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:46.976587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67f360fd-b6de-4aee-981a-6ccc67e1b6c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:46.977041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67f360fd-b6de-4aee-981a-6ccc67e1b6c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:46.977795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67f360fd-b6de-4aee-981a-6ccc67e1b6c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:46.978228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-67f360fd-b6de-4aee-981a-6ccc67e1b6c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:47.040044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-67f360fd-b6de-4aee-981a-6ccc67e1b6c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:47.047861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-67f360fd-b6de-4aee-981a-6ccc67e1b6c6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081773 Jul 28 20:18:47.048406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 986/1818] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:46 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:47.524466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2b15e3b9-9abe-4127-9a30-c8c5e4a59add tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:47.526686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2b15e3b9-9abe-4127-9a30-c8c5e4a59add tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:47.529124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=82 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:47.534497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b15e3b9-9abe-4127-9a30-c8c5e4a59add tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:47.534939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b15e3b9-9abe-4127-9a30-c8c5e4a59add tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:47.535694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b15e3b9-9abe-4127-9a30-c8c5e4a59add tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:47.536123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b15e3b9-9abe-4127-9a30-c8c5e4a59add tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:47.565243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2b15e3b9-9abe-4127-9a30-c8c5e4a59add tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Jul 28 20:18:47.565794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 833/1819] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:47.739139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-de44f404-912c-4101-ad62-9a488225c212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:47.739770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-de44f404-912c-4101-ad62-9a488225c212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:47.746240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de44f404-912c-4101-ad62-9a488225c212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:47.746687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de44f404-912c-4101-ad62-9a488225c212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:47.747940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de44f404-912c-4101-ad62-9a488225c212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:47.748372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-de44f404-912c-4101-ad62-9a488225c212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:47.880519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-de44f404-912c-4101-ad62-9a488225c212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:47.888578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-de44f404-912c-4101-ad62-9a488225c212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.153127 Jul 28 20:18:47.889141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 987/1820] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:48.068499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-87cb7f56-1c2b-4ea0-a0e7-19a7b9a973f6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:48.069288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-87cb7f56-1c2b-4ea0-a0e7-19a7b9a973f6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:48.075896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87cb7f56-1c2b-4ea0-a0e7-19a7b9a973f6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:48.076395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87cb7f56-1c2b-4ea0-a0e7-19a7b9a973f6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:48.077136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87cb7f56-1c2b-4ea0-a0e7-19a7b9a973f6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:48.077574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87cb7f56-1c2b-4ea0-a0e7-19a7b9a973f6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:48.138467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-87cb7f56-1c2b-4ea0-a0e7-19a7b9a973f6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:48.146061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-87cb7f56-1c2b-4ea0-a0e7-19a7b9a973f6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081386 Jul 28 20:18:48.146622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 834/1821] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:48.578407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-45161ebe-d30b-4a0e-b28e-7672a61e1f2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:48.580534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-45161ebe-d30b-4a0e-b28e-7672a61e1f2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:48.582432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=82 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:48.587814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-45161ebe-d30b-4a0e-b28e-7672a61e1f2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:48.588263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-45161ebe-d30b-4a0e-b28e-7672a61e1f2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:48.589059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-45161ebe-d30b-4a0e-b28e-7672a61e1f2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:48.589496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-45161ebe-d30b-4a0e-b28e-7672a61e1f2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:48.618750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-45161ebe-d30b-4a0e-b28e-7672a61e1f2b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Jul 28 20:18:48.619187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 988/1822] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:48.910648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0256e346-b88c-4ae1-8cd6-6e907584598b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:48.911158 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0256e346-b88c-4ae1-8cd6-6e907584598b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:48.917211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0256e346-b88c-4ae1-8cd6-6e907584598b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:48.917659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0256e346-b88c-4ae1-8cd6-6e907584598b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:48.918415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0256e346-b88c-4ae1-8cd6-6e907584598b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:48.918885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0256e346-b88c-4ae1-8cd6-6e907584598b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:49.045979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0256e346-b88c-4ae1-8cd6-6e907584598b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:49.053958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0256e346-b88c-4ae1-8cd6-6e907584598b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147665 Jul 28 20:18:49.054512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 835/1823] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:48 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:49.167350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eb7930f8-b0eb-4c1d-813f-4381eca7bc9d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:49.170828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eb7930f8-b0eb-4c1d-813f-4381eca7bc9d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:49.177316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb7930f8-b0eb-4c1d-813f-4381eca7bc9d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:49.177762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb7930f8-b0eb-4c1d-813f-4381eca7bc9d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:49.178523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb7930f8-b0eb-4c1d-813f-4381eca7bc9d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:49.178951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eb7930f8-b0eb-4c1d-813f-4381eca7bc9d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:49.242632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eb7930f8-b0eb-4c1d-813f-4381eca7bc9d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:49.250616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eb7930f8-b0eb-4c1d-813f-4381eca7bc9d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087132 Jul 28 20:18:49.251170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 989/1824] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:49 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:49.633042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5993b52b-993b-478d-8bbc-53eed37392ba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:49.635197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5993b52b-993b-478d-8bbc-53eed37392ba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:49.642834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5993b52b-993b-478d-8bbc-53eed37392ba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:49.643278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5993b52b-993b-478d-8bbc-53eed37392ba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:49.644033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5993b52b-993b-478d-8bbc-53eed37392ba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:49.644466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5993b52b-993b-478d-8bbc-53eed37392ba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:49.673884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5993b52b-993b-478d-8bbc-53eed37392ba tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046535 Jul 28 20:18:49.674429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 836/1825] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:50.075698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-89c6ce47-def2-4b7a-aae9-ce151d942670 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:50.076310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-89c6ce47-def2-4b7a-aae9-ce151d942670 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:50.082480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-89c6ce47-def2-4b7a-aae9-ce151d942670 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:50.082923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-89c6ce47-def2-4b7a-aae9-ce151d942670 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:50.083672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-89c6ce47-def2-4b7a-aae9-ce151d942670 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:50.084113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-89c6ce47-def2-4b7a-aae9-ce151d942670 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:50.212068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-89c6ce47-def2-4b7a-aae9-ce151d942670 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:50.220433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-89c6ce47-def2-4b7a-aae9-ce151d942670 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148645 Jul 28 20:18:50.221002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 990/1826] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:50 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:50.271364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a998573a-467c-4fd6-a15f-8ccadb8f5619 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:50.272032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a998573a-467c-4fd6-a15f-8ccadb8f5619 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:50.278109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a998573a-467c-4fd6-a15f-8ccadb8f5619 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:50.278557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a998573a-467c-4fd6-a15f-8ccadb8f5619 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:50.279306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a998573a-467c-4fd6-a15f-8ccadb8f5619 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:50.279740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a998573a-467c-4fd6-a15f-8ccadb8f5619 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:50.341079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a998573a-467c-4fd6-a15f-8ccadb8f5619 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:50.349301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a998573a-467c-4fd6-a15f-8ccadb8f5619 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081750 Jul 28 20:18:50.349856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 837/1827] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:50.686600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f370562-6e2f-4114-8b98-20ae9e206614 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:50.689760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f370562-6e2f-4114-8b98-20ae9e206614 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:50.695967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f370562-6e2f-4114-8b98-20ae9e206614 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:50.696414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f370562-6e2f-4114-8b98-20ae9e206614 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:50.697212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f370562-6e2f-4114-8b98-20ae9e206614 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:50.697677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f370562-6e2f-4114-8b98-20ae9e206614 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:50.714295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:50.727839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f370562-6e2f-4114-8b98-20ae9e206614 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045625 Jul 28 20:18:50.728389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 991/1828] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:51.242035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-980c9042-f4f0-4fde-a17e-fcf01b6c6e56 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:51.242639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-980c9042-f4f0-4fde-a17e-fcf01b6c6e56 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:51.249630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-980c9042-f4f0-4fde-a17e-fcf01b6c6e56 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:51.250077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-980c9042-f4f0-4fde-a17e-fcf01b6c6e56 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:51.250834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-980c9042-f4f0-4fde-a17e-fcf01b6c6e56 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:51.251266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-980c9042-f4f0-4fde-a17e-fcf01b6c6e56 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:51.370752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ae255aec-a294-440c-a1ea-198e9c881a26 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:51.371357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ae255aec-a294-440c-a1ea-198e9c881a26 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:51.377687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae255aec-a294-440c-a1ea-198e9c881a26 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:51.378128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae255aec-a294-440c-a1ea-198e9c881a26 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:51.378874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae255aec-a294-440c-a1ea-198e9c881a26 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:51.379308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ae255aec-a294-440c-a1ea-198e9c881a26 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:51.398422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-980c9042-f4f0-4fde-a17e-fcf01b6c6e56 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:51.401409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-980c9042-f4f0-4fde-a17e-fcf01b6c6e56 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.163181 Jul 28 20:18:51.401973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 838/1829] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:51.449332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ae255aec-a294-440c-a1ea-198e9c881a26 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:51.458011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ae255aec-a294-440c-a1ea-198e9c881a26 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.091150 Jul 28 20:18:51.458571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 992/1830] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:51 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:51.739798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b6c00b4f-126c-4e1b-9bd3-1b0f5591c949 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:51.741988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b6c00b4f-126c-4e1b-9bd3-1b0f5591c949 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:51.747860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6c00b4f-126c-4e1b-9bd3-1b0f5591c949 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:51.748310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6c00b4f-126c-4e1b-9bd3-1b0f5591c949 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:51.750269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6c00b4f-126c-4e1b-9bd3-1b0f5591c949 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:51.750708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6c00b4f-126c-4e1b-9bd3-1b0f5591c949 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:51.781657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b6c00b4f-126c-4e1b-9bd3-1b0f5591c949 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Jul 28 20:18:51.781657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 839/1831] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:52.423981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a5edc353-1ae5-400c-8fe8-6c9348bc93f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:52.424621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a5edc353-1ae5-400c-8fe8-6c9348bc93f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:52.431137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a5edc353-1ae5-400c-8fe8-6c9348bc93f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:52.431578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a5edc353-1ae5-400c-8fe8-6c9348bc93f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:52.432333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a5edc353-1ae5-400c-8fe8-6c9348bc93f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:52.432791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a5edc353-1ae5-400c-8fe8-6c9348bc93f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:52.480003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-55b6f023-3bc5-43b9-af24-38085124467e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:52.481517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-55b6f023-3bc5-43b9-af24-38085124467e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:52.489535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-55b6f023-3bc5-43b9-af24-38085124467e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:52.490405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-55b6f023-3bc5-43b9-af24-38085124467e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:52.491447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-55b6f023-3bc5-43b9-af24-38085124467e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:52.492157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-55b6f023-3bc5-43b9-af24-38085124467e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:52.570618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-55b6f023-3bc5-43b9-af24-38085124467e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:52.580470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-55b6f023-3bc5-43b9-af24-38085124467e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.104703 Jul 28 20:18:52.592780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 840/1832] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:52 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:52.599266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a5edc353-1ae5-400c-8fe8-6c9348bc93f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:52.607425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a5edc353-1ae5-400c-8fe8-6c9348bc93f2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.187853 Jul 28 20:18:52.608216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 993/1833] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:52 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:52.793308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5cab56cc-e045-4b96-8549-4306d6b5911c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:52.795446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5cab56cc-e045-4b96-8549-4306d6b5911c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:52.801647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cab56cc-e045-4b96-8549-4306d6b5911c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:52.802096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cab56cc-e045-4b96-8549-4306d6b5911c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:52.802852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cab56cc-e045-4b96-8549-4306d6b5911c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:52.803283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cab56cc-e045-4b96-8549-4306d6b5911c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:52.833919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5cab56cc-e045-4b96-8549-4306d6b5911c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Jul 28 20:18:52.834474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 841/1834] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:53.602214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cd6a3c48-ea5b-4927-9f5f-7a9fd1164fef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:53.603436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cd6a3c48-ea5b-4927-9f5f-7a9fd1164fef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:53.610023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd6a3c48-ea5b-4927-9f5f-7a9fd1164fef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:53.610462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd6a3c48-ea5b-4927-9f5f-7a9fd1164fef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:53.611221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd6a3c48-ea5b-4927-9f5f-7a9fd1164fef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:53.611644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd6a3c48-ea5b-4927-9f5f-7a9fd1164fef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:53.629367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a1d23832-c715-43c7-8209-6bd0e9355697 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:53.630119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a1d23832-c715-43c7-8209-6bd0e9355697 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:53.638156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1d23832-c715-43c7-8209-6bd0e9355697 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:53.638845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1d23832-c715-43c7-8209-6bd0e9355697 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:53.640319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1d23832-c715-43c7-8209-6bd0e9355697 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:53.640883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1d23832-c715-43c7-8209-6bd0e9355697 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:53.741929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cd6a3c48-ea5b-4927-9f5f-7a9fd1164fef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:53.750855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cd6a3c48-ea5b-4927-9f5f-7a9fd1164fef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.153105 Jul 28 20:18:53.751433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 994/1835] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:53 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:53.846476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5690fe27-12c2-4bf1-a677-cbd8b0ed7ac6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:53.848748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5690fe27-12c2-4bf1-a677-cbd8b0ed7ac6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:53.855459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5690fe27-12c2-4bf1-a677-cbd8b0ed7ac6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:53.856263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5690fe27-12c2-4bf1-a677-cbd8b0ed7ac6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:53.857311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5690fe27-12c2-4bf1-a677-cbd8b0ed7ac6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:53.858891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5690fe27-12c2-4bf1-a677-cbd8b0ed7ac6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:53.860958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a1d23832-c715-43c7-8209-6bd0e9355697 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:53.872435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a1d23832-c715-43c7-8209-6bd0e9355697 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.246840 Jul 28 20:18:53.873673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 842/1836] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:53.896913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5690fe27-12c2-4bf1-a677-cbd8b0ed7ac6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054336 Jul 28 20:18:53.897473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 995/1837] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:54.773629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-01652ae1-1432-4a48-bb9e-48af9f1e8748 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:54.774245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-01652ae1-1432-4a48-bb9e-48af9f1e8748 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:54.782341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01652ae1-1432-4a48-bb9e-48af9f1e8748 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:54.782791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01652ae1-1432-4a48-bb9e-48af9f1e8748 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:54.783551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01652ae1-1432-4a48-bb9e-48af9f1e8748 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:54.784179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01652ae1-1432-4a48-bb9e-48af9f1e8748 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:54.847976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-01652ae1-1432-4a48-bb9e-48af9f1e8748 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:54.856638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-01652ae1-1432-4a48-bb9e-48af9f1e8748 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.086811 Jul 28 20:18:54.857203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 843/1838] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:54.895494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d484ecbd-af48-48b6-b779-1d3cd2eebfdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:54.896100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d484ecbd-af48-48b6-b779-1d3cd2eebfdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:54.902470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d484ecbd-af48-48b6-b779-1d3cd2eebfdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:54.902907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d484ecbd-af48-48b6-b779-1d3cd2eebfdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:54.903972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d484ecbd-af48-48b6-b779-1d3cd2eebfdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:54.904405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d484ecbd-af48-48b6-b779-1d3cd2eebfdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:54.910430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2eb2bb02-b8ff-413a-b9bd-6c0bb1d48427 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:54.912665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2eb2bb02-b8ff-413a-b9bd-6c0bb1d48427 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:54.919008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2eb2bb02-b8ff-413a-b9bd-6c0bb1d48427 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:54.919461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2eb2bb02-b8ff-413a-b9bd-6c0bb1d48427 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:54.920268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2eb2bb02-b8ff-413a-b9bd-6c0bb1d48427 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:54.921856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2eb2bb02-b8ff-413a-b9bd-6c0bb1d48427 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:54.956018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2eb2bb02-b8ff-413a-b9bd-6c0bb1d48427 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051013 Jul 28 20:18:54.956514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 844/1839] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:55.055807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d484ecbd-af48-48b6-b779-1d3cd2eebfdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:55.064474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d484ecbd-af48-48b6-b779-1d3cd2eebfdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.172894 Jul 28 20:18:55.065057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 996/1840] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:55.879930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b477a5f7-a04f-4a9d-9600-1096d98790ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:55.880839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b477a5f7-a04f-4a9d-9600-1096d98790ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:55.887547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b477a5f7-a04f-4a9d-9600-1096d98790ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:55.887998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b477a5f7-a04f-4a9d-9600-1096d98790ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:55.888844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b477a5f7-a04f-4a9d-9600-1096d98790ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:55.889329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b477a5f7-a04f-4a9d-9600-1096d98790ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:55.968429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ca073a47-96be-42b4-bb04-44550515ae57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:55.970513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ca073a47-96be-42b4-bb04-44550515ae57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:55.977071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca073a47-96be-42b4-bb04-44550515ae57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:55.977513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca073a47-96be-42b4-bb04-44550515ae57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:55.978290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca073a47-96be-42b4-bb04-44550515ae57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:55.978718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca073a47-96be-42b4-bb04-44550515ae57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:55.995493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b477a5f7-a04f-4a9d-9600-1096d98790ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:56.003670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b477a5f7-a04f-4a9d-9600-1096d98790ad tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.127970 Jul 28 20:18:56.004235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 845/1841] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:56.008172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ca073a47-96be-42b4-bb04-44550515ae57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Jul 28 20:18:56.008750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 997/1842] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:55 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:18:56.087281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2549caf8-4927-470d-8aa5-af570e9c4655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:56.087884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2549caf8-4927-470d-8aa5-af570e9c4655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:56.094741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2549caf8-4927-470d-8aa5-af570e9c4655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:56.095190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2549caf8-4927-470d-8aa5-af570e9c4655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:56.095945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2549caf8-4927-470d-8aa5-af570e9c4655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:56.096370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2549caf8-4927-470d-8aa5-af570e9c4655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:56.261525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2549caf8-4927-470d-8aa5-af570e9c4655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:56.268466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:18:56.271026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2549caf8-4927-470d-8aa5-af570e9c4655 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.187675 Jul 28 20:18:56.271587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 846/1843] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:57.020444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-93762b9e-d29c-417c-8a75-b5c1d480fe27 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:57.022958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-93762b9e-d29c-417c-8a75-b5c1d480fe27 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:57.027782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6455c410-b917-47f8-9b87-bfee67d25530 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:57.028292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6455c410-b917-47f8-9b87-bfee67d25530 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:57.029554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93762b9e-d29c-417c-8a75-b5c1d480fe27 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:57.031648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93762b9e-d29c-417c-8a75-b5c1d480fe27 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:57.032432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93762b9e-d29c-417c-8a75-b5c1d480fe27 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:57.032897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93762b9e-d29c-417c-8a75-b5c1d480fe27 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:57.037092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6455c410-b917-47f8-9b87-bfee67d25530 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:57.037541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6455c410-b917-47f8-9b87-bfee67d25530 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:57.038529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6455c410-b917-47f8-9b87-bfee67d25530 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:57.039101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6455c410-b917-47f8-9b87-bfee67d25530 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:57.065029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-93762b9e-d29c-417c-8a75-b5c1d480fe27 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048337 Jul 28 20:18:57.065511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 998/1844] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:57.109841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6455c410-b917-47f8-9b87-bfee67d25530 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:57.121356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6455c410-b917-47f8-9b87-bfee67d25530 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.097377 Jul 28 20:18:57.121936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 847/1845] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:18:57.293410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-529e8bad-db72-44b5-bd32-d74187a9cf3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:57.294041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-529e8bad-db72-44b5-bd32-d74187a9cf3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:57.300142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-529e8bad-db72-44b5-bd32-d74187a9cf3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:57.300619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-529e8bad-db72-44b5-bd32-d74187a9cf3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:57.301373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-529e8bad-db72-44b5-bd32-d74187a9cf3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:57.301796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-529e8bad-db72-44b5-bd32-d74187a9cf3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:57.436652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-529e8bad-db72-44b5-bd32-d74187a9cf3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:57.444931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-529e8bad-db72-44b5-bd32-d74187a9cf3a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.155318 Jul 28 20:18:57.445482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 999/1846] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:57 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:58.077666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dea5e6c8-58b8-4d85-a257-aaa34426d25d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:58.079787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dea5e6c8-58b8-4d85-a257-aaa34426d25d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:58.086773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dea5e6c8-58b8-4d85-a257-aaa34426d25d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:58.087251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dea5e6c8-58b8-4d85-a257-aaa34426d25d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:58.088028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dea5e6c8-58b8-4d85-a257-aaa34426d25d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:58.088494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dea5e6c8-58b8-4d85-a257-aaa34426d25d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:58.120890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dea5e6c8-58b8-4d85-a257-aaa34426d25d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Jul 28 20:18:58.126122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 848/1847] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:58 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:58.142637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a8de41c7-d997-406c-8938-1de5e66d4999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:58.143249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a8de41c7-d997-406c-8938-1de5e66d4999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:58.149707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8de41c7-d997-406c-8938-1de5e66d4999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:58.150155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8de41c7-d997-406c-8938-1de5e66d4999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:58.150908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8de41c7-d997-406c-8938-1de5e66d4999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:58.151340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8de41c7-d997-406c-8938-1de5e66d4999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:58.215948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a8de41c7-d997-406c-8938-1de5e66d4999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:58.224268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a8de41c7-d997-406c-8938-1de5e66d4999 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085789 Jul 28 20:18:58.224863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1000/1848] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:58 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:58.467436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-172fdd83-d522-4b14-a524-3b2ecabfae16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:58.468044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-172fdd83-d522-4b14-a524-3b2ecabfae16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:58.474441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-172fdd83-d522-4b14-a524-3b2ecabfae16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:58.474881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-172fdd83-d522-4b14-a524-3b2ecabfae16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:58.475944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-172fdd83-d522-4b14-a524-3b2ecabfae16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:58.476517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-172fdd83-d522-4b14-a524-3b2ecabfae16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:58.611305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-172fdd83-d522-4b14-a524-3b2ecabfae16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:58.619202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-172fdd83-d522-4b14-a524-3b2ecabfae16 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.155710 Jul 28 20:18:58.619763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 849/1849] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:59.133747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8b44c310-b055-4115-a260-da746e19a738 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:59.135901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8b44c310-b055-4115-a260-da746e19a738 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:59.142107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b44c310-b055-4115-a260-da746e19a738 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:59.142551 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b44c310-b055-4115-a260-da746e19a738 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:59.143307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b44c310-b055-4115-a260-da746e19a738 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:59.144082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b44c310-b055-4115-a260-da746e19a738 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:59.176753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8b44c310-b055-4115-a260-da746e19a738 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046820 Jul 28 20:18:59.177312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1001/1850] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:18:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:18:59.244705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-10c5bb8a-ba64-4af0-8ff8-8ddda1f36dd4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:59.245318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-10c5bb8a-ba64-4af0-8ff8-8ddda1f36dd4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:59.251815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10c5bb8a-ba64-4af0-8ff8-8ddda1f36dd4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:59.252262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10c5bb8a-ba64-4af0-8ff8-8ddda1f36dd4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:59.253046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10c5bb8a-ba64-4af0-8ff8-8ddda1f36dd4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:59.253473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10c5bb8a-ba64-4af0-8ff8-8ddda1f36dd4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:59.314797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-10c5bb8a-ba64-4af0-8ff8-8ddda1f36dd4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:59.322309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-10c5bb8a-ba64-4af0-8ff8-8ddda1f36dd4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081544 Jul 28 20:18:59.322856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 850/1851] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:59 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:18:59.640751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-06917d38-7f81-43e8-bc65-0e521b965c2a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:18:59.641412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-06917d38-7f81-43e8-bc65-0e521b965c2a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:18:59.647457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06917d38-7f81-43e8-bc65-0e521b965c2a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:59.647901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06917d38-7f81-43e8-bc65-0e521b965c2a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:59.648685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06917d38-7f81-43e8-bc65-0e521b965c2a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:18:59.649114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06917d38-7f81-43e8-bc65-0e521b965c2a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:18:59.776793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-06917d38-7f81-43e8-bc65-0e521b965c2a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:18:59.785014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-06917d38-7f81-43e8-bc65-0e521b965c2a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148634 Jul 28 20:18:59.785574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1002/1852] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:18:59 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:00.189548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bfd5a7f7-f2aa-4f1d-83c3-e97aa3c0a1ae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:00.191666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bfd5a7f7-f2aa-4f1d-83c3-e97aa3c0a1ae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:00.197738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bfd5a7f7-f2aa-4f1d-83c3-e97aa3c0a1ae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:00.198189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bfd5a7f7-f2aa-4f1d-83c3-e97aa3c0a1ae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:00.198954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bfd5a7f7-f2aa-4f1d-83c3-e97aa3c0a1ae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:00.199392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bfd5a7f7-f2aa-4f1d-83c3-e97aa3c0a1ae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:00.227579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bfd5a7f7-f2aa-4f1d-83c3-e97aa3c0a1ae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042665 Jul 28 20:19:00.228125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 851/1853] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:00.343117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cdb8a793-7cd7-4f78-8fd4-19cdd04bad67 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:00.343729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cdb8a793-7cd7-4f78-8fd4-19cdd04bad67 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:00.350354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdb8a793-7cd7-4f78-8fd4-19cdd04bad67 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:00.350822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdb8a793-7cd7-4f78-8fd4-19cdd04bad67 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:00.351575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdb8a793-7cd7-4f78-8fd4-19cdd04bad67 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:00.352003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cdb8a793-7cd7-4f78-8fd4-19cdd04bad67 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:00.417012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cdb8a793-7cd7-4f78-8fd4-19cdd04bad67 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:00.424974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cdb8a793-7cd7-4f78-8fd4-19cdd04bad67 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085767 Jul 28 20:19:00.425528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1003/1854] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:00 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:00.806101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-32a7df48-4e55-4f6c-a214-0e8aed766d0a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:00.806628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-32a7df48-4e55-4f6c-a214-0e8aed766d0a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:00.812854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32a7df48-4e55-4f6c-a214-0e8aed766d0a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:00.813300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32a7df48-4e55-4f6c-a214-0e8aed766d0a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:00.814048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32a7df48-4e55-4f6c-a214-0e8aed766d0a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:00.814478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32a7df48-4e55-4f6c-a214-0e8aed766d0a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:00.939967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-32a7df48-4e55-4f6c-a214-0e8aed766d0a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:00.947930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-32a7df48-4e55-4f6c-a214-0e8aed766d0a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.145719 Jul 28 20:19:00.948487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 852/1855] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:01.240022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-374deb4b-2269-4d6c-befc-7d2457d26306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:01.242210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-374deb4b-2269-4d6c-befc-7d2457d26306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:01.249281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-374deb4b-2269-4d6c-befc-7d2457d26306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:01.249509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-374deb4b-2269-4d6c-befc-7d2457d26306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:01.250265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-374deb4b-2269-4d6c-befc-7d2457d26306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:01.250691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-374deb4b-2269-4d6c-befc-7d2457d26306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:01.279547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-374deb4b-2269-4d6c-befc-7d2457d26306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043421 Jul 28 20:19:01.280094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1004/1856] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:01.446204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ea2f6c94-1cd9-4ff5-9480-429f16834912 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:01.446744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ea2f6c94-1cd9-4ff5-9480-429f16834912 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:01.453363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea2f6c94-1cd9-4ff5-9480-429f16834912 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:01.453814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea2f6c94-1cd9-4ff5-9480-429f16834912 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:01.454589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea2f6c94-1cd9-4ff5-9480-429f16834912 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:01.455003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ea2f6c94-1cd9-4ff5-9480-429f16834912 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:01.516902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ea2f6c94-1cd9-4ff5-9480-429f16834912 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:01.524349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ea2f6c94-1cd9-4ff5-9480-429f16834912 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082127 Jul 28 20:19:01.524941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 853/1857] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:01.970067 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2382c444-053b-4696-b341-4669c3726f4b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:01.970667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2382c444-053b-4696-b341-4669c3726f4b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:01.977317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2382c444-053b-4696-b341-4669c3726f4b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:01.977772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2382c444-053b-4696-b341-4669c3726f4b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:01.978523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2382c444-053b-4696-b341-4669c3726f4b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:01.979236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2382c444-053b-4696-b341-4669c3726f4b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:02.114570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2382c444-053b-4696-b341-4669c3726f4b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:02.122450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2382c444-053b-4696-b341-4669c3726f4b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.156769 Jul 28 20:19:02.123001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1005/1858] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:02.292243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-21d96d81-f261-453f-9e93-e000c20f7a94 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:02.294391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-21d96d81-f261-453f-9e93-e000c20f7a94 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:02.307071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21d96d81-f261-453f-9e93-e000c20f7a94 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:02.307540 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21d96d81-f261-453f-9e93-e000c20f7a94 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:02.308292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21d96d81-f261-453f-9e93-e000c20f7a94 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:02.308756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21d96d81-f261-453f-9e93-e000c20f7a94 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:02.339287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-21d96d81-f261-453f-9e93-e000c20f7a94 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050880 Jul 28 20:19:02.339851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 854/1859] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:02 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:02.546462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ca8d2c67-dd17-4538-af7a-efa8ef1aa364 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:02.546981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ca8d2c67-dd17-4538-af7a-efa8ef1aa364 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:02.553103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c67-dd17-4538-af7a-efa8ef1aa364 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:02.553545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c67-dd17-4538-af7a-efa8ef1aa364 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:02.554288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c67-dd17-4538-af7a-efa8ef1aa364 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:02.554721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca8d2c67-dd17-4538-af7a-efa8ef1aa364 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:02.786582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ca8d2c67-dd17-4538-af7a-efa8ef1aa364 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:02.794162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ca8d2c67-dd17-4538-af7a-efa8ef1aa364 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.252337 Jul 28 20:19:02.794739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1006/1860] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:03.143861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6197e02c-b212-445c-b4d6-70f87c3619f1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:03.144499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6197e02c-b212-445c-b4d6-70f87c3619f1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:03.150685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6197e02c-b212-445c-b4d6-70f87c3619f1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:03.151133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6197e02c-b212-445c-b4d6-70f87c3619f1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:03.151887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6197e02c-b212-445c-b4d6-70f87c3619f1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:03.152307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6197e02c-b212-445c-b4d6-70f87c3619f1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:03.343579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6197e02c-b212-445c-b4d6-70f87c3619f1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:03.351795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6197e02c-b212-445c-b4d6-70f87c3619f1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.211727 Jul 28 20:19:03.352373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 855/1861] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:03 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:03.490771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c2900209-0871-45d5-847a-491ecf23a0c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:03.493379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c2900209-0871-45d5-847a-491ecf23a0c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:03.500735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2900209-0871-45d5-847a-491ecf23a0c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:03.501188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2900209-0871-45d5-847a-491ecf23a0c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:03.502436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2900209-0871-45d5-847a-491ecf23a0c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:03.502959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2900209-0871-45d5-847a-491ecf23a0c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:03.539087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c2900209-0871-45d5-847a-491ecf23a0c5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191573 Jul 28 20:19:03.539650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1007/1862] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:03.815222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b69516ea-4497-4e69-a82f-252447abbd75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:03.815745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b69516ea-4497-4e69-a82f-252447abbd75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:03.822058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b69516ea-4497-4e69-a82f-252447abbd75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:03.822498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b69516ea-4497-4e69-a82f-252447abbd75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:03.823256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b69516ea-4497-4e69-a82f-252447abbd75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:03.823679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b69516ea-4497-4e69-a82f-252447abbd75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:03.887604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b69516ea-4497-4e69-a82f-252447abbd75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:03.896106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b69516ea-4497-4e69-a82f-252447abbd75 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085073 Jul 28 20:19:03.896733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 856/1863] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:03 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:04.374744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-043dfecc-08a9-433c-8ed6-a7d18bf2fcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:04.375343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-043dfecc-08a9-433c-8ed6-a7d18bf2fcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:04.381915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-043dfecc-08a9-433c-8ed6-a7d18bf2fcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:04.382362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-043dfecc-08a9-433c-8ed6-a7d18bf2fcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:04.383113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-043dfecc-08a9-433c-8ed6-a7d18bf2fcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:04.383541 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-043dfecc-08a9-433c-8ed6-a7d18bf2fcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:04.387383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:04.510779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-043dfecc-08a9-433c-8ed6-a7d18bf2fcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:04.519598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-043dfecc-08a9-433c-8ed6-a7d18bf2fcf9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149276 Jul 28 20:19:04.520149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1008/1864] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:04 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:04.552240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-66a1c0b5-8345-4fca-a0d7-b625a4963bf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:04.554331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-66a1c0b5-8345-4fca-a0d7-b625a4963bf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:04.561348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-66a1c0b5-8345-4fca-a0d7-b625a4963bf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:04.561807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-66a1c0b5-8345-4fca-a0d7-b625a4963bf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:04.562564 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-66a1c0b5-8345-4fca-a0d7-b625a4963bf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:04.562999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-66a1c0b5-8345-4fca-a0d7-b625a4963bf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:04.591340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-66a1c0b5-8345-4fca-a0d7-b625a4963bf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 Jul 28 20:19:04.591999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 857/1865] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:04.917901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-18e8375d-a357-4921-a1a0-473cfb27638b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:04.918512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-18e8375d-a357-4921-a1a0-473cfb27638b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:04.925568 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18e8375d-a357-4921-a1a0-473cfb27638b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:04.926002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18e8375d-a357-4921-a1a0-473cfb27638b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:04.926751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18e8375d-a357-4921-a1a0-473cfb27638b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:04.927182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18e8375d-a357-4921-a1a0-473cfb27638b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:04.987958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-18e8375d-a357-4921-a1a0-473cfb27638b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:04.995779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-18e8375d-a357-4921-a1a0-473cfb27638b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081722 Jul 28 20:19:04.996336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1009/1866] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:04 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:05.540599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-71c1fb72-b285-488f-bbf7-9a8ab500c465 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:05.541215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-71c1fb72-b285-488f-bbf7-9a8ab500c465 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:05.547430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71c1fb72-b285-488f-bbf7-9a8ab500c465 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:05.547876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71c1fb72-b285-488f-bbf7-9a8ab500c465 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:05.548665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71c1fb72-b285-488f-bbf7-9a8ab500c465 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:05.549102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71c1fb72-b285-488f-bbf7-9a8ab500c465 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:05.603601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0257d513-dca7-4f7b-9ded-d9207a357907 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:05.605897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0257d513-dca7-4f7b-9ded-d9207a357907 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:05.612275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0257d513-dca7-4f7b-9ded-d9207a357907 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:05.612748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0257d513-dca7-4f7b-9ded-d9207a357907 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:05.613513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0257d513-dca7-4f7b-9ded-d9207a357907 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:05.613936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0257d513-dca7-4f7b-9ded-d9207a357907 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:05.643301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0257d513-dca7-4f7b-9ded-d9207a357907 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Jul 28 20:19:05.643865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1010/1867] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:05.681807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-71c1fb72-b285-488f-bbf7-9a8ab500c465 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:05.690464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-71c1fb72-b285-488f-bbf7-9a8ab500c465 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.153823 Jul 28 20:19:05.691005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 858/1868] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:05 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:06.017622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d6b1c145-dd76-49eb-ac8b-74cc5b82a5e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:06.018149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d6b1c145-dd76-49eb-ac8b-74cc5b82a5e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:06.024158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b1c145-dd76-49eb-ac8b-74cc5b82a5e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:06.024625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b1c145-dd76-49eb-ac8b-74cc5b82a5e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:06.025373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b1c145-dd76-49eb-ac8b-74cc5b82a5e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:06.025836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b1c145-dd76-49eb-ac8b-74cc5b82a5e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:06.086761 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d6b1c145-dd76-49eb-ac8b-74cc5b82a5e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:06.094564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d6b1c145-dd76-49eb-ac8b-74cc5b82a5e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081662 Jul 28 20:19:06.095130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1011/1869] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:06 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:06.657012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5280ab42-f07c-48ed-8c34-b22115fa0cf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:06.659122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5280ab42-f07c-48ed-8c34-b22115fa0cf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:06.665661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5280ab42-f07c-48ed-8c34-b22115fa0cf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:06.666106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5280ab42-f07c-48ed-8c34-b22115fa0cf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:06.666853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5280ab42-f07c-48ed-8c34-b22115fa0cf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:06.667281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5280ab42-f07c-48ed-8c34-b22115fa0cf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:06.698178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5280ab42-f07c-48ed-8c34-b22115fa0cf6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Jul 28 20:19:06.698868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 859/1870] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:06.712208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-27091df0-6af8-4f76-b9d7-1f61966c70aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:06.712856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-27091df0-6af8-4f76-b9d7-1f61966c70aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:06.719751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27091df0-6af8-4f76-b9d7-1f61966c70aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:06.720200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27091df0-6af8-4f76-b9d7-1f61966c70aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:06.721025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27091df0-6af8-4f76-b9d7-1f61966c70aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:06.721461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27091df0-6af8-4f76-b9d7-1f61966c70aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:06.852228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-27091df0-6af8-4f76-b9d7-1f61966c70aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:06.860487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-27091df0-6af8-4f76-b9d7-1f61966c70aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152092 Jul 28 20:19:06.861080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1012/1871] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:06 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:07.116577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d4e8e08c-70a7-4102-866e-9701fab2caef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:07.117190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d4e8e08c-70a7-4102-866e-9701fab2caef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:07.123545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4e8e08c-70a7-4102-866e-9701fab2caef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:07.124134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4e8e08c-70a7-4102-866e-9701fab2caef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:07.124924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4e8e08c-70a7-4102-866e-9701fab2caef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:07.125358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4e8e08c-70a7-4102-866e-9701fab2caef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:07.192869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d4e8e08c-70a7-4102-866e-9701fab2caef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:07.200409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d4e8e08c-70a7-4102-866e-9701fab2caef tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087723 Jul 28 20:19:07.200992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 860/1872] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:07 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:07.711517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-601396bd-bb63-451a-85f0-4eeb4421d3db tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:07.713683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-601396bd-bb63-451a-85f0-4eeb4421d3db tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:07.720428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-601396bd-bb63-451a-85f0-4eeb4421d3db tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:07.720904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-601396bd-bb63-451a-85f0-4eeb4421d3db tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:07.721660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-601396bd-bb63-451a-85f0-4eeb4421d3db tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:07.722091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-601396bd-bb63-451a-85f0-4eeb4421d3db tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:07.751206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-601396bd-bb63-451a-85f0-4eeb4421d3db tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Jul 28 20:19:07.751756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1013/1873] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:07.882436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b0537185-e004-4dac-9a4f-bb21829dec89 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:07.882955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b0537185-e004-4dac-9a4f-bb21829dec89 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:07.889980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b0537185-e004-4dac-9a4f-bb21829dec89 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:07.890424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b0537185-e004-4dac-9a4f-bb21829dec89 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:07.891182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b0537185-e004-4dac-9a4f-bb21829dec89 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:07.891615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b0537185-e004-4dac-9a4f-bb21829dec89 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:08.020014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b0537185-e004-4dac-9a4f-bb21829dec89 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:08.028009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b0537185-e004-4dac-9a4f-bb21829dec89 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149490 Jul 28 20:19:08.028593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 861/1874] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:07 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:08.221570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-126bb5b5-677a-4ba6-8d5d-da59db99424d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:08.222202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-126bb5b5-677a-4ba6-8d5d-da59db99424d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:08.228142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-126bb5b5-677a-4ba6-8d5d-da59db99424d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:08.228618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-126bb5b5-677a-4ba6-8d5d-da59db99424d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:08.229364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-126bb5b5-677a-4ba6-8d5d-da59db99424d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:08.229787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-126bb5b5-677a-4ba6-8d5d-da59db99424d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:08.289868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-126bb5b5-677a-4ba6-8d5d-da59db99424d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:08.297767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-126bb5b5-677a-4ba6-8d5d-da59db99424d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080203 Jul 28 20:19:08.298315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1014/1875] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:08 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:08.764143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5b21ea59-42b8-423e-8e5c-4f791791a0d9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:08.766386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5b21ea59-42b8-423e-8e5c-4f791791a0d9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:08.772424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b21ea59-42b8-423e-8e5c-4f791791a0d9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:08.772899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b21ea59-42b8-423e-8e5c-4f791791a0d9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:08.773652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b21ea59-42b8-423e-8e5c-4f791791a0d9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:08.774085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b21ea59-42b8-423e-8e5c-4f791791a0d9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:08.804341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5b21ea59-42b8-423e-8e5c-4f791791a0d9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Jul 28 20:19:08.804913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 862/1876] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:09.049914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-57c75fbb-9f09-4a78-ba66-5425dc2fa444 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:09.050516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-57c75fbb-9f09-4a78-ba66-5425dc2fa444 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:09.056900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57c75fbb-9f09-4a78-ba66-5425dc2fa444 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:09.057347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57c75fbb-9f09-4a78-ba66-5425dc2fa444 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:09.058100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57c75fbb-9f09-4a78-ba66-5425dc2fa444 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:09.058528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57c75fbb-9f09-4a78-ba66-5425dc2fa444 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:09.186961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-57c75fbb-9f09-4a78-ba66-5425dc2fa444 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:09.194848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-57c75fbb-9f09-4a78-ba66-5425dc2fa444 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149493 Jul 28 20:19:09.195393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1015/1877] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:09 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:09.318349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c855e82c-33d1-4035-8151-63cf0bcaa9f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:09.318889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c855e82c-33d1-4035-8151-63cf0bcaa9f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:09.325346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c855e82c-33d1-4035-8151-63cf0bcaa9f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:09.325790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c855e82c-33d1-4035-8151-63cf0bcaa9f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:09.327121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c855e82c-33d1-4035-8151-63cf0bcaa9f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:09.327488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c855e82c-33d1-4035-8151-63cf0bcaa9f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:09.345940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:09.390599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c855e82c-33d1-4035-8151-63cf0bcaa9f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:09.398082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c855e82c-33d1-4035-8151-63cf0bcaa9f0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083648 Jul 28 20:19:09.398642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 863/1878] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:09 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:09.817098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f8f86087-a73a-485e-af28-15e84ef18f70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:09.819458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f8f86087-a73a-485e-af28-15e84ef18f70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:09.826832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8f86087-a73a-485e-af28-15e84ef18f70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:09.827304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8f86087-a73a-485e-af28-15e84ef18f70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:09.828042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8f86087-a73a-485e-af28-15e84ef18f70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:09.828474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8f86087-a73a-485e-af28-15e84ef18f70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:09.857063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f8f86087-a73a-485e-af28-15e84ef18f70 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Jul 28 20:19:09.857720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1016/1879] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:09 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:10.217653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e2cd2d8b-b52f-40e2-9099-327c583519c2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:10.218272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e2cd2d8b-b52f-40e2-9099-327c583519c2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:10.224266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2cd2d8b-b52f-40e2-9099-327c583519c2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:10.224753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2cd2d8b-b52f-40e2-9099-327c583519c2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:10.225506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2cd2d8b-b52f-40e2-9099-327c583519c2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:10.226235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2cd2d8b-b52f-40e2-9099-327c583519c2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:10.377300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e2cd2d8b-b52f-40e2-9099-327c583519c2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:10.385271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e2cd2d8b-b52f-40e2-9099-327c583519c2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.172168 Jul 28 20:19:10.385833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 864/1880] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:10 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:10.419021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-094832c0-879c-4875-86a3-88de38718620 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:10.419570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-094832c0-879c-4875-86a3-88de38718620 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:10.426146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-094832c0-879c-4875-86a3-88de38718620 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:10.426591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-094832c0-879c-4875-86a3-88de38718620 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:10.427358 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-094832c0-879c-4875-86a3-88de38718620 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:10.427792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-094832c0-879c-4875-86a3-88de38718620 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:10.491356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-094832c0-879c-4875-86a3-88de38718620 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:10.499483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-094832c0-879c-4875-86a3-88de38718620 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084293 Jul 28 20:19:10.500039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1017/1881] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:10 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:10.869257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1cd115b3-e1c9-459d-85eb-eef5eabea12e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:10.871393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1cd115b3-e1c9-459d-85eb-eef5eabea12e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:10.878011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1cd115b3-e1c9-459d-85eb-eef5eabea12e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:10.878452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1cd115b3-e1c9-459d-85eb-eef5eabea12e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:10.879203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1cd115b3-e1c9-459d-85eb-eef5eabea12e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:10.879633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1cd115b3-e1c9-459d-85eb-eef5eabea12e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:10.907777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1cd115b3-e1c9-459d-85eb-eef5eabea12e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042476 Jul 28 20:19:10.908319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 865/1882] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:11.407821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e47e0305-4cbc-425b-a706-f59121954b7f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:11.408430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e47e0305-4cbc-425b-a706-f59121954b7f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:11.414458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47e0305-4cbc-425b-a706-f59121954b7f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:11.414908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47e0305-4cbc-425b-a706-f59121954b7f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:11.415716 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47e0305-4cbc-425b-a706-f59121954b7f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:11.416101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47e0305-4cbc-425b-a706-f59121954b7f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:11.519780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b09a1993-24b3-450d-b557-4f601cc6132e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:11.520396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b09a1993-24b3-450d-b557-4f601cc6132e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:11.526937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b09a1993-24b3-450d-b557-4f601cc6132e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:11.527387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b09a1993-24b3-450d-b557-4f601cc6132e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:11.528152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b09a1993-24b3-450d-b557-4f601cc6132e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:11.528613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b09a1993-24b3-450d-b557-4f601cc6132e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:11.543600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e47e0305-4cbc-425b-a706-f59121954b7f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:11.551802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e47e0305-4cbc-425b-a706-f59121954b7f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148705 Jul 28 20:19:11.560783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1018/1883] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:11 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:11.598297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b09a1993-24b3-450d-b557-4f601cc6132e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:11.605951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b09a1993-24b3-450d-b557-4f601cc6132e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.090061 Jul 28 20:19:11.606518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 866/1884] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:11 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:11.920234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4146a80a-26d1-46b6-93d4-ca9b100b9504 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:11.922543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4146a80a-26d1-46b6-93d4-ca9b100b9504 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:11.928560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4146a80a-26d1-46b6-93d4-ca9b100b9504 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:11.929011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4146a80a-26d1-46b6-93d4-ca9b100b9504 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:11.929761 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4146a80a-26d1-46b6-93d4-ca9b100b9504 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:11.930192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4146a80a-26d1-46b6-93d4-ca9b100b9504 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:11.960035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4146a80a-26d1-46b6-93d4-ca9b100b9504 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Jul 28 20:19:11.960589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1019/1885] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:12.573061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c782bbef-1752-4e11-9476-812fa32631ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:12.573683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c782bbef-1752-4e11-9476-812fa32631ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:12.580982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c782bbef-1752-4e11-9476-812fa32631ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:12.581433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c782bbef-1752-4e11-9476-812fa32631ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:12.582188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c782bbef-1752-4e11-9476-812fa32631ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:12.582619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c782bbef-1752-4e11-9476-812fa32631ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:12.626491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a8a7c20b-bab3-46a3-8869-be7f552c795c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:12.627101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a8a7c20b-bab3-46a3-8869-be7f552c795c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:12.633834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8a7c20b-bab3-46a3-8869-be7f552c795c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:12.634350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8a7c20b-bab3-46a3-8869-be7f552c795c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:12.635191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8a7c20b-bab3-46a3-8869-be7f552c795c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:12.635683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8a7c20b-bab3-46a3-8869-be7f552c795c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:12.705889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a8a7c20b-bab3-46a3-8869-be7f552c795c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:12.713412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a8a7c20b-bab3-46a3-8869-be7f552c795c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.090884 Jul 28 20:19:12.714116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1020/1886] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:12 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:12.741269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c782bbef-1752-4e11-9476-812fa32631ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:12.749364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c782bbef-1752-4e11-9476-812fa32631ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.180199 Jul 28 20:19:12.749919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 867/1887] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:12 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:12.972927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f783b6bf-ec68-4326-8ec5-ac1411255bd8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:12.974994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f783b6bf-ec68-4326-8ec5-ac1411255bd8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:12.981052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f783b6bf-ec68-4326-8ec5-ac1411255bd8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:12.981498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f783b6bf-ec68-4326-8ec5-ac1411255bd8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:12.982286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f783b6bf-ec68-4326-8ec5-ac1411255bd8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:12.982790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f783b6bf-ec68-4326-8ec5-ac1411255bd8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:13.011080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f783b6bf-ec68-4326-8ec5-ac1411255bd8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042214 Jul 28 20:19:13.011620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1021/1888] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:13.735801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ae70d60a-27ff-4ef1-8a1a-8b1b6aba8d93 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:13.736405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ae70d60a-27ff-4ef1-8a1a-8b1b6aba8d93 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:13.742976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae70d60a-27ff-4ef1-8a1a-8b1b6aba8d93 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:13.743415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae70d60a-27ff-4ef1-8a1a-8b1b6aba8d93 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:13.744158 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae70d60a-27ff-4ef1-8a1a-8b1b6aba8d93 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:13.744620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae70d60a-27ff-4ef1-8a1a-8b1b6aba8d93 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:13.770597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4395f566-aaa8-44e5-93cc-ea916a822ba3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:13.771207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4395f566-aaa8-44e5-93cc-ea916a822ba3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:13.777658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4395f566-aaa8-44e5-93cc-ea916a822ba3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:13.778102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4395f566-aaa8-44e5-93cc-ea916a822ba3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:13.778856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4395f566-aaa8-44e5-93cc-ea916a822ba3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:13.779783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4395f566-aaa8-44e5-93cc-ea916a822ba3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:13.806577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ae70d60a-27ff-4ef1-8a1a-8b1b6aba8d93 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:13.815049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ae70d60a-27ff-4ef1-8a1a-8b1b6aba8d93 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083926 Jul 28 20:19:13.815628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 868/1889] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:13 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:13.906186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4395f566-aaa8-44e5-93cc-ea916a822ba3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:13.914084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4395f566-aaa8-44e5-93cc-ea916a822ba3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147276 Jul 28 20:19:13.914632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1022/1890] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:13 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:14.023324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6f007a24-57b6-4d2d-b07f-2da2af62e3c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:14.025467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6f007a24-57b6-4d2d-b07f-2da2af62e3c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:14.032231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f007a24-57b6-4d2d-b07f-2da2af62e3c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:14.032712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f007a24-57b6-4d2d-b07f-2da2af62e3c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:14.033460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f007a24-57b6-4d2d-b07f-2da2af62e3c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:14.033888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f007a24-57b6-4d2d-b07f-2da2af62e3c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:14.062845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6f007a24-57b6-4d2d-b07f-2da2af62e3c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043490 Jul 28 20:19:14.063382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 869/1891] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:14.835662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-16a4d799-a2f8-4957-98ad-d1189ed51599 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:14.836277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-16a4d799-a2f8-4957-98ad-d1189ed51599 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:14.843448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16a4d799-a2f8-4957-98ad-d1189ed51599 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:14.843897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16a4d799-a2f8-4957-98ad-d1189ed51599 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:14.844676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16a4d799-a2f8-4957-98ad-d1189ed51599 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:14.845110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16a4d799-a2f8-4957-98ad-d1189ed51599 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:14.908220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-16a4d799-a2f8-4957-98ad-d1189ed51599 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:14.915728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-16a4d799-a2f8-4957-98ad-d1189ed51599 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083932 Jul 28 20:19:14.916279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1023/1892] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:14.935717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b181b09-3e16-4d0c-a971-51e8fd704e73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:14.936334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b181b09-3e16-4d0c-a971-51e8fd704e73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:14.942794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b181b09-3e16-4d0c-a971-51e8fd704e73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:14.943244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b181b09-3e16-4d0c-a971-51e8fd704e73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:14.944001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b181b09-3e16-4d0c-a971-51e8fd704e73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:14.944436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b181b09-3e16-4d0c-a971-51e8fd704e73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:15.071449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b181b09-3e16-4d0c-a971-51e8fd704e73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:15.074931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-26e741ff-f1dd-41d1-8103-5b17caa6bc7d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:15.077717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-26e741ff-f1dd-41d1-8103-5b17caa6bc7d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:15.080009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b181b09-3e16-4d0c-a971-51e8fd704e73 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148242 Jul 28 20:19:15.080595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 870/1893] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:14 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:15.083985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26e741ff-f1dd-41d1-8103-5b17caa6bc7d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:15.084466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26e741ff-f1dd-41d1-8103-5b17caa6bc7d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:15.085292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26e741ff-f1dd-41d1-8103-5b17caa6bc7d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:15.085782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26e741ff-f1dd-41d1-8103-5b17caa6bc7d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:15.110691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:15.115785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-26e741ff-f1dd-41d1-8103-5b17caa6bc7d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Jul 28 20:19:15.116337 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1024/1894] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:15.937758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b735ad2f-0725-44b3-9815-c6c0a4a0bc72 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:15.938367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b735ad2f-0725-44b3-9815-c6c0a4a0bc72 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:15.944936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b735ad2f-0725-44b3-9815-c6c0a4a0bc72 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:15.945381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b735ad2f-0725-44b3-9815-c6c0a4a0bc72 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:15.946130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b735ad2f-0725-44b3-9815-c6c0a4a0bc72 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:15.946557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b735ad2f-0725-44b3-9815-c6c0a4a0bc72 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:16.006264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b735ad2f-0725-44b3-9815-c6c0a4a0bc72 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:16.013719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b735ad2f-0725-44b3-9815-c6c0a4a0bc72 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080488 Jul 28 20:19:16.014274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 871/1895] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:15 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:16.101949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-65b033d9-8466-4abd-951b-e30b47775b3b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:16.102545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-65b033d9-8466-4abd-951b-e30b47775b3b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:16.109595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65b033d9-8466-4abd-951b-e30b47775b3b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:16.110036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65b033d9-8466-4abd-951b-e30b47775b3b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:16.110777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65b033d9-8466-4abd-951b-e30b47775b3b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:16.111200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65b033d9-8466-4abd-951b-e30b47775b3b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:16.128341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-feef6143-2bd6-4224-9421-75806760bd81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:16.130518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-feef6143-2bd6-4224-9421-75806760bd81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:16.136440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-feef6143-2bd6-4224-9421-75806760bd81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:16.136929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-feef6143-2bd6-4224-9421-75806760bd81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:16.137693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-feef6143-2bd6-4224-9421-75806760bd81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:16.138128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-feef6143-2bd6-4224-9421-75806760bd81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:16.168925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-feef6143-2bd6-4224-9421-75806760bd81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Jul 28 20:19:16.169721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 872/1896] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:16.244974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-65b033d9-8466-4abd-951b-e30b47775b3b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:16.252873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-65b033d9-8466-4abd-951b-e30b47775b3b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.154847 Jul 28 20:19:16.253431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1025/1897] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:16 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:17.035144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5cf7bc35-9b6d-4227-8455-0c165a2de1bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:17.035752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5cf7bc35-9b6d-4227-8455-0c165a2de1bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:17.042229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cf7bc35-9b6d-4227-8455-0c165a2de1bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:17.042674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cf7bc35-9b6d-4227-8455-0c165a2de1bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:17.043430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cf7bc35-9b6d-4227-8455-0c165a2de1bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:17.043870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cf7bc35-9b6d-4227-8455-0c165a2de1bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:17.103916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5cf7bc35-9b6d-4227-8455-0c165a2de1bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:17.111974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5cf7bc35-9b6d-4227-8455-0c165a2de1bb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081083 Jul 28 20:19:17.112524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 873/1898] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:17 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:17.182126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f16ba4a8-9685-4d12-80b9-492e6b1b87d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:17.184244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f16ba4a8-9685-4d12-80b9-492e6b1b87d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:17.191617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f16ba4a8-9685-4d12-80b9-492e6b1b87d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:17.192058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f16ba4a8-9685-4d12-80b9-492e6b1b87d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:17.192835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f16ba4a8-9685-4d12-80b9-492e6b1b87d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:17.193263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f16ba4a8-9685-4d12-80b9-492e6b1b87d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:17.222108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f16ba4a8-9685-4d12-80b9-492e6b1b87d5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Jul 28 20:19:17.222648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1026/1899] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:17.274617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e2e012ab-06e8-46e2-b45f-e26e4c3da56b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:17.275363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e2e012ab-06e8-46e2-b45f-e26e4c3da56b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:17.281789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2e012ab-06e8-46e2-b45f-e26e4c3da56b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:17.282240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2e012ab-06e8-46e2-b45f-e26e4c3da56b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:17.283001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2e012ab-06e8-46e2-b45f-e26e4c3da56b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:17.283436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2e012ab-06e8-46e2-b45f-e26e4c3da56b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:17.409458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e2e012ab-06e8-46e2-b45f-e26e4c3da56b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:17.417356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e2e012ab-06e8-46e2-b45f-e26e4c3da56b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146586 Jul 28 20:19:17.417920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 874/1900] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:17 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:18.133995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e5145d3a-abd5-4553-9b73-60c46b05e88f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:18.134621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e5145d3a-abd5-4553-9b73-60c46b05e88f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:18.140721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5145d3a-abd5-4553-9b73-60c46b05e88f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:18.141162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5145d3a-abd5-4553-9b73-60c46b05e88f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:18.141904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5145d3a-abd5-4553-9b73-60c46b05e88f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:18.142329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5145d3a-abd5-4553-9b73-60c46b05e88f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:18.205680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5145d3a-abd5-4553-9b73-60c46b05e88f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:18.213166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e5145d3a-abd5-4553-9b73-60c46b05e88f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083069 Jul 28 20:19:18.213710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1027/1901] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:18 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:18.234830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0de97768-fe01-462c-9d04-105170430da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:18.237005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0de97768-fe01-462c-9d04-105170430da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:18.239311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=84 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:18.244849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0de97768-fe01-462c-9d04-105170430da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:18.245287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0de97768-fe01-462c-9d04-105170430da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:18.246035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0de97768-fe01-462c-9d04-105170430da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:18.246459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0de97768-fe01-462c-9d04-105170430da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:18.275316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0de97768-fe01-462c-9d04-105170430da9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Jul 28 20:19:18.275847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 875/1902] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:18.440249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ccc9f4c6-728b-4800-821c-3e14e6ff16c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:18.440816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ccc9f4c6-728b-4800-821c-3e14e6ff16c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:18.446790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccc9f4c6-728b-4800-821c-3e14e6ff16c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:18.447235 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccc9f4c6-728b-4800-821c-3e14e6ff16c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:18.447982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccc9f4c6-728b-4800-821c-3e14e6ff16c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:18.448411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccc9f4c6-728b-4800-821c-3e14e6ff16c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:18.575254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ccc9f4c6-728b-4800-821c-3e14e6ff16c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:18.585201 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ccc9f4c6-728b-4800-821c-3e14e6ff16c0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149907 Jul 28 20:19:18.585755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1028/1903] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:18 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:19.234529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-53a89127-0812-4dc1-9b57-102e6b6b40e7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:19.235125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-53a89127-0812-4dc1-9b57-102e6b6b40e7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:19.241550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53a89127-0812-4dc1-9b57-102e6b6b40e7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:19.241988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53a89127-0812-4dc1-9b57-102e6b6b40e7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:19.242730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53a89127-0812-4dc1-9b57-102e6b6b40e7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:19.243154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53a89127-0812-4dc1-9b57-102e6b6b40e7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:19.287968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a97d0467-5857-4529-8169-973de4dee349 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:19.290163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a97d0467-5857-4529-8169-973de4dee349 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:19.292477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=82 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:19.298863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a97d0467-5857-4529-8169-973de4dee349 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:19.299314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a97d0467-5857-4529-8169-973de4dee349 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:19.300087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a97d0467-5857-4529-8169-973de4dee349 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:19.300610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a97d0467-5857-4529-8169-973de4dee349 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:19.311201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-53a89127-0812-4dc1-9b57-102e6b6b40e7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:19.318676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-53a89127-0812-4dc1-9b57-102e6b6b40e7 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.088645 Jul 28 20:19:19.319228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 876/1904] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:19 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:19.331947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a97d0467-5857-4529-8169-973de4dee349 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047871 Jul 28 20:19:19.332517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1029/1905] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:19.606613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f55fb5be-3422-408e-a77b-05ab19d9e211 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:19.607784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f55fb5be-3422-408e-a77b-05ab19d9e211 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:19.614168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f55fb5be-3422-408e-a77b-05ab19d9e211 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:19.614616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f55fb5be-3422-408e-a77b-05ab19d9e211 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:19.615365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f55fb5be-3422-408e-a77b-05ab19d9e211 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:19.615798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f55fb5be-3422-408e-a77b-05ab19d9e211 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:19.756183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f55fb5be-3422-408e-a77b-05ab19d9e211 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:19.764186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f55fb5be-3422-408e-a77b-05ab19d9e211 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.161375 Jul 28 20:19:19.764782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 877/1906] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:19 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:20.339193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-42b02148-a04a-4c9d-92ec-e550d1727b78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:20.339805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-42b02148-a04a-4c9d-92ec-e550d1727b78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:20.343751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-341042d2-1aea-49cd-90b6-1f4f6da2ae7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:20.345965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-341042d2-1aea-49cd-90b6-1f4f6da2ae7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:20.346295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42b02148-a04a-4c9d-92ec-e550d1727b78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:20.346741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42b02148-a04a-4c9d-92ec-e550d1727b78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:20.347500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42b02148-a04a-4c9d-92ec-e550d1727b78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:20.347927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42b02148-a04a-4c9d-92ec-e550d1727b78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:20.351766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-341042d2-1aea-49cd-90b6-1f4f6da2ae7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:20.352210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-341042d2-1aea-49cd-90b6-1f4f6da2ae7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:20.352995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-341042d2-1aea-49cd-90b6-1f4f6da2ae7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:20.353423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-341042d2-1aea-49cd-90b6-1f4f6da2ae7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:20.383576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-341042d2-1aea-49cd-90b6-1f4f6da2ae7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Jul 28 20:19:20.384255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 878/1907] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:20.410721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-42b02148-a04a-4c9d-92ec-e550d1727b78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:20.418194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-42b02148-a04a-4c9d-92ec-e550d1727b78 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082835 Jul 28 20:19:20.418694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1030/1908] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:20 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:20.787416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-788c1e39-d32d-4536-99c1-3cf376856602 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:20.787972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-788c1e39-d32d-4536-99c1-3cf376856602 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:20.793945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-788c1e39-d32d-4536-99c1-3cf376856602 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:20.794397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-788c1e39-d32d-4536-99c1-3cf376856602 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:20.795483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-788c1e39-d32d-4536-99c1-3cf376856602 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:20.795886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-788c1e39-d32d-4536-99c1-3cf376856602 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:20.923317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-788c1e39-d32d-4536-99c1-3cf376856602 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:20.931121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-788c1e39-d32d-4536-99c1-3cf376856602 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147663 Jul 28 20:19:20.931671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 879/1909] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:20 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:21.395806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e4acb669-819b-4ec7-8967-52b606ffe5ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:21.398005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e4acb669-819b-4ec7-8967-52b606ffe5ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:21.404700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4acb669-819b-4ec7-8967-52b606ffe5ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:21.405166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4acb669-819b-4ec7-8967-52b606ffe5ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:21.406192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4acb669-819b-4ec7-8967-52b606ffe5ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:21.406631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4acb669-819b-4ec7-8967-52b606ffe5ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:21.435980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e4acb669-819b-4ec7-8967-52b606ffe5ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043480 Jul 28 20:19:21.436620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1031/1910] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:21.439895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-27ea6729-419f-4199-a6e4-7e8034de7c2d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:21.440600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-27ea6729-419f-4199-a6e4-7e8034de7c2d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:21.447014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ea6729-419f-4199-a6e4-7e8034de7c2d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:21.447457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ea6729-419f-4199-a6e4-7e8034de7c2d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:21.448241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ea6729-419f-4199-a6e4-7e8034de7c2d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:21.448729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ea6729-419f-4199-a6e4-7e8034de7c2d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:21.452914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:21.512165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-27ea6729-419f-4199-a6e4-7e8034de7c2d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:21.520305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-27ea6729-419f-4199-a6e4-7e8034de7c2d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084950 Jul 28 20:19:21.520893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 880/1911] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:21 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:21.954059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b54431c2-2e8f-4373-b016-f8fee5c52e8c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:21.954668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b54431c2-2e8f-4373-b016-f8fee5c52e8c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:21.960695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b54431c2-2e8f-4373-b016-f8fee5c52e8c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:21.961144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b54431c2-2e8f-4373-b016-f8fee5c52e8c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:21.961894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b54431c2-2e8f-4373-b016-f8fee5c52e8c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:21.962327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b54431c2-2e8f-4373-b016-f8fee5c52e8c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:22.088992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b54431c2-2e8f-4373-b016-f8fee5c52e8c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:22.097518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b54431c2-2e8f-4373-b016-f8fee5c52e8c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148339 Jul 28 20:19:22.098068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1032/1912] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:21 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:22.448012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bbdf0174-d4ef-470b-84c3-ea9757faae96 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:22.450180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bbdf0174-d4ef-470b-84c3-ea9757faae96 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:22.457446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbdf0174-d4ef-470b-84c3-ea9757faae96 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:22.457894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbdf0174-d4ef-470b-84c3-ea9757faae96 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:22.458650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbdf0174-d4ef-470b-84c3-ea9757faae96 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:22.459083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bbdf0174-d4ef-470b-84c3-ea9757faae96 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:22.487038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bbdf0174-d4ef-470b-84c3-ea9757faae96 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042993 Jul 28 20:19:22.487580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 881/1913] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:22 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:22.541312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3e7764b3-2fc1-45ac-b5c1-45c412f38de8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:22.541919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3e7764b3-2fc1-45ac-b5c1-45c412f38de8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:22.548904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e7764b3-2fc1-45ac-b5c1-45c412f38de8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:22.549344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e7764b3-2fc1-45ac-b5c1-45c412f38de8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:22.550084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e7764b3-2fc1-45ac-b5c1-45c412f38de8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:22.550508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e7764b3-2fc1-45ac-b5c1-45c412f38de8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:22.611132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3e7764b3-2fc1-45ac-b5c1-45c412f38de8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:22.618463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3e7764b3-2fc1-45ac-b5c1-45c412f38de8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080946 Jul 28 20:19:22.619040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1033/1914] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:22 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:23.118575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-40e5fc0d-da60-40b5-a1bb-15fd5725af2e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:23.119187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-40e5fc0d-da60-40b5-a1bb-15fd5725af2e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:23.126447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40e5fc0d-da60-40b5-a1bb-15fd5725af2e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:23.126887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40e5fc0d-da60-40b5-a1bb-15fd5725af2e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:23.127666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40e5fc0d-da60-40b5-a1bb-15fd5725af2e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:23.128093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40e5fc0d-da60-40b5-a1bb-15fd5725af2e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:23.257849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-40e5fc0d-da60-40b5-a1bb-15fd5725af2e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:23.266697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-40e5fc0d-da60-40b5-a1bb-15fd5725af2e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151993 Jul 28 20:19:23.267248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 882/1915] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:23 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:23.499959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aa6c9b8d-e03b-439c-b499-8560ddd69bc9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:23.502031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aa6c9b8d-e03b-439c-b499-8560ddd69bc9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:23.508033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aa6c9b8d-e03b-439c-b499-8560ddd69bc9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:23.508470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aa6c9b8d-e03b-439c-b499-8560ddd69bc9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:23.509253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aa6c9b8d-e03b-439c-b499-8560ddd69bc9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:23.509679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aa6c9b8d-e03b-439c-b499-8560ddd69bc9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:23.537937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aa6c9b8d-e03b-439c-b499-8560ddd69bc9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Jul 28 20:19:23.538503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1034/1916] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:23.639576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3873507d-d558-4ace-88eb-bf88ba7937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:23.640200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3873507d-d558-4ace-88eb-bf88ba7937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:23.646642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3873507d-d558-4ace-88eb-bf88ba7937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:23.647088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3873507d-d558-4ace-88eb-bf88ba7937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:23.647847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3873507d-d558-4ace-88eb-bf88ba7937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:23.648281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3873507d-d558-4ace-88eb-bf88ba7937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:23.710933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3873507d-d558-4ace-88eb-bf88ba7937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:23.718942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3873507d-d558-4ace-88eb-bf88ba7937f5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083351 Jul 28 20:19:23.719494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 883/1917] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:23 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:24.287617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bbfb75ab-c7cb-416c-a8d0-a5d3a712cd75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:24.288223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bbfb75ab-c7cb-416c-a8d0-a5d3a712cd75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:24.294997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbfb75ab-c7cb-416c-a8d0-a5d3a712cd75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:24.295446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbfb75ab-c7cb-416c-a8d0-a5d3a712cd75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:24.296198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbfb75ab-c7cb-416c-a8d0-a5d3a712cd75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:24.296660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbfb75ab-c7cb-416c-a8d0-a5d3a712cd75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:24.421907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bbfb75ab-c7cb-416c-a8d0-a5d3a712cd75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:24.430083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bbfb75ab-c7cb-416c-a8d0-a5d3a712cd75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146396 Jul 28 20:19:24.430655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1035/1918] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:24.550717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6e70037b-0b66-46ec-bb01-486c134ce144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:24.552985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6e70037b-0b66-46ec-bb01-486c134ce144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:24.559048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e70037b-0b66-46ec-bb01-486c134ce144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:24.559499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e70037b-0b66-46ec-bb01-486c134ce144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:24.560853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e70037b-0b66-46ec-bb01-486c134ce144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:24.561318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e70037b-0b66-46ec-bb01-486c134ce144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:24.590514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6e70037b-0b66-46ec-bb01-486c134ce144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043784 Jul 28 20:19:24.591051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 884/1919] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:24.740858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-296b4722-96fe-4033-b93b-3cc99ee7a4d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:24.741379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-296b4722-96fe-4033-b93b-3cc99ee7a4d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:24.747298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-296b4722-96fe-4033-b93b-3cc99ee7a4d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:24.748739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-296b4722-96fe-4033-b93b-3cc99ee7a4d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:24.749441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-296b4722-96fe-4033-b93b-3cc99ee7a4d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:24.749863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-296b4722-96fe-4033-b93b-3cc99ee7a4d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:24.815406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-296b4722-96fe-4033-b93b-3cc99ee7a4d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:24.822877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-296b4722-96fe-4033-b93b-3cc99ee7a4d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087288 Jul 28 20:19:24.823427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1036/1920] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:24 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:25.453777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-884ebc0a-7a2b-4dbf-bbd1-3ebdc6eaaf5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:25.454344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-884ebc0a-7a2b-4dbf-bbd1-3ebdc6eaaf5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:25.460979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-884ebc0a-7a2b-4dbf-bbd1-3ebdc6eaaf5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:25.461429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-884ebc0a-7a2b-4dbf-bbd1-3ebdc6eaaf5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:25.462193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-884ebc0a-7a2b-4dbf-bbd1-3ebdc6eaaf5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:25.462630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-884ebc0a-7a2b-4dbf-bbd1-3ebdc6eaaf5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:25.592626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-884ebc0a-7a2b-4dbf-bbd1-3ebdc6eaaf5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:25.600766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-884ebc0a-7a2b-4dbf-bbd1-3ebdc6eaaf5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150962 Jul 28 20:19:25.601335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 885/1921] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:25.602791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-21011860-cd9d-4342-a0fc-8da31d372335 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:25.605021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-21011860-cd9d-4342-a0fc-8da31d372335 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:25.611971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21011860-cd9d-4342-a0fc-8da31d372335 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:25.612422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21011860-cd9d-4342-a0fc-8da31d372335 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:25.613220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21011860-cd9d-4342-a0fc-8da31d372335 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:25.613656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21011860-cd9d-4342-a0fc-8da31d372335 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:25.644711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-21011860-cd9d-4342-a0fc-8da31d372335 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045860 Jul 28 20:19:25.645278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1037/1922] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:25.843757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-54cd407a-7832-4cd9-aa49-746b27358bbd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:25.844361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-54cd407a-7832-4cd9-aa49-746b27358bbd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:25.850326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-54cd407a-7832-4cd9-aa49-746b27358bbd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:25.850767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-54cd407a-7832-4cd9-aa49-746b27358bbd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:25.851506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-54cd407a-7832-4cd9-aa49-746b27358bbd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:25.851931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-54cd407a-7832-4cd9-aa49-746b27358bbd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:25.912374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-54cd407a-7832-4cd9-aa49-746b27358bbd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:25.919920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-54cd407a-7832-4cd9-aa49-746b27358bbd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080713 Jul 28 20:19:25.920472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 886/1923] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:25 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:26.622136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fedc0533-6ffd-42d8-a688-8519ddf9852d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:26.622781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fedc0533-6ffd-42d8-a688-8519ddf9852d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:26.629759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fedc0533-6ffd-42d8-a688-8519ddf9852d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:26.630196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fedc0533-6ffd-42d8-a688-8519ddf9852d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:26.630938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fedc0533-6ffd-42d8-a688-8519ddf9852d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:26.631361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fedc0533-6ffd-42d8-a688-8519ddf9852d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:26.657266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9295dc0f-8508-4372-80dd-360460c22611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:26.659458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9295dc0f-8508-4372-80dd-360460c22611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:26.666064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9295dc0f-8508-4372-80dd-360460c22611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:26.666511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9295dc0f-8508-4372-80dd-360460c22611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:26.667271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9295dc0f-8508-4372-80dd-360460c22611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:26.667705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9295dc0f-8508-4372-80dd-360460c22611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:26.702361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9295dc0f-8508-4372-80dd-360460c22611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049267 Jul 28 20:19:26.703130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 887/1924] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:26.768196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fedc0533-6ffd-42d8-a688-8519ddf9852d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:26.776269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fedc0533-6ffd-42d8-a688-8519ddf9852d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157955 Jul 28 20:19:26.776865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1038/1925] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:26.941227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-82092d29-1ea4-42bd-9991-1d67f529acfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:26.941758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-82092d29-1ea4-42bd-9991-1d67f529acfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:26.947827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82092d29-1ea4-42bd-9991-1d67f529acfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:26.948274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82092d29-1ea4-42bd-9991-1d67f529acfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:26.949069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82092d29-1ea4-42bd-9991-1d67f529acfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:26.949506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82092d29-1ea4-42bd-9991-1d67f529acfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:27.011374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-82092d29-1ea4-42bd-9991-1d67f529acfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:27.019170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-82092d29-1ea4-42bd-9991-1d67f529acfb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081939 Jul 28 20:19:27.019726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 888/1926] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:26 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:27.714699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9eaff8c6-5e51-4e1f-829d-716face45824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:27.716998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9eaff8c6-5e51-4e1f-829d-716face45824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:27.723389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9eaff8c6-5e51-4e1f-829d-716face45824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:27.723829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9eaff8c6-5e51-4e1f-829d-716face45824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:27.724601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9eaff8c6-5e51-4e1f-829d-716face45824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:27.725036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9eaff8c6-5e51-4e1f-829d-716face45824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:27.759463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9eaff8c6-5e51-4e1f-829d-716face45824 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048694 Jul 28 20:19:27.760006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1039/1927] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:27.798878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0c883678-acc1-4ee2-b2bf-26dbb137fd39 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:27.799487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0c883678-acc1-4ee2-b2bf-26dbb137fd39 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:27.805943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c883678-acc1-4ee2-b2bf-26dbb137fd39 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:27.806372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c883678-acc1-4ee2-b2bf-26dbb137fd39 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:27.807113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c883678-acc1-4ee2-b2bf-26dbb137fd39 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:27.807539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c883678-acc1-4ee2-b2bf-26dbb137fd39 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:27.940893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0c883678-acc1-4ee2-b2bf-26dbb137fd39 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:27.948586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0c883678-acc1-4ee2-b2bf-26dbb137fd39 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.154127 Jul 28 20:19:27.949119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 889/1928] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:27 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:28.040604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-acd33c6c-845a-4d96-8042-39c63018b0ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:28.041138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-acd33c6c-845a-4d96-8042-39c63018b0ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:28.047769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-acd33c6c-845a-4d96-8042-39c63018b0ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:28.048203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-acd33c6c-845a-4d96-8042-39c63018b0ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:28.048982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-acd33c6c-845a-4d96-8042-39c63018b0ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:28.049406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-acd33c6c-845a-4d96-8042-39c63018b0ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:28.113338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-acd33c6c-845a-4d96-8042-39c63018b0ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:28.120938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-acd33c6c-845a-4d96-8042-39c63018b0ac tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084248 Jul 28 20:19:28.121488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1040/1929] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:28 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:28.772452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-de5fd437-f93d-4d75-91e4-626f06252728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:28.774668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-de5fd437-f93d-4d75-91e4-626f06252728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:28.781048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de5fd437-f93d-4d75-91e4-626f06252728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:28.781567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de5fd437-f93d-4d75-91e4-626f06252728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:28.782319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de5fd437-f93d-4d75-91e4-626f06252728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:28.782746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de5fd437-f93d-4d75-91e4-626f06252728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:28.812008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-de5fd437-f93d-4d75-91e4-626f06252728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 Jul 28 20:19:28.812704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 890/1930] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:28.970435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-58c47dc5-0f49-4d0e-ac90-52649d007beb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:28.971077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-58c47dc5-0f49-4d0e-ac90-52649d007beb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:28.977608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58c47dc5-0f49-4d0e-ac90-52649d007beb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:28.978055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58c47dc5-0f49-4d0e-ac90-52649d007beb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:28.978810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58c47dc5-0f49-4d0e-ac90-52649d007beb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:28.979245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58c47dc5-0f49-4d0e-ac90-52649d007beb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:28.997490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:29.107965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-58c47dc5-0f49-4d0e-ac90-52649d007beb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:29.116530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-58c47dc5-0f49-4d0e-ac90-52649d007beb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150740 Jul 28 20:19:29.117118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1041/1931] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:28 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:29.143284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c502867b-c80c-44a8-91d0-baf3de129655 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:29.143889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c502867b-c80c-44a8-91d0-baf3de129655 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:29.149777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c502867b-c80c-44a8-91d0-baf3de129655 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:29.150222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c502867b-c80c-44a8-91d0-baf3de129655 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:29.150968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c502867b-c80c-44a8-91d0-baf3de129655 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:29.151426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c502867b-c80c-44a8-91d0-baf3de129655 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:29.212269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c502867b-c80c-44a8-91d0-baf3de129655 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:29.219721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c502867b-c80c-44a8-91d0-baf3de129655 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080950 Jul 28 20:19:29.220285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 891/1932] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:29 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:29.831587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-95b2cca7-70e8-466e-a205-09cf83a1c732 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:29.833902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-95b2cca7-70e8-466e-a205-09cf83a1c732 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:29.839869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95b2cca7-70e8-466e-a205-09cf83a1c732 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:29.840311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95b2cca7-70e8-466e-a205-09cf83a1c732 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:29.841101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95b2cca7-70e8-466e-a205-09cf83a1c732 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:29.841527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-95b2cca7-70e8-466e-a205-09cf83a1c732 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:29.870774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-95b2cca7-70e8-466e-a205-09cf83a1c732 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048030 Jul 28 20:19:29.871313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1042/1933] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:29 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:30.137436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c2b71ba2-a4d3-4ec3-bd12-02d0d2ae126e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:30.138004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c2b71ba2-a4d3-4ec3-bd12-02d0d2ae126e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:30.145193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c2b71ba2-a4d3-4ec3-bd12-02d0d2ae126e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:30.145645 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c2b71ba2-a4d3-4ec3-bd12-02d0d2ae126e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:30.146407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c2b71ba2-a4d3-4ec3-bd12-02d0d2ae126e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:30.146841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c2b71ba2-a4d3-4ec3-bd12-02d0d2ae126e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:30.239540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dcefafbf-14ac-4a4e-9c62-fdfbee640f53 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:30.240282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dcefafbf-14ac-4a4e-9c62-fdfbee640f53 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:30.246725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dcefafbf-14ac-4a4e-9c62-fdfbee640f53 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:30.247166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dcefafbf-14ac-4a4e-9c62-fdfbee640f53 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:30.247933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dcefafbf-14ac-4a4e-9c62-fdfbee640f53 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:30.248360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dcefafbf-14ac-4a4e-9c62-fdfbee640f53 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:30.282730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c2b71ba2-a4d3-4ec3-bd12-02d0d2ae126e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:30.290590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c2b71ba2-a4d3-4ec3-bd12-02d0d2ae126e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157109 Jul 28 20:19:30.291156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 892/1934] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:30 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:30.313223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dcefafbf-14ac-4a4e-9c62-fdfbee640f53 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:30.320713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dcefafbf-14ac-4a4e-9c62-fdfbee640f53 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085010 Jul 28 20:19:30.321264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1043/1935] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:30 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:30.883188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-12eccecb-3bdd-4ba1-9431-29f981ac6050 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:30.885358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-12eccecb-3bdd-4ba1-9431-29f981ac6050 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:30.891790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12eccecb-3bdd-4ba1-9431-29f981ac6050 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:30.892239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12eccecb-3bdd-4ba1-9431-29f981ac6050 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:30.893023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12eccecb-3bdd-4ba1-9431-29f981ac6050 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:30.893456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12eccecb-3bdd-4ba1-9431-29f981ac6050 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:30.922975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-12eccecb-3bdd-4ba1-9431-29f981ac6050 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Jul 28 20:19:30.923629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 893/1936] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:31.311590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e8adfdd9-f253-4502-968d-8296e6ef2636 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:31.312134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e8adfdd9-f253-4502-968d-8296e6ef2636 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:31.318923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8adfdd9-f253-4502-968d-8296e6ef2636 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:31.319468 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8adfdd9-f253-4502-968d-8296e6ef2636 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:31.320225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8adfdd9-f253-4502-968d-8296e6ef2636 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:31.320681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e8adfdd9-f253-4502-968d-8296e6ef2636 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:31.340622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-82c4f6d9-4b02-40db-b3ef-ce0e2e9b60a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:31.341240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-82c4f6d9-4b02-40db-b3ef-ce0e2e9b60a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:31.348044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82c4f6d9-4b02-40db-b3ef-ce0e2e9b60a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:31.348599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82c4f6d9-4b02-40db-b3ef-ce0e2e9b60a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:31.349711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82c4f6d9-4b02-40db-b3ef-ce0e2e9b60a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:31.350053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82c4f6d9-4b02-40db-b3ef-ce0e2e9b60a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:31.422622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-82c4f6d9-4b02-40db-b3ef-ce0e2e9b60a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:31.430346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-82c4f6d9-4b02-40db-b3ef-ce0e2e9b60a8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.093513 Jul 28 20:19:31.430909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 894/1937] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:31 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:31.480208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e8adfdd9-f253-4502-968d-8296e6ef2636 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:31.488929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e8adfdd9-f253-4502-968d-8296e6ef2636 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.181494 Jul 28 20:19:31.489489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1044/1938] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:31.935400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1d4d78b9-d246-43a1-8714-7be34a0b5d8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:31.938004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1d4d78b9-d246-43a1-8714-7be34a0b5d8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:31.944463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d4d78b9-d246-43a1-8714-7be34a0b5d8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:31.944948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d4d78b9-d246-43a1-8714-7be34a0b5d8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:31.945710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d4d78b9-d246-43a1-8714-7be34a0b5d8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:31.946147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d4d78b9-d246-43a1-8714-7be34a0b5d8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:31.976602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1d4d78b9-d246-43a1-8714-7be34a0b5d8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Jul 28 20:19:31.977156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 895/1939] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:32.451157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b632a872-91b7-4472-a303-6332ea68c08e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:32.452289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b632a872-91b7-4472-a303-6332ea68c08e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:32.459038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b632a872-91b7-4472-a303-6332ea68c08e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:32.459475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b632a872-91b7-4472-a303-6332ea68c08e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:32.460227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b632a872-91b7-4472-a303-6332ea68c08e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:32.460689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b632a872-91b7-4472-a303-6332ea68c08e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:32.510333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6592ff63-3d9c-4aa8-9fcb-0be9046cdad4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:32.510869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6592ff63-3d9c-4aa8-9fcb-0be9046cdad4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:32.517337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6592ff63-3d9c-4aa8-9fcb-0be9046cdad4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:32.517781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6592ff63-3d9c-4aa8-9fcb-0be9046cdad4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:32.518530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6592ff63-3d9c-4aa8-9fcb-0be9046cdad4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:32.518956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6592ff63-3d9c-4aa8-9fcb-0be9046cdad4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:32.522643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b632a872-91b7-4472-a303-6332ea68c08e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:32.530935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b632a872-91b7-4472-a303-6332ea68c08e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082899 Jul 28 20:19:32.531507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1045/1940] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:32 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:32.644394 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6592ff63-3d9c-4aa8-9fcb-0be9046cdad4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:32.647731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:32.652991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6592ff63-3d9c-4aa8-9fcb-0be9046cdad4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146528 Jul 28 20:19:32.653542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 896/1941] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:32.988844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-57340201-d9c4-498a-977b-15fe31135648 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:32.991077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-57340201-d9c4-498a-977b-15fe31135648 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:32.997151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57340201-d9c4-498a-977b-15fe31135648 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:32.997591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57340201-d9c4-498a-977b-15fe31135648 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:32.998379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57340201-d9c4-498a-977b-15fe31135648 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:32.999524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-57340201-d9c4-498a-977b-15fe31135648 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:33.028203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-57340201-d9c4-498a-977b-15fe31135648 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043322 Jul 28 20:19:33.028771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1046/1942] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:33.552342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1c252b3f-b8b3-4d0b-81cb-c588ff1f99e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:33.553012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1c252b3f-b8b3-4d0b-81cb-c588ff1f99e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:33.559600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c252b3f-b8b3-4d0b-81cb-c588ff1f99e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:33.560047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c252b3f-b8b3-4d0b-81cb-c588ff1f99e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:33.560837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c252b3f-b8b3-4d0b-81cb-c588ff1f99e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:33.561324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c252b3f-b8b3-4d0b-81cb-c588ff1f99e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:33.623878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1c252b3f-b8b3-4d0b-81cb-c588ff1f99e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:33.631375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1c252b3f-b8b3-4d0b-81cb-c588ff1f99e0 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082967 Jul 28 20:19:33.631963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 897/1943] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:33 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:33.675394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f6d811ed-ec6b-418a-94fb-3210a685dda9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:33.676013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f6d811ed-ec6b-418a-94fb-3210a685dda9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:33.682445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6d811ed-ec6b-418a-94fb-3210a685dda9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:33.682889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6d811ed-ec6b-418a-94fb-3210a685dda9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:33.683629 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6d811ed-ec6b-418a-94fb-3210a685dda9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:33.684057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6d811ed-ec6b-418a-94fb-3210a685dda9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:33.820392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f6d811ed-ec6b-418a-94fb-3210a685dda9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:33.828678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f6d811ed-ec6b-418a-94fb-3210a685dda9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157152 Jul 28 20:19:33.829236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1047/1944] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:34.040979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fc6ca610-8979-4856-8d67-b5287a491889 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:34.043233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fc6ca610-8979-4856-8d67-b5287a491889 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:34.049876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fc6ca610-8979-4856-8d67-b5287a491889 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:34.050324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fc6ca610-8979-4856-8d67-b5287a491889 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:34.051080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fc6ca610-8979-4856-8d67-b5287a491889 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:34.051517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fc6ca610-8979-4856-8d67-b5287a491889 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:34.080456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fc6ca610-8979-4856-8d67-b5287a491889 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Jul 28 20:19:34.081035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 898/1945] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:34.652155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c5138f27-3f2a-4ba8-b1f2-aa33a211fc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:34.652802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c5138f27-3f2a-4ba8-b1f2-aa33a211fc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:34.660174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5138f27-3f2a-4ba8-b1f2-aa33a211fc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:34.660656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5138f27-3f2a-4ba8-b1f2-aa33a211fc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:34.661427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5138f27-3f2a-4ba8-b1f2-aa33a211fc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:34.661858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c5138f27-3f2a-4ba8-b1f2-aa33a211fc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:34.723115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c5138f27-3f2a-4ba8-b1f2-aa33a211fc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:34.730534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c5138f27-3f2a-4ba8-b1f2-aa33a211fc68 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082218 Jul 28 20:19:34.731079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1048/1946] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:34 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:34.850287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-79427b64-cef0-4614-a557-af06ca0c66bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:34.850890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-79427b64-cef0-4614-a557-af06ca0c66bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:34.857345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79427b64-cef0-4614-a557-af06ca0c66bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:34.858309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79427b64-cef0-4614-a557-af06ca0c66bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:34.859083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79427b64-cef0-4614-a557-af06ca0c66bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:34.859511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79427b64-cef0-4614-a557-af06ca0c66bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:35.093562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4a4999d8-9cc5-4b55-9caf-0059e120aa1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:35.095735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4a4999d8-9cc5-4b55-9caf-0059e120aa1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:35.101927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a4999d8-9cc5-4b55-9caf-0059e120aa1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:35.102375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a4999d8-9cc5-4b55-9caf-0059e120aa1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:35.103148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a4999d8-9cc5-4b55-9caf-0059e120aa1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:35.103583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a4999d8-9cc5-4b55-9caf-0059e120aa1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:35.135071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4a4999d8-9cc5-4b55-9caf-0059e120aa1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Jul 28 20:19:35.135645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1049/1947] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:35.195068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-79427b64-cef0-4614-a557-af06ca0c66bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:35.203128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-79427b64-cef0-4614-a557-af06ca0c66bf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.356862 Jul 28 20:19:35.203686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 899/1948] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:34 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:35.751185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b061739c-23d1-4de6-8b75-60618ae72460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:35.751791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b061739c-23d1-4de6-8b75-60618ae72460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:35.758393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b061739c-23d1-4de6-8b75-60618ae72460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:35.758832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b061739c-23d1-4de6-8b75-60618ae72460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:35.759564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b061739c-23d1-4de6-8b75-60618ae72460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:35.759986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b061739c-23d1-4de6-8b75-60618ae72460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:35.829546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b061739c-23d1-4de6-8b75-60618ae72460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:35.836949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b061739c-23d1-4de6-8b75-60618ae72460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.089738 Jul 28 20:19:35.837500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1050/1949] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:35 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:36.147437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4b064d85-31e3-474c-b7d4-cc9dcd6cff52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:36.149621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4b064d85-31e3-474c-b7d4-cc9dcd6cff52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:36.157125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b064d85-31e3-474c-b7d4-cc9dcd6cff52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:36.157563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b064d85-31e3-474c-b7d4-cc9dcd6cff52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:36.158313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b064d85-31e3-474c-b7d4-cc9dcd6cff52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:36.158777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4b064d85-31e3-474c-b7d4-cc9dcd6cff52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:36.187537 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4b064d85-31e3-474c-b7d4-cc9dcd6cff52 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 Jul 28 20:19:36.188073 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 900/1950] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:36.224688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-462c9ba1-b29b-4f7c-b87b-faa695061376 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:36.225299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-462c9ba1-b29b-4f7c-b87b-faa695061376 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:36.231292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-462c9ba1-b29b-4f7c-b87b-faa695061376 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:36.231739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-462c9ba1-b29b-4f7c-b87b-faa695061376 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:36.232486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-462c9ba1-b29b-4f7c-b87b-faa695061376 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:36.233081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-462c9ba1-b29b-4f7c-b87b-faa695061376 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:36.358990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-462c9ba1-b29b-4f7c-b87b-faa695061376 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:36.366821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-462c9ba1-b29b-4f7c-b87b-faa695061376 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146138 Jul 28 20:19:36.367381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1051/1951] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:36 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:36.858781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-42a21d3a-1e0d-4e8b-b3bd-5440a00334c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:36.859046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-42a21d3a-1e0d-4e8b-b3bd-5440a00334c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:36.865170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42a21d3a-1e0d-4e8b-b3bd-5440a00334c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:36.865611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42a21d3a-1e0d-4e8b-b3bd-5440a00334c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:36.866352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42a21d3a-1e0d-4e8b-b3bd-5440a00334c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:36.866776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-42a21d3a-1e0d-4e8b-b3bd-5440a00334c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:36.929809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-42a21d3a-1e0d-4e8b-b3bd-5440a00334c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:36.938583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-42a21d3a-1e0d-4e8b-b3bd-5440a00334c3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084543 Jul 28 20:19:36.939147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 901/1952] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:36 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:37.199425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-758bf34d-f845-47c2-8351-bc718bda77eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:37.201751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-758bf34d-f845-47c2-8351-bc718bda77eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:37.208622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-758bf34d-f845-47c2-8351-bc718bda77eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:37.209107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-758bf34d-f845-47c2-8351-bc718bda77eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:37.209939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-758bf34d-f845-47c2-8351-bc718bda77eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:37.210485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-758bf34d-f845-47c2-8351-bc718bda77eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:37.242341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-758bf34d-f845-47c2-8351-bc718bda77eb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046787 Jul 28 20:19:37.242888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1052/1953] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:37.388005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b1b99cb0-4cb9-4f24-b794-fc27ae2bc91b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:37.388643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b1b99cb0-4cb9-4f24-b794-fc27ae2bc91b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:37.395652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1b99cb0-4cb9-4f24-b794-fc27ae2bc91b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:37.396101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1b99cb0-4cb9-4f24-b794-fc27ae2bc91b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:37.396896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1b99cb0-4cb9-4f24-b794-fc27ae2bc91b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:37.397328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1b99cb0-4cb9-4f24-b794-fc27ae2bc91b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:37.527512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b1b99cb0-4cb9-4f24-b794-fc27ae2bc91b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:37.536330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b1b99cb0-4cb9-4f24-b794-fc27ae2bc91b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152187 Jul 28 20:19:37.537022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 902/1954] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:37 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:37.958976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-83e54670-ca43-4751-946f-3a66a3564a5a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:37.959580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-83e54670-ca43-4751-946f-3a66a3564a5a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:37.965634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83e54670-ca43-4751-946f-3a66a3564a5a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:37.966079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83e54670-ca43-4751-946f-3a66a3564a5a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:37.966822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83e54670-ca43-4751-946f-3a66a3564a5a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:37.967782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83e54670-ca43-4751-946f-3a66a3564a5a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:38.026537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-83e54670-ca43-4751-946f-3a66a3564a5a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:38.034784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-83e54670-ca43-4751-946f-3a66a3564a5a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.079675 Jul 28 20:19:38.035329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1053/1955] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:37 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:38.259306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-09e0caad-0fef-47f8-9fd5-4bf0dc6f5b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:38.261479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-09e0caad-0fef-47f8-9fd5-4bf0dc6f5b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:38.268452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09e0caad-0fef-47f8-9fd5-4bf0dc6f5b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:38.268926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09e0caad-0fef-47f8-9fd5-4bf0dc6f5b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:38.269757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09e0caad-0fef-47f8-9fd5-4bf0dc6f5b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:38.270183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09e0caad-0fef-47f8-9fd5-4bf0dc6f5b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:38.303766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-09e0caad-0fef-47f8-9fd5-4bf0dc6f5b02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052783 Jul 28 20:19:38.304316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 903/1956] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:38.557641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0051071c-5153-4fa8-963b-5cbe0a5bc5f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:38.558179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0051071c-5153-4fa8-963b-5cbe0a5bc5f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:38.565150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0051071c-5153-4fa8-963b-5cbe0a5bc5f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:38.565593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0051071c-5153-4fa8-963b-5cbe0a5bc5f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:38.566367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0051071c-5153-4fa8-963b-5cbe0a5bc5f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:38.566796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0051071c-5153-4fa8-963b-5cbe0a5bc5f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:38.695352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0051071c-5153-4fa8-963b-5cbe0a5bc5f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:38.703794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0051071c-5153-4fa8-963b-5cbe0a5bc5f5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150029 Jul 28 20:19:38.704347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1054/1957] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:39.055847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-478385a2-a5ff-4db5-93fd-9e66ab1f68b4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:39.056465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-478385a2-a5ff-4db5-93fd-9e66ab1f68b4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:39.063629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-478385a2-a5ff-4db5-93fd-9e66ab1f68b4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:39.064082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-478385a2-a5ff-4db5-93fd-9e66ab1f68b4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:39.064872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-478385a2-a5ff-4db5-93fd-9e66ab1f68b4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:39.065312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-478385a2-a5ff-4db5-93fd-9e66ab1f68b4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:39.125410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-478385a2-a5ff-4db5-93fd-9e66ab1f68b4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:39.132817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-478385a2-a5ff-4db5-93fd-9e66ab1f68b4 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080812 Jul 28 20:19:39.133369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 904/1958] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:39 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:39.316522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b432e09b-d2c5-4c3e-a604-a40a93d42b73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:39.318632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b432e09b-d2c5-4c3e-a604-a40a93d42b73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:39.324591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b432e09b-d2c5-4c3e-a604-a40a93d42b73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:39.325035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b432e09b-d2c5-4c3e-a604-a40a93d42b73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:39.325778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b432e09b-d2c5-4c3e-a604-a40a93d42b73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:39.326203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b432e09b-d2c5-4c3e-a604-a40a93d42b73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:39.353860 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b432e09b-d2c5-4c3e-a604-a40a93d42b73 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041373 Jul 28 20:19:39.354395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1055/1959] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:39.726052 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9aacd53a-9c87-4b01-a941-3ed5c20b0800 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:39.726052 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9aacd53a-9c87-4b01-a941-3ed5c20b0800 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:39.732397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9aacd53a-9c87-4b01-a941-3ed5c20b0800 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:39.733740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9aacd53a-9c87-4b01-a941-3ed5c20b0800 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:39.734867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9aacd53a-9c87-4b01-a941-3ed5c20b0800 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:39.735310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9aacd53a-9c87-4b01-a941-3ed5c20b0800 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:39.864498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9aacd53a-9c87-4b01-a941-3ed5c20b0800 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:39.872328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9aacd53a-9c87-4b01-a941-3ed5c20b0800 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150789 Jul 28 20:19:39.872908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 905/1960] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:39 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:40.153775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8690160d-1816-47a2-86fb-04d6c30eedd1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:40.154326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8690160d-1816-47a2-86fb-04d6c30eedd1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:40.161830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8690160d-1816-47a2-86fb-04d6c30eedd1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:40.162282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8690160d-1816-47a2-86fb-04d6c30eedd1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:40.163046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8690160d-1816-47a2-86fb-04d6c30eedd1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:40.163484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8690160d-1816-47a2-86fb-04d6c30eedd1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:40.228107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8690160d-1816-47a2-86fb-04d6c30eedd1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:40.235715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8690160d-1816-47a2-86fb-04d6c30eedd1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085976 Jul 28 20:19:40.236268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1056/1961] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:40 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:40.366702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-61e1a5cd-1091-4d07-bb0e-56832927db02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:40.368919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-61e1a5cd-1091-4d07-bb0e-56832927db02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:40.376380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61e1a5cd-1091-4d07-bb0e-56832927db02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:40.376864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61e1a5cd-1091-4d07-bb0e-56832927db02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:40.377635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61e1a5cd-1091-4d07-bb0e-56832927db02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:40.378071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-61e1a5cd-1091-4d07-bb0e-56832927db02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:40.409097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-61e1a5cd-1091-4d07-bb0e-56832927db02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Jul 28 20:19:40.409576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 906/1962] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:40.893455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0e71c534-3082-47b9-b1f5-50ffcc7a01aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:40.894061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0e71c534-3082-47b9-b1f5-50ffcc7a01aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:40.900010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e71c534-3082-47b9-b1f5-50ffcc7a01aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:40.900439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e71c534-3082-47b9-b1f5-50ffcc7a01aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:40.901217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e71c534-3082-47b9-b1f5-50ffcc7a01aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:40.901641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e71c534-3082-47b9-b1f5-50ffcc7a01aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:41.029457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0e71c534-3082-47b9-b1f5-50ffcc7a01aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:41.038331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0e71c534-3082-47b9-b1f5-50ffcc7a01aa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148696 Jul 28 20:19:41.038896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1057/1963] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:41.256652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5ab22a0c-0a7c-44e8-962d-bf529811bcae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:41.257270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5ab22a0c-0a7c-44e8-962d-bf529811bcae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:41.263485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ab22a0c-0a7c-44e8-962d-bf529811bcae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:41.264591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ab22a0c-0a7c-44e8-962d-bf529811bcae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:41.265369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ab22a0c-0a7c-44e8-962d-bf529811bcae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:41.265797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ab22a0c-0a7c-44e8-962d-bf529811bcae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:41.327321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5ab22a0c-0a7c-44e8-962d-bf529811bcae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:41.334807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5ab22a0c-0a7c-44e8-962d-bf529811bcae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082115 Jul 28 20:19:41.335583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 907/1964] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:41 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:41.423728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-04505b64-8408-455e-a788-e3c9e34b5d30 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:41.425827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-04505b64-8408-455e-a788-e3c9e34b5d30 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:41.433359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04505b64-8408-455e-a788-e3c9e34b5d30 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:41.433802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04505b64-8408-455e-a788-e3c9e34b5d30 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:41.434565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04505b64-8408-455e-a788-e3c9e34b5d30 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:41.434994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04505b64-8408-455e-a788-e3c9e34b5d30 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:41.440636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:41.466024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-04505b64-8408-455e-a788-e3c9e34b5d30 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047313 Jul 28 20:19:41.466900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1058/1965] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:42.060625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2b57cb23-d849-4392-ac97-c13f22216fb2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:42.061352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2b57cb23-d849-4392-ac97-c13f22216fb2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:42.067829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b57cb23-d849-4392-ac97-c13f22216fb2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:42.068269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b57cb23-d849-4392-ac97-c13f22216fb2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:42.069042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b57cb23-d849-4392-ac97-c13f22216fb2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:42.069470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b57cb23-d849-4392-ac97-c13f22216fb2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:42.198258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2b57cb23-d849-4392-ac97-c13f22216fb2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:42.206733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2b57cb23-d849-4392-ac97-c13f22216fb2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150081 Jul 28 20:19:42.207287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 908/1966] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:42 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:42.355335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3103cce1-2fc5-407f-ac1b-38d25528bf4d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:42.355944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3103cce1-2fc5-407f-ac1b-38d25528bf4d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:42.361988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3103cce1-2fc5-407f-ac1b-38d25528bf4d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:42.362430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3103cce1-2fc5-407f-ac1b-38d25528bf4d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:42.363172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3103cce1-2fc5-407f-ac1b-38d25528bf4d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:42.363598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3103cce1-2fc5-407f-ac1b-38d25528bf4d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:42.423890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3103cce1-2fc5-407f-ac1b-38d25528bf4d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:42.432466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3103cce1-2fc5-407f-ac1b-38d25528bf4d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080918 Jul 28 20:19:42.433046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1059/1967] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:42 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:42.478472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f1c96b88-2d55-425f-97c5-8a0c68fa1fe3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:42.480791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f1c96b88-2d55-425f-97c5-8a0c68fa1fe3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:42.486838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1c96b88-2d55-425f-97c5-8a0c68fa1fe3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:42.487278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1c96b88-2d55-425f-97c5-8a0c68fa1fe3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:42.488028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1c96b88-2d55-425f-97c5-8a0c68fa1fe3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:42.488454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1c96b88-2d55-425f-97c5-8a0c68fa1fe3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:42.517528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f1c96b88-2d55-425f-97c5-8a0c68fa1fe3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042977 Jul 28 20:19:42.518059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 909/1968] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:43.228572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fbcdf830-4b17-45fd-85a0-f9d4bf0e085f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:43.229182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fbcdf830-4b17-45fd-85a0-f9d4bf0e085f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:43.235786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fbcdf830-4b17-45fd-85a0-f9d4bf0e085f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:43.236224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fbcdf830-4b17-45fd-85a0-f9d4bf0e085f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:43.237010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fbcdf830-4b17-45fd-85a0-f9d4bf0e085f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:43.237437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fbcdf830-4b17-45fd-85a0-f9d4bf0e085f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:43.364334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fbcdf830-4b17-45fd-85a0-f9d4bf0e085f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:43.372218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fbcdf830-4b17-45fd-85a0-f9d4bf0e085f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147480 Jul 28 20:19:43.372807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1060/1969] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:43 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:43.454345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-26a168a6-6016-4a68-9997-7edc338e722c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:43.454892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-26a168a6-6016-4a68-9997-7edc338e722c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:43.461261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26a168a6-6016-4a68-9997-7edc338e722c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:43.461704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26a168a6-6016-4a68-9997-7edc338e722c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:43.462454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26a168a6-6016-4a68-9997-7edc338e722c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:43.462877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26a168a6-6016-4a68-9997-7edc338e722c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:43.527409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-26a168a6-6016-4a68-9997-7edc338e722c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:43.530113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1a02478e-560f-4b4d-a33f-c3d5b405e490 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:43.532598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1a02478e-560f-4b4d-a33f-c3d5b405e490 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:43.536021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-26a168a6-6016-4a68-9997-7edc338e722c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085807 Jul 28 20:19:43.536632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 910/1970] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:43 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:43.538706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a02478e-560f-4b4d-a33f-c3d5b405e490 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:43.539149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a02478e-560f-4b4d-a33f-c3d5b405e490 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:43.539903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a02478e-560f-4b4d-a33f-c3d5b405e490 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:43.540391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a02478e-560f-4b4d-a33f-c3d5b405e490 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:43.568743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1a02478e-560f-4b4d-a33f-c3d5b405e490 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042982 Jul 28 20:19:43.569279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1061/1971] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:44.394477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-67126de0-4bc7-4ca3-9321-6b3ab5699404 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:44.395116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-67126de0-4bc7-4ca3-9321-6b3ab5699404 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:44.401096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67126de0-4bc7-4ca3-9321-6b3ab5699404 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:44.401537 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67126de0-4bc7-4ca3-9321-6b3ab5699404 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:44.402284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67126de0-4bc7-4ca3-9321-6b3ab5699404 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:44.402706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67126de0-4bc7-4ca3-9321-6b3ab5699404 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:44.534908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-67126de0-4bc7-4ca3-9321-6b3ab5699404 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:44.542744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-67126de0-4bc7-4ca3-9321-6b3ab5699404 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152088 Jul 28 20:19:44.543293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 911/1972] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:44 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:44.557292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c8fe3544-957d-4637-8f97-f0395cf2961f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:44.557902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c8fe3544-957d-4637-8f97-f0395cf2961f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:44.564404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8fe3544-957d-4637-8f97-f0395cf2961f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:44.564890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8fe3544-957d-4637-8f97-f0395cf2961f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:44.565643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8fe3544-957d-4637-8f97-f0395cf2961f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:44.566076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8fe3544-957d-4637-8f97-f0395cf2961f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:44.581664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-18d53ac3-3f05-40de-ab69-7ee1bd745c7f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:44.583792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-18d53ac3-3f05-40de-ab69-7ee1bd745c7f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:44.589645 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d53ac3-3f05-40de-ab69-7ee1bd745c7f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:44.590086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d53ac3-3f05-40de-ab69-7ee1bd745c7f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:44.590835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d53ac3-3f05-40de-ab69-7ee1bd745c7f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:44.591262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d53ac3-3f05-40de-ab69-7ee1bd745c7f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:44.621273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-18d53ac3-3f05-40de-ab69-7ee1bd745c7f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043832 Jul 28 20:19:44.621828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 912/1973] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:44.629476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c8fe3544-957d-4637-8f97-f0395cf2961f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:44.636935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c8fe3544-957d-4637-8f97-f0395cf2961f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083538 Jul 28 20:19:44.637490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1062/1974] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:44 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:45.564960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-77e779b5-bb0d-4ff4-847f-467f280287b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:45.565491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-77e779b5-bb0d-4ff4-847f-467f280287b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:45.571864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77e779b5-bb0d-4ff4-847f-467f280287b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:45.572308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77e779b5-bb0d-4ff4-847f-467f280287b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:45.573086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77e779b5-bb0d-4ff4-847f-467f280287b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:45.573513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77e779b5-bb0d-4ff4-847f-467f280287b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:45.590978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:45.633899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-219899d7-6a9d-4cb1-94e7-c02566981a39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:45.636098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-219899d7-6a9d-4cb1-94e7-c02566981a39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:45.642736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-219899d7-6a9d-4cb1-94e7-c02566981a39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:45.643419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-219899d7-6a9d-4cb1-94e7-c02566981a39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:45.644188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-219899d7-6a9d-4cb1-94e7-c02566981a39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:45.644644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-219899d7-6a9d-4cb1-94e7-c02566981a39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:45.674882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-219899d7-6a9d-4cb1-94e7-c02566981a39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044893 Jul 28 20:19:45.675438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1063/1975] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:45.679810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b1a724fa-a6e5-41a1-9bad-ee45e04bab31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:45.680410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b1a724fa-a6e5-41a1-9bad-ee45e04bab31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:45.686472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b1a724fa-a6e5-41a1-9bad-ee45e04bab31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:45.686911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b1a724fa-a6e5-41a1-9bad-ee45e04bab31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:45.687662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b1a724fa-a6e5-41a1-9bad-ee45e04bab31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:45.688092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b1a724fa-a6e5-41a1-9bad-ee45e04bab31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:45.707814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-77e779b5-bb0d-4ff4-847f-467f280287b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:45.715699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-77e779b5-bb0d-4ff4-847f-467f280287b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.154760 Jul 28 20:19:45.716258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 913/1976] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:45.748363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b1a724fa-a6e5-41a1-9bad-ee45e04bab31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:45.755917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b1a724fa-a6e5-41a1-9bad-ee45e04bab31 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.079517 Jul 28 20:19:45.756466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1064/1977] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:45 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:46.687042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-108c6343-850f-48e6-a884-89d9ef9d57e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:46.689221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-108c6343-850f-48e6-a884-89d9ef9d57e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:46.696471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-108c6343-850f-48e6-a884-89d9ef9d57e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:46.696958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-108c6343-850f-48e6-a884-89d9ef9d57e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:46.697730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-108c6343-850f-48e6-a884-89d9ef9d57e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:46.698168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-108c6343-850f-48e6-a884-89d9ef9d57e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:46.729187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-108c6343-850f-48e6-a884-89d9ef9d57e2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046134 Jul 28 20:19:46.729739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 914/1978] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:46.737987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f5144857-cf05-4f8d-9875-a693f6986b2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:46.738581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f5144857-cf05-4f8d-9875-a693f6986b2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:46.745034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5144857-cf05-4f8d-9875-a693f6986b2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:46.745474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5144857-cf05-4f8d-9875-a693f6986b2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:46.746242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5144857-cf05-4f8d-9875-a693f6986b2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:46.746665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5144857-cf05-4f8d-9875-a693f6986b2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:46.777228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-025c7c62-9f28-46d9-ae49-944eb9c93292 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:46.777830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-025c7c62-9f28-46d9-ae49-944eb9c93292 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:46.785168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-025c7c62-9f28-46d9-ae49-944eb9c93292 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:46.785606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-025c7c62-9f28-46d9-ae49-944eb9c93292 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:46.786360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-025c7c62-9f28-46d9-ae49-944eb9c93292 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:46.786786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-025c7c62-9f28-46d9-ae49-944eb9c93292 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:46.858203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-025c7c62-9f28-46d9-ae49-944eb9c93292 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:46.865708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-025c7c62-9f28-46d9-ae49-944eb9c93292 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.092191 Jul 28 20:19:46.866267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 915/1979] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:46 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:19:46.898738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f5144857-cf05-4f8d-9875-a693f6986b2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:46.907523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f5144857-cf05-4f8d-9875-a693f6986b2b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.173314 Jul 28 20:19:46.908089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1065/1980] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:47.741487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fa0920cb-637f-4549-8179-f81407f4e66c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:47.743622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fa0920cb-637f-4549-8179-f81407f4e66c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:47.750718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa0920cb-637f-4549-8179-f81407f4e66c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:47.751142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa0920cb-637f-4549-8179-f81407f4e66c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:47.752164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa0920cb-637f-4549-8179-f81407f4e66c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:47.752624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa0920cb-637f-4549-8179-f81407f4e66c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:47.781517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fa0920cb-637f-4549-8179-f81407f4e66c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 Jul 28 20:19:47.782058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 916/1981] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:47.886856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3fb17ce4-d6c4-4831-964b-c768530c3d18 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:47.887494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3fb17ce4-d6c4-4831-964b-c768530c3d18 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:47.894747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fb17ce4-d6c4-4831-964b-c768530c3d18 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:47.895190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fb17ce4-d6c4-4831-964b-c768530c3d18 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:47.895940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fb17ce4-d6c4-4831-964b-c768530c3d18 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:47.896368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fb17ce4-d6c4-4831-964b-c768530c3d18 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:47.935003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-21f8a487-8b87-424a-942a-2b4376da8c9e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:47.935621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-21f8a487-8b87-424a-942a-2b4376da8c9e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:47.942945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21f8a487-8b87-424a-942a-2b4376da8c9e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:47.943734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21f8a487-8b87-424a-942a-2b4376da8c9e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:47.944531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21f8a487-8b87-424a-942a-2b4376da8c9e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:47.945001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-21f8a487-8b87-424a-942a-2b4376da8c9e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:47.963255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3fb17ce4-d6c4-4831-964b-c768530c3d18 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:47.971048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3fb17ce4-d6c4-4831-964b-c768530c3d18 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.088063 Jul 28 20:19:47.971618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1066/1982] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:48.075669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-21f8a487-8b87-424a-942a-2b4376da8c9e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:48.083660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-21f8a487-8b87-424a-942a-2b4376da8c9e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157759 Jul 28 20:19:48.084220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 917/1983] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:48.793859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b3808819-2bb3-4649-a356-7b1c456e7625 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:48.796585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b3808819-2bb3-4649-a356-7b1c456e7625 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:48.802657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3808819-2bb3-4649-a356-7b1c456e7625 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:48.803104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3808819-2bb3-4649-a356-7b1c456e7625 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:48.803858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3808819-2bb3-4649-a356-7b1c456e7625 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:48.804291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3808819-2bb3-4649-a356-7b1c456e7625 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:48.832788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b3808819-2bb3-4649-a356-7b1c456e7625 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042873 Jul 28 20:19:48.833327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1067/1984] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:48.992526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2ac31f67-087d-4ae3-af56-a373e14ea74b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:48.993158 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2ac31f67-087d-4ae3-af56-a373e14ea74b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:48.995447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=86 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:49.001420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2ac31f67-087d-4ae3-af56-a373e14ea74b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:49.001862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2ac31f67-087d-4ae3-af56-a373e14ea74b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:49.002609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2ac31f67-087d-4ae3-af56-a373e14ea74b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:49.003030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2ac31f67-087d-4ae3-af56-a373e14ea74b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:49.063980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2ac31f67-087d-4ae3-af56-a373e14ea74b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:49.071704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2ac31f67-087d-4ae3-af56-a373e14ea74b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083055 Jul 28 20:19:49.072251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 918/1985] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:49.106010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a94ce184-f1fc-4cb8-ad18-8bd92602e897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:49.106625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a94ce184-f1fc-4cb8-ad18-8bd92602e897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:49.113542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a94ce184-f1fc-4cb8-ad18-8bd92602e897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:49.113992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a94ce184-f1fc-4cb8-ad18-8bd92602e897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:49.114743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a94ce184-f1fc-4cb8-ad18-8bd92602e897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:49.115177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a94ce184-f1fc-4cb8-ad18-8bd92602e897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:49.246088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a94ce184-f1fc-4cb8-ad18-8bd92602e897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:49.254295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a94ce184-f1fc-4cb8-ad18-8bd92602e897 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152108 Jul 28 20:19:49.254862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1068/1986] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:49 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:49.845258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c9558b93-d6e8-4611-844b-76cf5b8aa041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:49.847377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c9558b93-d6e8-4611-844b-76cf5b8aa041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:49.853402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9558b93-d6e8-4611-844b-76cf5b8aa041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:49.853839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9558b93-d6e8-4611-844b-76cf5b8aa041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:49.854588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9558b93-d6e8-4611-844b-76cf5b8aa041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:49.855011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9558b93-d6e8-4611-844b-76cf5b8aa041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:49.886693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c9558b93-d6e8-4611-844b-76cf5b8aa041 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Jul 28 20:19:49.887155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 919/1987] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:50.091745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-94ac1091-a1d7-4efc-b7e8-8e44b01c981c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:50.092364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-94ac1091-a1d7-4efc-b7e8-8e44b01c981c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:50.094753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=80 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:50.099974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94ac1091-a1d7-4efc-b7e8-8e44b01c981c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:50.100418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94ac1091-a1d7-4efc-b7e8-8e44b01c981c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:50.101195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94ac1091-a1d7-4efc-b7e8-8e44b01c981c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:50.101626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94ac1091-a1d7-4efc-b7e8-8e44b01c981c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:50.173806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-94ac1091-a1d7-4efc-b7e8-8e44b01c981c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:50.181342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-94ac1091-a1d7-4efc-b7e8-8e44b01c981c tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.093402 Jul 28 20:19:50.181890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1069/1988] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:50 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:50.275771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b770cf28-2f86-49e0-8e8b-c27d79540450 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:50.276390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b770cf28-2f86-49e0-8e8b-c27d79540450 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:50.284028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b770cf28-2f86-49e0-8e8b-c27d79540450 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:50.284480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b770cf28-2f86-49e0-8e8b-c27d79540450 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:50.285274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b770cf28-2f86-49e0-8e8b-c27d79540450 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:50.285709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b770cf28-2f86-49e0-8e8b-c27d79540450 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:50.416082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b770cf28-2f86-49e0-8e8b-c27d79540450 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:50.424217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b770cf28-2f86-49e0-8e8b-c27d79540450 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152324 Jul 28 20:19:50.424813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 920/1989] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:50 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:50.899461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-88ac95ab-29d1-46d4-bd6d-b1ed2cf0c4cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:50.901644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-88ac95ab-29d1-46d4-bd6d-b1ed2cf0c4cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:50.907974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88ac95ab-29d1-46d4-bd6d-b1ed2cf0c4cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:50.908414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88ac95ab-29d1-46d4-bd6d-b1ed2cf0c4cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:50.909187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88ac95ab-29d1-46d4-bd6d-b1ed2cf0c4cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:50.909614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88ac95ab-29d1-46d4-bd6d-b1ed2cf0c4cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:50.937809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-88ac95ab-29d1-46d4-bd6d-b1ed2cf0c4cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042381 Jul 28 20:19:50.938333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1070/1990] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:51.203727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f4ee9f95-f15c-430e-ae78-e53c234815cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:51.204341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f4ee9f95-f15c-430e-ae78-e53c234815cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:51.210400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4ee9f95-f15c-430e-ae78-e53c234815cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:51.210845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4ee9f95-f15c-430e-ae78-e53c234815cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:51.211599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4ee9f95-f15c-430e-ae78-e53c234815cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:51.212031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f4ee9f95-f15c-430e-ae78-e53c234815cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:51.275956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f4ee9f95-f15c-430e-ae78-e53c234815cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:51.284285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f4ee9f95-f15c-430e-ae78-e53c234815cb tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084950 Jul 28 20:19:51.284928 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 921/1991] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:51 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:51.446072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f8f308d-fdb2-45ba-9314-d08e8394f491 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:51.446618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f8f308d-fdb2-45ba-9314-d08e8394f491 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:51.453340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f8f308d-fdb2-45ba-9314-d08e8394f491 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:51.453788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f8f308d-fdb2-45ba-9314-d08e8394f491 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:51.454542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f8f308d-fdb2-45ba-9314-d08e8394f491 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:51.454973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f8f308d-fdb2-45ba-9314-d08e8394f491 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:51.582507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2f8f308d-fdb2-45ba-9314-d08e8394f491 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:51.590639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f8f308d-fdb2-45ba-9314-d08e8394f491 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148505 Jul 28 20:19:51.591192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1071/1992] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:51.949961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e2b3640a-0826-4c97-b921-537ba860c50d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:51.952821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e2b3640a-0826-4c97-b921-537ba860c50d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:51.958837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2b3640a-0826-4c97-b921-537ba860c50d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:51.959289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2b3640a-0826-4c97-b921-537ba860c50d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:51.960047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2b3640a-0826-4c97-b921-537ba860c50d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:51.960479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e2b3640a-0826-4c97-b921-537ba860c50d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:51.997195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e2b3640a-0826-4c97-b921-537ba860c50d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051026 Jul 28 20:19:51.997668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 922/1993] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:52.305963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e5a86762-fa25-467b-9a46-6d73341a3237 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:52.306497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e5a86762-fa25-467b-9a46-6d73341a3237 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:52.313504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a86762-fa25-467b-9a46-6d73341a3237 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:52.315100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a86762-fa25-467b-9a46-6d73341a3237 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:52.315938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a86762-fa25-467b-9a46-6d73341a3237 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:52.316440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5a86762-fa25-467b-9a46-6d73341a3237 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:52.377704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5a86762-fa25-467b-9a46-6d73341a3237 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:52.385105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e5a86762-fa25-467b-9a46-6d73341a3237 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083089 Jul 28 20:19:52.385650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1072/1994] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:52 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:52.612793 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-34170fba-829d-4f49-8006-9d6c1e925abd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:52.613417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-34170fba-829d-4f49-8006-9d6c1e925abd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:52.619889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34170fba-829d-4f49-8006-9d6c1e925abd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:52.620341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34170fba-829d-4f49-8006-9d6c1e925abd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:52.621137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34170fba-829d-4f49-8006-9d6c1e925abd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:52.621571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34170fba-829d-4f49-8006-9d6c1e925abd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:52.752401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-34170fba-829d-4f49-8006-9d6c1e925abd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:52.760320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-34170fba-829d-4f49-8006-9d6c1e925abd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151382 Jul 28 20:19:52.760919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 923/1995] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:52 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:53.009618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ba98f452-bcb3-4853-a05c-b723b855685a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:53.011651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ba98f452-bcb3-4853-a05c-b723b855685a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:53.018174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba98f452-bcb3-4853-a05c-b723b855685a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:53.018614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba98f452-bcb3-4853-a05c-b723b855685a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:53.019361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba98f452-bcb3-4853-a05c-b723b855685a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:53.019787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ba98f452-bcb3-4853-a05c-b723b855685a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:53.049145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ba98f452-bcb3-4853-a05c-b723b855685a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 Jul 28 20:19:53.049682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1073/1996] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:53.407790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-264b4c87-eccb-409b-bf63-b33a1774aaa3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:53.408393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-264b4c87-eccb-409b-bf63-b33a1774aaa3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:53.414472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-264b4c87-eccb-409b-bf63-b33a1774aaa3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:53.414914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-264b4c87-eccb-409b-bf63-b33a1774aaa3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:53.415661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-264b4c87-eccb-409b-bf63-b33a1774aaa3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:53.416088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-264b4c87-eccb-409b-bf63-b33a1774aaa3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:53.476450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-264b4c87-eccb-409b-bf63-b33a1774aaa3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:53.483964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-264b4c87-eccb-409b-bf63-b33a1774aaa3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080950 Jul 28 20:19:53.484515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 924/1997] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:53 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:53.782359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ed128ac1-f458-4fb9-81c2-0e5a97b0d5af tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:53.783002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ed128ac1-f458-4fb9-81c2-0e5a97b0d5af tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:53.789031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed128ac1-f458-4fb9-81c2-0e5a97b0d5af tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:53.789480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed128ac1-f458-4fb9-81c2-0e5a97b0d5af tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:53.790232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed128ac1-f458-4fb9-81c2-0e5a97b0d5af tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:53.790669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed128ac1-f458-4fb9-81c2-0e5a97b0d5af tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:53.918634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ed128ac1-f458-4fb9-81c2-0e5a97b0d5af tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:53.922076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:53.927442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ed128ac1-f458-4fb9-81c2-0e5a97b0d5af tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149253 Jul 28 20:19:53.928007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1074/1998] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:54.061998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7339a1f1-b321-4858-b661-6d3ec5a2ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:54.064103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7339a1f1-b321-4858-b661-6d3ec5a2ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:54.070610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7339a1f1-b321-4858-b661-6d3ec5a2ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:54.071053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7339a1f1-b321-4858-b661-6d3ec5a2ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:54.071801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7339a1f1-b321-4858-b661-6d3ec5a2ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:54.072228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7339a1f1-b321-4858-b661-6d3ec5a2ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:54.100101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7339a1f1-b321-4858-b661-6d3ec5a2ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Jul 28 20:19:54.100658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 925/1999] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:54.503874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cf0ffe62-6917-4e9e-a9ab-46359c0a188d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:54.504514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cf0ffe62-6917-4e9e-a9ab-46359c0a188d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:54.511244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf0ffe62-6917-4e9e-a9ab-46359c0a188d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:54.511755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf0ffe62-6917-4e9e-a9ab-46359c0a188d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:54.512488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf0ffe62-6917-4e9e-a9ab-46359c0a188d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:54.512947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf0ffe62-6917-4e9e-a9ab-46359c0a188d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:54.578416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cf0ffe62-6917-4e9e-a9ab-46359c0a188d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:54.585927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cf0ffe62-6917-4e9e-a9ab-46359c0a188d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085977 Jul 28 20:19:54.586476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1075/2000] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:54 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:54.950016 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e423aeda-86f0-41dc-bdb9-1ce6d85fa953 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:54.950650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e423aeda-86f0-41dc-bdb9-1ce6d85fa953 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:54.956764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e423aeda-86f0-41dc-bdb9-1ce6d85fa953 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:54.957212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e423aeda-86f0-41dc-bdb9-1ce6d85fa953 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:54.957964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e423aeda-86f0-41dc-bdb9-1ce6d85fa953 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:54.958396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e423aeda-86f0-41dc-bdb9-1ce6d85fa953 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:55.085213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e423aeda-86f0-41dc-bdb9-1ce6d85fa953 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:55.093180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e423aeda-86f0-41dc-bdb9-1ce6d85fa953 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147077 Jul 28 20:19:55.093732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 926/2001] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:55.111801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7992f7ef-fc35-4621-b355-f339f1644f7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:55.114029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7992f7ef-fc35-4621-b355-f339f1644f7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:55.119922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7992f7ef-fc35-4621-b355-f339f1644f7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:55.120362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7992f7ef-fc35-4621-b355-f339f1644f7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:55.121154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7992f7ef-fc35-4621-b355-f339f1644f7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:55.121579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7992f7ef-fc35-4621-b355-f339f1644f7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:55.150198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7992f7ef-fc35-4621-b355-f339f1644f7e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042978 Jul 28 20:19:55.150892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1076/2002] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:55 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:55.607452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-57f28767-30c8-4c48-892c-abe303507318 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:55.608282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-57f28767-30c8-4c48-892c-abe303507318 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:55.614444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57f28767-30c8-4c48-892c-abe303507318 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:55.614889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57f28767-30c8-4c48-892c-abe303507318 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:55.615642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57f28767-30c8-4c48-892c-abe303507318 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:55.616083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57f28767-30c8-4c48-892c-abe303507318 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:55.676180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-57f28767-30c8-4c48-892c-abe303507318 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:55.683676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-57f28767-30c8-4c48-892c-abe303507318 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080112 Jul 28 20:19:55.684231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 927/2003] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:55 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:56.114418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eab59827-1bf2-4801-9b81-2a7fb84599a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:56.115031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eab59827-1bf2-4801-9b81-2a7fb84599a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:56.121580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eab59827-1bf2-4801-9b81-2a7fb84599a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:56.122028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eab59827-1bf2-4801-9b81-2a7fb84599a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:56.122776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eab59827-1bf2-4801-9b81-2a7fb84599a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:56.123209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eab59827-1bf2-4801-9b81-2a7fb84599a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:56.162577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-daea483e-9895-42ef-af1b-0028ad25f773 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:56.164835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-daea483e-9895-42ef-af1b-0028ad25f773 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:56.171745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-daea483e-9895-42ef-af1b-0028ad25f773 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:56.172204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-daea483e-9895-42ef-af1b-0028ad25f773 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:56.173019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-daea483e-9895-42ef-af1b-0028ad25f773 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:56.173651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-daea483e-9895-42ef-af1b-0028ad25f773 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:56.204837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-daea483e-9895-42ef-af1b-0028ad25f773 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046227 Jul 28 20:19:56.205406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 928/2004] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:19:56.265170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eab59827-1bf2-4801-9b81-2a7fb84599a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:56.273164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eab59827-1bf2-4801-9b81-2a7fb84599a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.162651 Jul 28 20:19:56.273728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1077/2005] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:56.704132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-95972de7-118d-42b3-9cdb-8afc8f40ae0a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:56.704784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-95972de7-118d-42b3-9cdb-8afc8f40ae0a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:56.710935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95972de7-118d-42b3-9cdb-8afc8f40ae0a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:56.711388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95972de7-118d-42b3-9cdb-8afc8f40ae0a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:56.712147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95972de7-118d-42b3-9cdb-8afc8f40ae0a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:56.712837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95972de7-118d-42b3-9cdb-8afc8f40ae0a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:56.792648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-95972de7-118d-42b3-9cdb-8afc8f40ae0a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:56.800765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-95972de7-118d-42b3-9cdb-8afc8f40ae0a tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.100523 Jul 28 20:19:56.801670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 929/2006] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:56 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:57.216999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-40b95ba5-6bb2-4bf8-bffa-d8e36861b2d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:57.219655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-40b95ba5-6bb2-4bf8-bffa-d8e36861b2d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:57.226043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40b95ba5-6bb2-4bf8-bffa-d8e36861b2d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:57.226481 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40b95ba5-6bb2-4bf8-bffa-d8e36861b2d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:57.227225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40b95ba5-6bb2-4bf8-bffa-d8e36861b2d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:57.227652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40b95ba5-6bb2-4bf8-bffa-d8e36861b2d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:57.257636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-40b95ba5-6bb2-4bf8-bffa-d8e36861b2d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044643 Jul 28 20:19:57.258166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1078/2007] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:57.293676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-09d561b1-d716-4947-9f40-7711e6217eec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:57.294284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-09d561b1-d716-4947-9f40-7711e6217eec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:57.301379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09d561b1-d716-4947-9f40-7711e6217eec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:57.301824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09d561b1-d716-4947-9f40-7711e6217eec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:57.302574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09d561b1-d716-4947-9f40-7711e6217eec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:57.303003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-09d561b1-d716-4947-9f40-7711e6217eec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:57.306992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:19:57.431877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-09d561b1-d716-4947-9f40-7711e6217eec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:57.441356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-09d561b1-d716-4947-9f40-7711e6217eec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151435 Jul 28 20:19:57.441916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 930/2008] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:57 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:57.822032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f383b11-5134-4407-b336-44060d8eb846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:57.822646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f383b11-5134-4407-b336-44060d8eb846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:57.828734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f383b11-5134-4407-b336-44060d8eb846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:57.829180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f383b11-5134-4407-b336-44060d8eb846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:57.829922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f383b11-5134-4407-b336-44060d8eb846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:57.830352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f383b11-5134-4407-b336-44060d8eb846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:57.893389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2f383b11-5134-4407-b336-44060d8eb846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:57.900848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f383b11-5134-4407-b336-44060d8eb846 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082712 Jul 28 20:19:57.901408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1079/2009] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:57 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:58.268933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dee61fc8-b953-4cc8-bf63-3f2455a9c12c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:58.271098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dee61fc8-b953-4cc8-bf63-3f2455a9c12c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:58.277186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dee61fc8-b953-4cc8-bf63-3f2455a9c12c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:58.277627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dee61fc8-b953-4cc8-bf63-3f2455a9c12c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:58.278373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dee61fc8-b953-4cc8-bf63-3f2455a9c12c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:58.278802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dee61fc8-b953-4cc8-bf63-3f2455a9c12c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:58.309312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dee61fc8-b953-4cc8-bf63-3f2455a9c12c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044335 Jul 28 20:19:58.309955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 931/2010] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:58 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:58.463264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-87c2b93d-f853-4242-8a84-d5292c01dd91 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:58.463834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-87c2b93d-f853-4242-8a84-d5292c01dd91 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:58.470967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-87c2b93d-f853-4242-8a84-d5292c01dd91 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:58.471417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-87c2b93d-f853-4242-8a84-d5292c01dd91 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:58.472167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-87c2b93d-f853-4242-8a84-d5292c01dd91 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:58.472629 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-87c2b93d-f853-4242-8a84-d5292c01dd91 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:58.613106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-87c2b93d-f853-4242-8a84-d5292c01dd91 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:58.621075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-87c2b93d-f853-4242-8a84-d5292c01dd91 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.161743 Jul 28 20:19:58.621632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1080/2011] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:58.922685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-89badfcc-8056-4aed-a389-2edfbb957400 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:58.923294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-89badfcc-8056-4aed-a389-2edfbb957400 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:58.929335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-89badfcc-8056-4aed-a389-2edfbb957400 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:58.929787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-89badfcc-8056-4aed-a389-2edfbb957400 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:58.930542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-89badfcc-8056-4aed-a389-2edfbb957400 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:58.930975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-89badfcc-8056-4aed-a389-2edfbb957400 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:58.991523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-89badfcc-8056-4aed-a389-2edfbb957400 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:58.998922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-89badfcc-8056-4aed-a389-2edfbb957400 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080722 Jul 28 20:19:58.999467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 932/2012] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:58 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:19:59.321631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-528a241c-3643-4518-90da-849e8a6eaabc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:59.323755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-528a241c-3643-4518-90da-849e8a6eaabc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:59.330380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-528a241c-3643-4518-90da-849e8a6eaabc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:59.330825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-528a241c-3643-4518-90da-849e8a6eaabc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:59.331577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-528a241c-3643-4518-90da-849e8a6eaabc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:59.332007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-528a241c-3643-4518-90da-849e8a6eaabc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:59.361614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-528a241c-3643-4518-90da-849e8a6eaabc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 Jul 28 20:19:59.362162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1081/2013] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:19:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:19:59.643503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-49f32e92-cab5-4cad-833a-f61da8017f51 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:19:59.644115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-49f32e92-cab5-4cad-833a-f61da8017f51 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:19:59.650454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-49f32e92-cab5-4cad-833a-f61da8017f51 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:59.650892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-49f32e92-cab5-4cad-833a-f61da8017f51 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:59.651635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-49f32e92-cab5-4cad-833a-f61da8017f51 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:19:59.652062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-49f32e92-cab5-4cad-833a-f61da8017f51 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:19:59.784584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-49f32e92-cab5-4cad-833a-f61da8017f51 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:19:59.792574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-49f32e92-cab5-4cad-833a-f61da8017f51 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.153355 Jul 28 20:19:59.793138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 933/2014] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:19:59 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:00.020156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dd4886f4-2194-4164-ba0c-25d388f00945 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:00.020839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dd4886f4-2194-4164-ba0c-25d388f00945 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:00.027212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd4886f4-2194-4164-ba0c-25d388f00945 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:00.027655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd4886f4-2194-4164-ba0c-25d388f00945 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:00.028394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd4886f4-2194-4164-ba0c-25d388f00945 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:00.028862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dd4886f4-2194-4164-ba0c-25d388f00945 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:00.089992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dd4886f4-2194-4164-ba0c-25d388f00945 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:00.098433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dd4886f4-2194-4164-ba0c-25d388f00945 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082722 Jul 28 20:20:00.099028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1082/2015] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:00 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:00.373542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f652482f-b4a1-4b1c-af34-51cedcaa3a01 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:00.376037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f652482f-b4a1-4b1c-af34-51cedcaa3a01 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:00.382460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f652482f-b4a1-4b1c-af34-51cedcaa3a01 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:00.382898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f652482f-b4a1-4b1c-af34-51cedcaa3a01 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:00.383643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f652482f-b4a1-4b1c-af34-51cedcaa3a01 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:00.384072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f652482f-b4a1-4b1c-af34-51cedcaa3a01 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:00.413835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f652482f-b4a1-4b1c-af34-51cedcaa3a01 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 Jul 28 20:20:00.414382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 934/2016] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:00.814743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fafa2f31-25a0-49af-a85b-4a54699a4d37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:00.815444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fafa2f31-25a0-49af-a85b-4a54699a4d37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:00.821338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fafa2f31-25a0-49af-a85b-4a54699a4d37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:00.821788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fafa2f31-25a0-49af-a85b-4a54699a4d37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:00.822544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fafa2f31-25a0-49af-a85b-4a54699a4d37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:00.822971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fafa2f31-25a0-49af-a85b-4a54699a4d37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:00.951936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fafa2f31-25a0-49af-a85b-4a54699a4d37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:00.960321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fafa2f31-25a0-49af-a85b-4a54699a4d37 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149608 Jul 28 20:20:00.960914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1083/2017] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:01.118751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bb053045-cf6a-48f3-9f87-50463a12d9f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:01.119363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bb053045-cf6a-48f3-9f87-50463a12d9f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:01.126011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb053045-cf6a-48f3-9f87-50463a12d9f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:01.126454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb053045-cf6a-48f3-9f87-50463a12d9f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:01.127205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb053045-cf6a-48f3-9f87-50463a12d9f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:01.127638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb053045-cf6a-48f3-9f87-50463a12d9f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:01.191566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bb053045-cf6a-48f3-9f87-50463a12d9f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:01.199017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bb053045-cf6a-48f3-9f87-50463a12d9f2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084093 Jul 28 20:20:01.199573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 935/2018] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:01 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:01.425877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-940bd746-4057-49d3-9b50-abc01a926b50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:01.427977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-940bd746-4057-49d3-9b50-abc01a926b50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:01.434681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-940bd746-4057-49d3-9b50-abc01a926b50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:01.435126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-940bd746-4057-49d3-9b50-abc01a926b50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:01.435904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-940bd746-4057-49d3-9b50-abc01a926b50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:01.436335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-940bd746-4057-49d3-9b50-abc01a926b50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:01.467598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-940bd746-4057-49d3-9b50-abc01a926b50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046363 Jul 28 20:20:01.468144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1084/2019] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:01.982538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1a8b1a9e-ae04-4b22-ba92-c3435cfd5560 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:01.983141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1a8b1a9e-ae04-4b22-ba92-c3435cfd5560 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:01.990103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a8b1a9e-ae04-4b22-ba92-c3435cfd5560 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:01.990540 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a8b1a9e-ae04-4b22-ba92-c3435cfd5560 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:01.991292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a8b1a9e-ae04-4b22-ba92-c3435cfd5560 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:01.991717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a8b1a9e-ae04-4b22-ba92-c3435cfd5560 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:02.118930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1a8b1a9e-ae04-4b22-ba92-c3435cfd5560 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:02.127258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1a8b1a9e-ae04-4b22-ba92-c3435cfd5560 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148592 Jul 28 20:20:02.127810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 936/2020] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:02.221484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4f22dd01-232e-42d6-8f8e-6bc20ae61de3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:02.222092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4f22dd01-232e-42d6-8f8e-6bc20ae61de3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:02.228077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f22dd01-232e-42d6-8f8e-6bc20ae61de3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:02.228514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f22dd01-232e-42d6-8f8e-6bc20ae61de3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:02.229283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f22dd01-232e-42d6-8f8e-6bc20ae61de3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:02.229707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f22dd01-232e-42d6-8f8e-6bc20ae61de3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:02.290611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4f22dd01-232e-42d6-8f8e-6bc20ae61de3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:02.298067 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4f22dd01-232e-42d6-8f8e-6bc20ae61de3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081209 Jul 28 20:20:02.298670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1085/2021] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:02 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:02.479801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d961d9d1-b71d-4651-9e60-839abc6d18ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:02.481988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d961d9d1-b71d-4651-9e60-839abc6d18ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:02.488402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d961d9d1-b71d-4651-9e60-839abc6d18ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:02.488817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d961d9d1-b71d-4651-9e60-839abc6d18ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:02.489568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d961d9d1-b71d-4651-9e60-839abc6d18ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:02.490026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d961d9d1-b71d-4651-9e60-839abc6d18ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:02.518718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d961d9d1-b71d-4651-9e60-839abc6d18ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043283 Jul 28 20:20:02.519255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 937/2022] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:02 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:03.148411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b5ea5b3e-b49f-49b3-badc-17979c262f97 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:03.149048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b5ea5b3e-b49f-49b3-badc-17979c262f97 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:03.155097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5ea5b3e-b49f-49b3-badc-17979c262f97 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:03.155796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5ea5b3e-b49f-49b3-badc-17979c262f97 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:03.156554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5ea5b3e-b49f-49b3-badc-17979c262f97 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:03.156991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5ea5b3e-b49f-49b3-badc-17979c262f97 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:03.293728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b5ea5b3e-b49f-49b3-badc-17979c262f97 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:03.303253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b5ea5b3e-b49f-49b3-badc-17979c262f97 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.158851 Jul 28 20:20:03.303828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1086/2023] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:03 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:03.318322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3e15238e-88d1-4e2b-bdfa-40bd62ff4cc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:03.318925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3e15238e-88d1-4e2b-bdfa-40bd62ff4cc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:03.326275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e15238e-88d1-4e2b-bdfa-40bd62ff4cc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:03.326717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e15238e-88d1-4e2b-bdfa-40bd62ff4cc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:03.327466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e15238e-88d1-4e2b-bdfa-40bd62ff4cc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:03.327889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e15238e-88d1-4e2b-bdfa-40bd62ff4cc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:03.391056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3e15238e-88d1-4e2b-bdfa-40bd62ff4cc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:03.398532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3e15238e-88d1-4e2b-bdfa-40bd62ff4cc1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083913 Jul 28 20:20:03.399020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 938/2024] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:03 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:03.532893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-482fd778-3172-452f-90ea-0b91c06c7390 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:03.535130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-482fd778-3172-452f-90ea-0b91c06c7390 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:03.541359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-482fd778-3172-452f-90ea-0b91c06c7390 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:03.541894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-482fd778-3172-452f-90ea-0b91c06c7390 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:03.542718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-482fd778-3172-452f-90ea-0b91c06c7390 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:03.543156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-482fd778-3172-452f-90ea-0b91c06c7390 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:03.572327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-482fd778-3172-452f-90ea-0b91c06c7390 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Jul 28 20:20:03.572920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1087/2025] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:04.325195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-94048539-d285-4190-bebc-4ae81f1b7ba2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:04.325809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-94048539-d285-4190-bebc-4ae81f1b7ba2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:04.332914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94048539-d285-4190-bebc-4ae81f1b7ba2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:04.333365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94048539-d285-4190-bebc-4ae81f1b7ba2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:04.334123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94048539-d285-4190-bebc-4ae81f1b7ba2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:04.334554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94048539-d285-4190-bebc-4ae81f1b7ba2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:04.419043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4a07400b-eed2-4108-ae65-92186fba13ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:04.419647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4a07400b-eed2-4108-ae65-92186fba13ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:04.427014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a07400b-eed2-4108-ae65-92186fba13ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:04.427381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a07400b-eed2-4108-ae65-92186fba13ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:04.428137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a07400b-eed2-4108-ae65-92186fba13ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:04.428580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a07400b-eed2-4108-ae65-92186fba13ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:04.463227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-94048539-d285-4190-bebc-4ae81f1b7ba2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:04.472240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-94048539-d285-4190-bebc-4ae81f1b7ba2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150831 Jul 28 20:20:04.472850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 939/2026] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:04 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:04.494992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4a07400b-eed2-4108-ae65-92186fba13ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:04.502480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4a07400b-eed2-4108-ae65-92186fba13ae tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087180 Jul 28 20:20:04.503029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1088/2027] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:04 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:04.585260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fe565032-17f0-4e03-b926-3d3eff76755e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:04.587431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fe565032-17f0-4e03-b926-3d3eff76755e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:04.593427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe565032-17f0-4e03-b926-3d3eff76755e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:04.593875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe565032-17f0-4e03-b926-3d3eff76755e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:04.595252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe565032-17f0-4e03-b926-3d3eff76755e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:04.595764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe565032-17f0-4e03-b926-3d3eff76755e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:04.623659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fe565032-17f0-4e03-b926-3d3eff76755e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042333 Jul 28 20:20:04.624174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 940/2028] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:20:05.493409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ed422941-e9e9-4118-8af1-80324ca76f68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:05.494105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ed422941-e9e9-4118-8af1-80324ca76f68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:05.500618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed422941-e9e9-4118-8af1-80324ca76f68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:05.501143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed422941-e9e9-4118-8af1-80324ca76f68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:05.501873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed422941-e9e9-4118-8af1-80324ca76f68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:05.502302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ed422941-e9e9-4118-8af1-80324ca76f68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:05.523283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9ace1553-bf5f-4962-9ba1-661d591b3e65 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:05.524041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9ace1553-bf5f-4962-9ba1-661d591b3e65 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:05.531128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ace1553-bf5f-4962-9ba1-661d591b3e65 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:05.531563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ace1553-bf5f-4962-9ba1-661d591b3e65 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:05.532953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ace1553-bf5f-4962-9ba1-661d591b3e65 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:05.533386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ace1553-bf5f-4962-9ba1-661d591b3e65 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:05.618715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9ace1553-bf5f-4962-9ba1-661d591b3e65 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:05.626961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9ace1553-bf5f-4962-9ba1-661d591b3e65 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.107887 Jul 28 20:20:05.627672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 941/2029] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:05 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:05.640155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6e32b9d0-35d8-415a-8135-e67b3ac08a03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:05.643936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6e32b9d0-35d8-415a-8135-e67b3ac08a03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:05.650775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e32b9d0-35d8-415a-8135-e67b3ac08a03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:05.651216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e32b9d0-35d8-415a-8135-e67b3ac08a03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:05.652078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e32b9d0-35d8-415a-8135-e67b3ac08a03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:05.652511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6e32b9d0-35d8-415a-8135-e67b3ac08a03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:05.687814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6e32b9d0-35d8-415a-8135-e67b3ac08a03 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055033 Jul 28 20:20:05.688902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 942/2030] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:05.695433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ed422941-e9e9-4118-8af1-80324ca76f68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:05.703588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ed422941-e9e9-4118-8af1-80324ca76f68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.214033 Jul 28 20:20:05.704829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1089/2031] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:05 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:06.648448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ad84165-65ab-44ef-bdae-a7136d2fbac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:06.649078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0ad84165-65ab-44ef-bdae-a7136d2fbac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:06.656076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ad84165-65ab-44ef-bdae-a7136d2fbac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:06.656513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ad84165-65ab-44ef-bdae-a7136d2fbac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:06.657878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ad84165-65ab-44ef-bdae-a7136d2fbac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:06.658469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ad84165-65ab-44ef-bdae-a7136d2fbac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:06.703347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1d362c68-3b0c-421e-8403-89efff0323b3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:06.706365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1d362c68-3b0c-421e-8403-89efff0323b3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:06.713056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d362c68-3b0c-421e-8403-89efff0323b3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:06.713497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d362c68-3b0c-421e-8403-89efff0323b3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:06.714257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d362c68-3b0c-421e-8403-89efff0323b3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:06.714710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d362c68-3b0c-421e-8403-89efff0323b3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:06.723974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0ad84165-65ab-44ef-bdae-a7136d2fbac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:06.731833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0ad84165-65ab-44ef-bdae-a7136d2fbac5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.087264 Jul 28 20:20:06.735735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 943/2032] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:06 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:06.737340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-19ecf354-04ab-4190-b9f4-026b15cfd4cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:06.738014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-19ecf354-04ab-4190-b9f4-026b15cfd4cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:06.743994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-19ecf354-04ab-4190-b9f4-026b15cfd4cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:06.744526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-19ecf354-04ab-4190-b9f4-026b15cfd4cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:06.745555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-19ecf354-04ab-4190-b9f4-026b15cfd4cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:06.745995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-19ecf354-04ab-4190-b9f4-026b15cfd4cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:06.760792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1d362c68-3b0c-421e-8403-89efff0323b3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063371 Jul 28 20:20:06.761553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1090/2033] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:20:06.873398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-19ecf354-04ab-4190-b9f4-026b15cfd4cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:06.882203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-19ecf354-04ab-4190-b9f4-026b15cfd4cc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148732 Jul 28 20:20:06.882763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 944/2034] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:06 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:07.753493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a3420a88-e5d5-4cd5-b6e9-8f39d1b383e8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:07.754097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a3420a88-e5d5-4cd5-b6e9-8f39d1b383e8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:07.760455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a3420a88-e5d5-4cd5-b6e9-8f39d1b383e8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:07.760926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a3420a88-e5d5-4cd5-b6e9-8f39d1b383e8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:07.761667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a3420a88-e5d5-4cd5-b6e9-8f39d1b383e8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:07.762089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a3420a88-e5d5-4cd5-b6e9-8f39d1b383e8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:07.773382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-78110610-afe8-401b-8864-a115aa6802ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:07.775553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-78110610-afe8-401b-8864-a115aa6802ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:07.779807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:07.782765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78110610-afe8-401b-8864-a115aa6802ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:07.783057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78110610-afe8-401b-8864-a115aa6802ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:07.783823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78110610-afe8-401b-8864-a115aa6802ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:07.784252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78110610-afe8-401b-8864-a115aa6802ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:07.815275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-78110610-afe8-401b-8864-a115aa6802ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045795 Jul 28 20:20:07.815834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 945/2035] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:20:07.824741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a3420a88-e5d5-4cd5-b6e9-8f39d1b383e8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:07.832211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a3420a88-e5d5-4cd5-b6e9-8f39d1b383e8 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083410 Jul 28 20:20:07.832788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1091/2036] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:07 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:07.903965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-41231bab-cb03-49a3-93b5-4dca7668b60f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:07.904608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-41231bab-cb03-49a3-93b5-4dca7668b60f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:07.911412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41231bab-cb03-49a3-93b5-4dca7668b60f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:07.911865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41231bab-cb03-49a3-93b5-4dca7668b60f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:07.912650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41231bab-cb03-49a3-93b5-4dca7668b60f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:07.913088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-41231bab-cb03-49a3-93b5-4dca7668b60f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:08.043155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-41231bab-cb03-49a3-93b5-4dca7668b60f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:08.046508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:08.052975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-41231bab-cb03-49a3-93b5-4dca7668b60f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152793 Jul 28 20:20:08.053525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 946/2037] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:07 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:08.827339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3ac29127-a0a4-4b15-8503-d5b59716f09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:08.829639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3ac29127-a0a4-4b15-8503-d5b59716f09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:08.836046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ac29127-a0a4-4b15-8503-d5b59716f09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:08.836484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ac29127-a0a4-4b15-8503-d5b59716f09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:08.837255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ac29127-a0a4-4b15-8503-d5b59716f09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:08.837681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ac29127-a0a4-4b15-8503-d5b59716f09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:08.853474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-347f169d-5387-49e4-9b61-c45044089b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:08.854177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-347f169d-5387-49e4-9b61-c45044089b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:08.861470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-347f169d-5387-49e4-9b61-c45044089b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:08.861918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-347f169d-5387-49e4-9b61-c45044089b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:08.862675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-347f169d-5387-49e4-9b61-c45044089b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:08.863104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-347f169d-5387-49e4-9b61-c45044089b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:08.867249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3ac29127-a0a4-4b15-8503-d5b59716f09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Jul 28 20:20:08.867799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1092/2038] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:08.925904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-347f169d-5387-49e4-9b61-c45044089b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:08.933343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-347f169d-5387-49e4-9b61-c45044089b44 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084052 Jul 28 20:20:08.933902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 947/2039] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:08 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:09.074174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9a5a85bf-fb13-4f7d-8848-6c32a9f28288 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:09.074785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9a5a85bf-fb13-4f7d-8848-6c32a9f28288 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:09.081874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a5a85bf-fb13-4f7d-8848-6c32a9f28288 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:09.082260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a5a85bf-fb13-4f7d-8848-6c32a9f28288 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:09.082999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a5a85bf-fb13-4f7d-8848-6c32a9f28288 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:09.083426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9a5a85bf-fb13-4f7d-8848-6c32a9f28288 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:09.209557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9a5a85bf-fb13-4f7d-8848-6c32a9f28288 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:09.217648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9a5a85bf-fb13-4f7d-8848-6c32a9f28288 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147264 Jul 28 20:20:09.218217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1093/2040] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:09 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:09.880290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a2cfd4ef-0c28-4a5d-8728-e8544c741a40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:09.882445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a2cfd4ef-0c28-4a5d-8728-e8544c741a40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:09.888848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2cfd4ef-0c28-4a5d-8728-e8544c741a40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:09.889293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2cfd4ef-0c28-4a5d-8728-e8544c741a40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:09.890039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2cfd4ef-0c28-4a5d-8728-e8544c741a40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:09.890464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a2cfd4ef-0c28-4a5d-8728-e8544c741a40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:09.954595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-03a6711a-5bcd-47c1-8c84-c7cbeab3783b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:09.955205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-03a6711a-5bcd-47c1-8c84-c7cbeab3783b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:09.962218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-03a6711a-5bcd-47c1-8c84-c7cbeab3783b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:09.962661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-03a6711a-5bcd-47c1-8c84-c7cbeab3783b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:09.963428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-03a6711a-5bcd-47c1-8c84-c7cbeab3783b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:09.963856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-03a6711a-5bcd-47c1-8c84-c7cbeab3783b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:10.032494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-03a6711a-5bcd-47c1-8c84-c7cbeab3783b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:10.040686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-03a6711a-5bcd-47c1-8c84-c7cbeab3783b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.090513 Jul 28 20:20:10.041734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1094/2041] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:09 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:10.074450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a2cfd4ef-0c28-4a5d-8728-e8544c741a40 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198901 Jul 28 20:20:10.074989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 948/2042] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:09 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:10.239793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4c0172e9-c2f5-4dfc-9d20-55927f9e0455 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:10.240435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4c0172e9-c2f5-4dfc-9d20-55927f9e0455 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:10.246527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c0172e9-c2f5-4dfc-9d20-55927f9e0455 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:10.246976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c0172e9-c2f5-4dfc-9d20-55927f9e0455 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:10.247729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c0172e9-c2f5-4dfc-9d20-55927f9e0455 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:10.248162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c0172e9-c2f5-4dfc-9d20-55927f9e0455 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:10.378188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4c0172e9-c2f5-4dfc-9d20-55927f9e0455 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:10.386199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4c0172e9-c2f5-4dfc-9d20-55927f9e0455 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150833 Jul 28 20:20:10.386762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1095/2043] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:10 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:11.062262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-af7ec86a-943d-4044-a0e0-9612e40eeab5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:11.062868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-af7ec86a-943d-4044-a0e0-9612e40eeab5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:11.069780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af7ec86a-943d-4044-a0e0-9612e40eeab5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:11.070222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af7ec86a-943d-4044-a0e0-9612e40eeab5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:11.070970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af7ec86a-943d-4044-a0e0-9612e40eeab5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:11.071428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af7ec86a-943d-4044-a0e0-9612e40eeab5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:11.086361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-866af003-cc8e-4a01-9201-18a69efdeba3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:11.088511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-866af003-cc8e-4a01-9201-18a69efdeba3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:11.095118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-866af003-cc8e-4a01-9201-18a69efdeba3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:11.095566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-866af003-cc8e-4a01-9201-18a69efdeba3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:11.096332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-866af003-cc8e-4a01-9201-18a69efdeba3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:11.096789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-866af003-cc8e-4a01-9201-18a69efdeba3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:11.126544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-866af003-cc8e-4a01-9201-18a69efdeba3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Jul 28 20:20:11.127178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1096/2044] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:20:11.132449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-af7ec86a-943d-4044-a0e0-9612e40eeab5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:11.139940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-af7ec86a-943d-4044-a0e0-9612e40eeab5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081547 Jul 28 20:20:11.140476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 949/2045] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:11 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:11.406869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c1e15dce-552c-4109-acad-78c227fb18f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:11.407479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c1e15dce-552c-4109-acad-78c227fb18f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:11.413536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c1e15dce-552c-4109-acad-78c227fb18f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:11.413985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c1e15dce-552c-4109-acad-78c227fb18f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:11.414740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c1e15dce-552c-4109-acad-78c227fb18f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:11.415175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c1e15dce-552c-4109-acad-78c227fb18f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:11.545023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c1e15dce-552c-4109-acad-78c227fb18f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:11.553089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c1e15dce-552c-4109-acad-78c227fb18f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150333 Jul 28 20:20:11.553652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1097/2046] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:11 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:12.138949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9611eadd-c924-4856-89ea-29d4cad2c41c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:12.141096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9611eadd-c924-4856-89ea-29d4cad2c41c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:12.148286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9611eadd-c924-4856-89ea-29d4cad2c41c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:12.148764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9611eadd-c924-4856-89ea-29d4cad2c41c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:12.149515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9611eadd-c924-4856-89ea-29d4cad2c41c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:12.149943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9611eadd-c924-4856-89ea-29d4cad2c41c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:12.162001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-65133e7f-9aae-43c1-8213-f23036b41ebd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:12.162647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-65133e7f-9aae-43c1-8213-f23036b41ebd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:12.169638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65133e7f-9aae-43c1-8213-f23036b41ebd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:12.170089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65133e7f-9aae-43c1-8213-f23036b41ebd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:12.170882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65133e7f-9aae-43c1-8213-f23036b41ebd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:12.171348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-65133e7f-9aae-43c1-8213-f23036b41ebd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:12.181490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9611eadd-c924-4856-89ea-29d4cad2c41c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Jul 28 20:20:12.182038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 950/2047] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:12.234115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-65133e7f-9aae-43c1-8213-f23036b41ebd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:12.241694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-65133e7f-9aae-43c1-8213-f23036b41ebd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084229 Jul 28 20:20:12.242257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1098/2048] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:12 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:12.574952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e74d568-3a14-4518-9dde-ad214e68cd1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:12.575567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9e74d568-3a14-4518-9dde-ad214e68cd1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:12.582156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e74d568-3a14-4518-9dde-ad214e68cd1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:12.582601 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e74d568-3a14-4518-9dde-ad214e68cd1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:12.583354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e74d568-3a14-4518-9dde-ad214e68cd1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:12.583785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e74d568-3a14-4518-9dde-ad214e68cd1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:12.708025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9e74d568-3a14-4518-9dde-ad214e68cd1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:12.716430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e74d568-3a14-4518-9dde-ad214e68cd1a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.145319 Jul 28 20:20:12.717007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 951/2049] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:12 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:13.194391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-91f0f845-aae7-4008-bddc-f68308119fe2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:13.196554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-91f0f845-aae7-4008-bddc-f68308119fe2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:13.202970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91f0f845-aae7-4008-bddc-f68308119fe2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:13.203413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91f0f845-aae7-4008-bddc-f68308119fe2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:13.204336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91f0f845-aae7-4008-bddc-f68308119fe2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:13.204797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-91f0f845-aae7-4008-bddc-f68308119fe2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:13.233403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-91f0f845-aae7-4008-bddc-f68308119fe2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 Jul 28 20:20:13.233942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1099/2050] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:13.262472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0fdb817a-7442-46eb-9673-fff6e4a8d8b2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:13.263080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0fdb817a-7442-46eb-9673-fff6e4a8d8b2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:13.269441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0fdb817a-7442-46eb-9673-fff6e4a8d8b2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:13.269880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0fdb817a-7442-46eb-9673-fff6e4a8d8b2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:13.270627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0fdb817a-7442-46eb-9673-fff6e4a8d8b2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:13.271128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0fdb817a-7442-46eb-9673-fff6e4a8d8b2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:13.333782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0fdb817a-7442-46eb-9673-fff6e4a8d8b2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:13.341266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0fdb817a-7442-46eb-9673-fff6e4a8d8b2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082599 Jul 28 20:20:13.341810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 952/2051] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:13 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:13.738077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-617b22d6-ca6b-417d-820f-9b8555dbc7ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:13.738724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-617b22d6-ca6b-417d-820f-9b8555dbc7ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:13.744890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-617b22d6-ca6b-417d-820f-9b8555dbc7ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:13.745331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-617b22d6-ca6b-417d-820f-9b8555dbc7ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:13.746072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-617b22d6-ca6b-417d-820f-9b8555dbc7ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:13.746494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-617b22d6-ca6b-417d-820f-9b8555dbc7ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:13.872771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-617b22d6-ca6b-417d-820f-9b8555dbc7ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:13.881218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-617b22d6-ca6b-417d-820f-9b8555dbc7ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147082 Jul 28 20:20:13.881775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1100/2052] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:13 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:14.246413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bb38ad53-3a78-4d90-abf4-a48d40143aa8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:14.248569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bb38ad53-3a78-4d90-abf4-a48d40143aa8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:14.255247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb38ad53-3a78-4d90-abf4-a48d40143aa8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:14.255696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb38ad53-3a78-4d90-abf4-a48d40143aa8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:14.256456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb38ad53-3a78-4d90-abf4-a48d40143aa8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:14.256918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb38ad53-3a78-4d90-abf4-a48d40143aa8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:14.285547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bb38ad53-3a78-4d90-abf4-a48d40143aa8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Jul 28 20:20:14.286164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 953/2053] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:14.363580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6f7e33bc-694f-46cc-81e5-64f41ce20460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:14.364114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6f7e33bc-694f-46cc-81e5-64f41ce20460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:14.370617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f7e33bc-694f-46cc-81e5-64f41ce20460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:14.371061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f7e33bc-694f-46cc-81e5-64f41ce20460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:14.371813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f7e33bc-694f-46cc-81e5-64f41ce20460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:14.372243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f7e33bc-694f-46cc-81e5-64f41ce20460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:14.432670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6f7e33bc-694f-46cc-81e5-64f41ce20460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:14.440720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6f7e33bc-694f-46cc-81e5-64f41ce20460 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081753 Jul 28 20:20:14.441271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1101/2054] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:14 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:14.903217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ec88be66-8cc6-400b-9514-c5bc7ec1550d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:14.903834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ec88be66-8cc6-400b-9514-c5bc7ec1550d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:14.911120 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec88be66-8cc6-400b-9514-c5bc7ec1550d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:14.911597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec88be66-8cc6-400b-9514-c5bc7ec1550d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:14.912354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec88be66-8cc6-400b-9514-c5bc7ec1550d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:14.912813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec88be66-8cc6-400b-9514-c5bc7ec1550d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:15.044733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ec88be66-8cc6-400b-9514-c5bc7ec1550d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:15.053188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ec88be66-8cc6-400b-9514-c5bc7ec1550d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.153827 Jul 28 20:20:15.053745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 954/2055] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:14 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:15.298061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ab491e8c-6242-439a-b26d-12aff1f42efc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:15.299960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ab491e8c-6242-439a-b26d-12aff1f42efc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:15.305956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab491e8c-6242-439a-b26d-12aff1f42efc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:15.306425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab491e8c-6242-439a-b26d-12aff1f42efc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:15.307163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab491e8c-6242-439a-b26d-12aff1f42efc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:15.307588 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab491e8c-6242-439a-b26d-12aff1f42efc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:15.336430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ab491e8c-6242-439a-b26d-12aff1f42efc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042504 Jul 28 20:20:15.337005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1102/2056] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:15.461311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c4d266f7-fe49-4756-97df-fae84aeb4827 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:15.461873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c4d266f7-fe49-4756-97df-fae84aeb4827 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:15.468372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4d266f7-fe49-4756-97df-fae84aeb4827 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:15.468850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4d266f7-fe49-4756-97df-fae84aeb4827 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:15.469657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4d266f7-fe49-4756-97df-fae84aeb4827 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:15.470089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4d266f7-fe49-4756-97df-fae84aeb4827 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:15.529966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c4d266f7-fe49-4756-97df-fae84aeb4827 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:15.537740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c4d266f7-fe49-4756-97df-fae84aeb4827 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080391 Jul 28 20:20:15.538295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 955/2057] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:15 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:16.074992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-712472a1-4343-46f1-aa7c-22ea808339c3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:16.075585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-712472a1-4343-46f1-aa7c-22ea808339c3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:16.082261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-712472a1-4343-46f1-aa7c-22ea808339c3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:16.082705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-712472a1-4343-46f1-aa7c-22ea808339c3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:16.083447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-712472a1-4343-46f1-aa7c-22ea808339c3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:16.083874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-712472a1-4343-46f1-aa7c-22ea808339c3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:16.211176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-712472a1-4343-46f1-aa7c-22ea808339c3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:16.219011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-712472a1-4343-46f1-aa7c-22ea808339c3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147852 Jul 28 20:20:16.219881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1103/2058] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:16 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:16.348503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5e1fc9f8-3055-496d-bc30-a9c0e7b5d607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:16.350611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5e1fc9f8-3055-496d-bc30-a9c0e7b5d607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:16.356695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e1fc9f8-3055-496d-bc30-a9c0e7b5d607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:16.357148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e1fc9f8-3055-496d-bc30-a9c0e7b5d607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:16.357906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e1fc9f8-3055-496d-bc30-a9c0e7b5d607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:16.358339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e1fc9f8-3055-496d-bc30-a9c0e7b5d607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:16.386843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5e1fc9f8-3055-496d-bc30-a9c0e7b5d607 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042509 Jul 28 20:20:16.387382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 956/2059] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:16.557409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-26894fcf-e720-4a83-8b69-4906e226bfba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:16.558016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-26894fcf-e720-4a83-8b69-4906e226bfba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:16.564106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26894fcf-e720-4a83-8b69-4906e226bfba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:16.564632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26894fcf-e720-4a83-8b69-4906e226bfba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:16.565427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26894fcf-e720-4a83-8b69-4906e226bfba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:16.565884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-26894fcf-e720-4a83-8b69-4906e226bfba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:16.629404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-26894fcf-e720-4a83-8b69-4906e226bfba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:16.636810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-26894fcf-e720-4a83-8b69-4906e226bfba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083294 Jul 28 20:20:16.637343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1104/2060] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:16 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:17.247760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-de8a6f9d-a8c2-4422-8c34-9fbe5014652f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:17.248513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-de8a6f9d-a8c2-4422-8c34-9fbe5014652f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:17.255668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de8a6f9d-a8c2-4422-8c34-9fbe5014652f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:17.256113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de8a6f9d-a8c2-4422-8c34-9fbe5014652f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:17.256898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de8a6f9d-a8c2-4422-8c34-9fbe5014652f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:17.257334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de8a6f9d-a8c2-4422-8c34-9fbe5014652f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:17.382896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-de8a6f9d-a8c2-4422-8c34-9fbe5014652f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:17.390705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-de8a6f9d-a8c2-4422-8c34-9fbe5014652f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146769 Jul 28 20:20:17.391255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 957/2061] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:17 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:17.399151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b2893e12-1f62-42f8-9ab9-6574e4573752 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:17.401502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b2893e12-1f62-42f8-9ab9-6574e4573752 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:17.408388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2893e12-1f62-42f8-9ab9-6574e4573752 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:17.408881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2893e12-1f62-42f8-9ab9-6574e4573752 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:17.409625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2893e12-1f62-42f8-9ab9-6574e4573752 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:17.410051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2893e12-1f62-42f8-9ab9-6574e4573752 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:17.441639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b2893e12-1f62-42f8-9ab9-6574e4573752 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046270 Jul 28 20:20:17.442111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1105/2062] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:17.658173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3e1f5daa-c9c2-48e9-b428-249595487a80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:17.658865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3e1f5daa-c9c2-48e9-b428-249595487a80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:17.664866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e1f5daa-c9c2-48e9-b428-249595487a80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:17.665312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e1f5daa-c9c2-48e9-b428-249595487a80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:17.666067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e1f5daa-c9c2-48e9-b428-249595487a80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:17.666498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e1f5daa-c9c2-48e9-b428-249595487a80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:17.727697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3e1f5daa-c9c2-48e9-b428-249595487a80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:17.735811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3e1f5daa-c9c2-48e9-b428-249595487a80 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081735 Jul 28 20:20:17.736363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 958/2063] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:17 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:18.412994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-196168e5-9341-485c-b931-1a3693ad342c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:18.413598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-196168e5-9341-485c-b931-1a3693ad342c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:18.420112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-196168e5-9341-485c-b931-1a3693ad342c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:18.420494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-196168e5-9341-485c-b931-1a3693ad342c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:18.421262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-196168e5-9341-485c-b931-1a3693ad342c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:18.421692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-196168e5-9341-485c-b931-1a3693ad342c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:18.453420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1ed1df14-cdb4-4ca9-a4d1-1e93864f3ba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:18.455673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1ed1df14-cdb4-4ca9-a4d1-1e93864f3ba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:18.462284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ed1df14-cdb4-4ca9-a4d1-1e93864f3ba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:18.462736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ed1df14-cdb4-4ca9-a4d1-1e93864f3ba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:18.463503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ed1df14-cdb4-4ca9-a4d1-1e93864f3ba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:18.463942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ed1df14-cdb4-4ca9-a4d1-1e93864f3ba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:18.495418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1ed1df14-cdb4-4ca9-a4d1-1e93864f3ba9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045959 Jul 28 20:20:18.495985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 959/2064] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:20:18.565633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-196168e5-9341-485c-b931-1a3693ad342c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:18.573383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-196168e5-9341-485c-b931-1a3693ad342c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.164578 Jul 28 20:20:18.573939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1106/2065] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:18 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:18.588721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:20:18.588896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:20:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:20:18.755873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-494eb0a6-cb0e-4ed2-a0d8-4ce37b88e6ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:18.756437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-494eb0a6-cb0e-4ed2-a0d8-4ce37b88e6ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:18.762907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-494eb0a6-cb0e-4ed2-a0d8-4ce37b88e6ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:18.763354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-494eb0a6-cb0e-4ed2-a0d8-4ce37b88e6ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:18.764129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-494eb0a6-cb0e-4ed2-a0d8-4ce37b88e6ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:18.764593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-494eb0a6-cb0e-4ed2-a0d8-4ce37b88e6ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:18.827870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-494eb0a6-cb0e-4ed2-a0d8-4ce37b88e6ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:18.836042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-494eb0a6-cb0e-4ed2-a0d8-4ce37b88e6ed tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084123 Jul 28 20:20:18.836614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 960/2066] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:18 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:19.507806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-66003650-0c82-46ee-9898-2a99b6a844bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:19.509920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-66003650-0c82-46ee-9898-2a99b6a844bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:19.516361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66003650-0c82-46ee-9898-2a99b6a844bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:19.516912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66003650-0c82-46ee-9898-2a99b6a844bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:19.517655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66003650-0c82-46ee-9898-2a99b6a844bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:19.518076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66003650-0c82-46ee-9898-2a99b6a844bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:19.546381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-66003650-0c82-46ee-9898-2a99b6a844bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Jul 28 20:20:19.546908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1107/2067] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:19.594555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c1629004-c9c6-4aeb-ad60-741743dbfa9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:19.595310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c1629004-c9c6-4aeb-ad60-741743dbfa9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:19.597685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=86 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:19.602951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1629004-c9c6-4aeb-ad60-741743dbfa9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:19.603405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1629004-c9c6-4aeb-ad60-741743dbfa9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:19.604164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1629004-c9c6-4aeb-ad60-741743dbfa9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:19.604619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c1629004-c9c6-4aeb-ad60-741743dbfa9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:19.732201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c1629004-c9c6-4aeb-ad60-741743dbfa9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:19.740608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c1629004-c9c6-4aeb-ad60-741743dbfa9c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149932 Jul 28 20:20:19.741162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 961/2068] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:19 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:19.857122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8130a533-1350-487d-9a13-9077d1db6911 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:19.857851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8130a533-1350-487d-9a13-9077d1db6911 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:19.864792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8130a533-1350-487d-9a13-9077d1db6911 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:19.865247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8130a533-1350-487d-9a13-9077d1db6911 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:19.865999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8130a533-1350-487d-9a13-9077d1db6911 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:19.866428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8130a533-1350-487d-9a13-9077d1db6911 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:19.870344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:19.929614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8130a533-1350-487d-9a13-9077d1db6911 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:19.937123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8130a533-1350-487d-9a13-9077d1db6911 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083819 Jul 28 20:20:19.937682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1108/2069] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:19 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:20.559715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d0232414-b832-4d05-8921-125d4042e994 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:20.561845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d0232414-b832-4d05-8921-125d4042e994 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:20.568433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0232414-b832-4d05-8921-125d4042e994 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:20.568917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0232414-b832-4d05-8921-125d4042e994 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:20.569718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0232414-b832-4d05-8921-125d4042e994 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:20.570153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0232414-b832-4d05-8921-125d4042e994 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:20.599831 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d0232414-b832-4d05-8921-125d4042e994 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Jul 28 20:20:20.600729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 962/2070] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:20.762407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0e85aaa1-3f5a-41fb-9a34-2bd7278428a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:20.763053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0e85aaa1-3f5a-41fb-9a34-2bd7278428a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:20.765374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=80 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:20.771281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e85aaa1-3f5a-41fb-9a34-2bd7278428a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:20.771734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e85aaa1-3f5a-41fb-9a34-2bd7278428a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:20.772480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e85aaa1-3f5a-41fb-9a34-2bd7278428a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:20.772940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e85aaa1-3f5a-41fb-9a34-2bd7278428a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:20.898513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0e85aaa1-3f5a-41fb-9a34-2bd7278428a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:20.907259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0e85aaa1-3f5a-41fb-9a34-2bd7278428a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148325 Jul 28 20:20:20.907796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1109/2071] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:20 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:20.959288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0a4c3c8a-ca73-41c5-ab05-aa7fac320ec3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:20.959895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0a4c3c8a-ca73-41c5-ab05-aa7fac320ec3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:20.965800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a4c3c8a-ca73-41c5-ab05-aa7fac320ec3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:20.966240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a4c3c8a-ca73-41c5-ab05-aa7fac320ec3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:20.966988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a4c3c8a-ca73-41c5-ab05-aa7fac320ec3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:20.967449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a4c3c8a-ca73-41c5-ab05-aa7fac320ec3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:20.986791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:21.028872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0a4c3c8a-ca73-41c5-ab05-aa7fac320ec3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:21.037242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0a4c3c8a-ca73-41c5-ab05-aa7fac320ec3 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081938 Jul 28 20:20:21.037786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 963/2072] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:20 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:21.612139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fc865765-232a-4ae5-8fa5-df5d7a9a8945 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:21.614372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fc865765-232a-4ae5-8fa5-df5d7a9a8945 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:21.620433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc865765-232a-4ae5-8fa5-df5d7a9a8945 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:21.620916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc865765-232a-4ae5-8fa5-df5d7a9a8945 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:21.621668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc865765-232a-4ae5-8fa5-df5d7a9a8945 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:21.622102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc865765-232a-4ae5-8fa5-df5d7a9a8945 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:21.651286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fc865765-232a-4ae5-8fa5-df5d7a9a8945 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043162 Jul 28 20:20:21.651831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1110/2073] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:21.928925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dab2b238-3864-4273-8f85-6f4a7ccf8176 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:21.929477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dab2b238-3864-4273-8f85-6f4a7ccf8176 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:21.935915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dab2b238-3864-4273-8f85-6f4a7ccf8176 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:21.936366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dab2b238-3864-4273-8f85-6f4a7ccf8176 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:21.937163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dab2b238-3864-4273-8f85-6f4a7ccf8176 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:21.937600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dab2b238-3864-4273-8f85-6f4a7ccf8176 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:22.057512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e3425eee-3ab4-4062-b000-63c6fc25f66f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:22.058274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e3425eee-3ab4-4062-b000-63c6fc25f66f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:22.065571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3425eee-3ab4-4062-b000-63c6fc25f66f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:22.066012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3425eee-3ab4-4062-b000-63c6fc25f66f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:22.067026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3425eee-3ab4-4062-b000-63c6fc25f66f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:22.067318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3425eee-3ab4-4062-b000-63c6fc25f66f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:22.068955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dab2b238-3864-4273-8f85-6f4a7ccf8176 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:22.077027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dab2b238-3864-4273-8f85-6f4a7ccf8176 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152121 Jul 28 20:20:22.077601 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 964/2074] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:21 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:22.131808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e3425eee-3ab4-4062-b000-63c6fc25f66f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:22.139227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e3425eee-3ab4-4062-b000-63c6fc25f66f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085628 Jul 28 20:20:22.139775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1111/2075] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:22 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:22.664056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4676a05f-bef6-4cfe-a1ce-cc65f5f58049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:22.666236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4676a05f-bef6-4cfe-a1ce-cc65f5f58049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:22.672252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4676a05f-bef6-4cfe-a1ce-cc65f5f58049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:22.672831 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4676a05f-bef6-4cfe-a1ce-cc65f5f58049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:22.673771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4676a05f-bef6-4cfe-a1ce-cc65f5f58049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:22.674206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4676a05f-bef6-4cfe-a1ce-cc65f5f58049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:22.702238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4676a05f-bef6-4cfe-a1ce-cc65f5f58049 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042324 Jul 28 20:20:22.702773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 965/2076] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:22 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:23.099143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc1b9e23-5d61-4ca5-9d80-1be49891f87f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:23.099772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc1b9e23-5d61-4ca5-9d80-1be49891f87f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:23.106182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc1b9e23-5d61-4ca5-9d80-1be49891f87f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:23.106621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc1b9e23-5d61-4ca5-9d80-1be49891f87f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:23.107361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc1b9e23-5d61-4ca5-9d80-1be49891f87f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:23.107782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc1b9e23-5d61-4ca5-9d80-1be49891f87f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:23.161463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dcee464b-9f6b-4919-afb5-10f164599d69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:23.162126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dcee464b-9f6b-4919-afb5-10f164599d69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:23.168416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcee464b-9f6b-4919-afb5-10f164599d69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:23.168893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcee464b-9f6b-4919-afb5-10f164599d69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:23.169658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcee464b-9f6b-4919-afb5-10f164599d69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:23.170239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcee464b-9f6b-4919-afb5-10f164599d69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:23.242764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dcee464b-9f6b-4919-afb5-10f164599d69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:23.251165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dcee464b-9f6b-4919-afb5-10f164599d69 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.094198 Jul 28 20:20:23.251750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 966/2077] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:23 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:23.258270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cc1b9e23-5d61-4ca5-9d80-1be49891f87f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:23.266676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc1b9e23-5d61-4ca5-9d80-1be49891f87f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.170836 Jul 28 20:20:23.267379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1112/2078] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:23 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:23.715124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-53eb392e-b33b-46fb-a301-1aede0444266 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:23.717336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-53eb392e-b33b-46fb-a301-1aede0444266 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:23.723494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53eb392e-b33b-46fb-a301-1aede0444266 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:23.723941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53eb392e-b33b-46fb-a301-1aede0444266 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:23.724731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53eb392e-b33b-46fb-a301-1aede0444266 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:23.725168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53eb392e-b33b-46fb-a301-1aede0444266 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:23.753841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-53eb392e-b33b-46fb-a301-1aede0444266 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042733 Jul 28 20:20:23.754381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 967/2079] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:24.273531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f64306f8-ed48-4754-aff0-0ae6380c0040 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:24.274147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f64306f8-ed48-4754-aff0-0ae6380c0040 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:24.280909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f64306f8-ed48-4754-aff0-0ae6380c0040 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:24.281435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f64306f8-ed48-4754-aff0-0ae6380c0040 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:24.282698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f64306f8-ed48-4754-aff0-0ae6380c0040 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:24.283143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f64306f8-ed48-4754-aff0-0ae6380c0040 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:24.287988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3c8439be-9330-4770-b8e2-83b92bbba427 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:24.288631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3c8439be-9330-4770-b8e2-83b92bbba427 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:24.295311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8439be-9330-4770-b8e2-83b92bbba427 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:24.295764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8439be-9330-4770-b8e2-83b92bbba427 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:24.296525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8439be-9330-4770-b8e2-83b92bbba427 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:24.297743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c8439be-9330-4770-b8e2-83b92bbba427 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:24.357813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f64306f8-ed48-4754-aff0-0ae6380c0040 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:24.366186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f64306f8-ed48-4754-aff0-0ae6380c0040 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.098583 Jul 28 20:20:24.366751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1113/2080] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:24 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:24.445952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3c8439be-9330-4770-b8e2-83b92bbba427 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:24.454279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3c8439be-9330-4770-b8e2-83b92bbba427 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.170163 Jul 28 20:20:24.454832 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 968/2081] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:24.767477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-64266f03-2ba0-4f2b-b8c8-575751a5e20f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:24.769582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-64266f03-2ba0-4f2b-b8c8-575751a5e20f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:24.775703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-64266f03-2ba0-4f2b-b8c8-575751a5e20f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:24.776148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-64266f03-2ba0-4f2b-b8c8-575751a5e20f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:24.776935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-64266f03-2ba0-4f2b-b8c8-575751a5e20f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:24.777415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-64266f03-2ba0-4f2b-b8c8-575751a5e20f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:24.809369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-64266f03-2ba0-4f2b-b8c8-575751a5e20f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046830 Jul 28 20:20:24.809971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1114/2082] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:25.387724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5da453dc-74db-4ee3-928c-859032d074e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:25.388344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5da453dc-74db-4ee3-928c-859032d074e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:25.395537 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5da453dc-74db-4ee3-928c-859032d074e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:25.395995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5da453dc-74db-4ee3-928c-859032d074e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:25.396805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5da453dc-74db-4ee3-928c-859032d074e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:25.397246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5da453dc-74db-4ee3-928c-859032d074e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:25.458853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5da453dc-74db-4ee3-928c-859032d074e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:25.466630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5da453dc-74db-4ee3-928c-859032d074e2 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082807 Jul 28 20:20:25.467206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 969/2083] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:25 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:25.475522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6d2b6cba-e318-465c-ab26-81f534e54093 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:25.476264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6d2b6cba-e318-465c-ab26-81f534e54093 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:25.482757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d2b6cba-e318-465c-ab26-81f534e54093 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:25.483195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d2b6cba-e318-465c-ab26-81f534e54093 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:25.483974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d2b6cba-e318-465c-ab26-81f534e54093 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:25.484397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d2b6cba-e318-465c-ab26-81f534e54093 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:25.620990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6d2b6cba-e318-465c-ab26-81f534e54093 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:25.629520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6d2b6cba-e318-465c-ab26-81f534e54093 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157834 Jul 28 20:20:25.630076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1115/2084] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:25.822094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-edaa593d-7c4d-41ca-aa15-a5574b259144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:25.824263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-edaa593d-7c4d-41ca-aa15-a5574b259144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:25.830430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edaa593d-7c4d-41ca-aa15-a5574b259144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:25.830879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edaa593d-7c4d-41ca-aa15-a5574b259144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:25.831636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edaa593d-7c4d-41ca-aa15-a5574b259144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:25.832071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edaa593d-7c4d-41ca-aa15-a5574b259144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:25.861090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-edaa593d-7c4d-41ca-aa15-a5574b259144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043045 Jul 28 20:20:25.861634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 970/2085] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:26.487906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5d889201-ff02-4b67-ab2b-49468dc17043 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:26.488463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5d889201-ff02-4b67-ab2b-49468dc17043 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:26.495107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5d889201-ff02-4b67-ab2b-49468dc17043 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:26.495611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5d889201-ff02-4b67-ab2b-49468dc17043 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:26.496364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5d889201-ff02-4b67-ab2b-49468dc17043 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:26.496818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5d889201-ff02-4b67-ab2b-49468dc17043 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:26.558487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5d889201-ff02-4b67-ab2b-49468dc17043 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:26.567134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5d889201-ff02-4b67-ab2b-49468dc17043 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083790 Jul 28 20:20:26.567685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1116/2086] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:26 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:26.650996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8b94b0c9-5f1b-4b51-a87c-06f7b909c86f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:26.651611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8b94b0c9-5f1b-4b51-a87c-06f7b909c86f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:26.660285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b94b0c9-5f1b-4b51-a87c-06f7b909c86f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:26.660766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b94b0c9-5f1b-4b51-a87c-06f7b909c86f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:26.661531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b94b0c9-5f1b-4b51-a87c-06f7b909c86f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:26.661964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b94b0c9-5f1b-4b51-a87c-06f7b909c86f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:26.798763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8b94b0c9-5f1b-4b51-a87c-06f7b909c86f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:26.806801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8b94b0c9-5f1b-4b51-a87c-06f7b909c86f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.159634 Jul 28 20:20:26.807358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 971/2087] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:26.873821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-20b7e9b6-ca7c-4ce7-8453-9e23f8e98e8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:26.876082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-20b7e9b6-ca7c-4ce7-8453-9e23f8e98e8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:26.882414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20b7e9b6-ca7c-4ce7-8453-9e23f8e98e8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:26.882857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20b7e9b6-ca7c-4ce7-8453-9e23f8e98e8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:26.883599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20b7e9b6-ca7c-4ce7-8453-9e23f8e98e8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:26.884025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20b7e9b6-ca7c-4ce7-8453-9e23f8e98e8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:26.912767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-20b7e9b6-ca7c-4ce7-8453-9e23f8e98e8c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042904 Jul 28 20:20:26.913299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1117/2088] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:27.588455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-00798546-c2c9-453c-9e3d-4793fc36013b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:27.589090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-00798546-c2c9-453c-9e3d-4793fc36013b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:27.595759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00798546-c2c9-453c-9e3d-4793fc36013b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:27.596202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00798546-c2c9-453c-9e3d-4793fc36013b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:27.596983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00798546-c2c9-453c-9e3d-4793fc36013b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:27.597414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00798546-c2c9-453c-9e3d-4793fc36013b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:27.660435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-00798546-c2c9-453c-9e3d-4793fc36013b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:27.668005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-00798546-c2c9-453c-9e3d-4793fc36013b tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.083430 Jul 28 20:20:27.668559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 972/2089] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:27 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:27.828189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f3ea2bcf-88a6-4c84-8dc7-4e7e571669d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:27.828837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f3ea2bcf-88a6-4c84-8dc7-4e7e571669d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:27.835711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3ea2bcf-88a6-4c84-8dc7-4e7e571669d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:27.836157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3ea2bcf-88a6-4c84-8dc7-4e7e571669d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:27.836943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3ea2bcf-88a6-4c84-8dc7-4e7e571669d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:27.837371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3ea2bcf-88a6-4c84-8dc7-4e7e571669d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:27.924725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-78b13dba-9ae2-4f9e-9f31-c5a48e2b8ade tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:27.926916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-78b13dba-9ae2-4f9e-9f31-c5a48e2b8ade tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:27.932965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78b13dba-9ae2-4f9e-9f31-c5a48e2b8ade tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:27.933423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78b13dba-9ae2-4f9e-9f31-c5a48e2b8ade tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:27.934195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78b13dba-9ae2-4f9e-9f31-c5a48e2b8ade tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:27.934633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78b13dba-9ae2-4f9e-9f31-c5a48e2b8ade tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:27.951688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:20:27.951878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 (ip 10.222.0.67) !!! Jul 28 20:20:27.965516 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-78b13dba-9ae2-4f9e-9f31-c5a48e2b8ade tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Jul 28 20:20:27.966307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 973/2090] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:20:27.974423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f3ea2bcf-88a6-4c84-8dc7-4e7e571669d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:27.982331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f3ea2bcf-88a6-4c84-8dc7-4e7e571669d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.158030 Jul 28 20:20:27.982885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1118/2091] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:27 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:28.690059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3af3222c-ed86-4d05-9954-9997a93095d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:28.690676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3af3222c-ed86-4d05-9954-9997a93095d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:28.697246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3af3222c-ed86-4d05-9954-9997a93095d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:28.697695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3af3222c-ed86-4d05-9954-9997a93095d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:28.698450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3af3222c-ed86-4d05-9954-9997a93095d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:28.698882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3af3222c-ed86-4d05-9954-9997a93095d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:28.759267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3af3222c-ed86-4d05-9954-9997a93095d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:28.767057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3af3222c-ed86-4d05-9954-9997a93095d5 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081407 Jul 28 20:20:28.767639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 974/2092] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:28 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:28.978363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-77458a87-2574-4447-8939-8d60faae8595 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:28.980458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-77458a87-2574-4447-8939-8d60faae8595 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:28.988224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77458a87-2574-4447-8939-8d60faae8595 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:28.988800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77458a87-2574-4447-8939-8d60faae8595 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:28.989559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77458a87-2574-4447-8939-8d60faae8595 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:28.989990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77458a87-2574-4447-8939-8d60faae8595 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:29.003707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-222918ca-6fc1-4acb-9778-531b2e53eecc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:29.004310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-222918ca-6fc1-4acb-9778-531b2e53eecc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:29.010177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-222918ca-6fc1-4acb-9778-531b2e53eecc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:29.010620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-222918ca-6fc1-4acb-9778-531b2e53eecc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:29.011376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-222918ca-6fc1-4acb-9778-531b2e53eecc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:29.011804 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-222918ca-6fc1-4acb-9778-531b2e53eecc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:29.021075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-77458a87-2574-4447-8939-8d60faae8595 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046726 Jul 28 20:20:29.021647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1119/2093] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:29.144947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-222918ca-6fc1-4acb-9778-531b2e53eecc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:29.152814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-222918ca-6fc1-4acb-9778-531b2e53eecc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.153375 Jul 28 20:20:29.153361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 975/2094] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:28 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:29.787553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4898ae9a-3145-4140-9255-0f7bdad46546 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:29.788193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4898ae9a-3145-4140-9255-0f7bdad46546 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:29.794340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4898ae9a-3145-4140-9255-0f7bdad46546 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:29.794781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4898ae9a-3145-4140-9255-0f7bdad46546 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:29.795531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4898ae9a-3145-4140-9255-0f7bdad46546 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:29.795958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4898ae9a-3145-4140-9255-0f7bdad46546 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:29.861488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4898ae9a-3145-4140-9255-0f7bdad46546 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:29.868992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4898ae9a-3145-4140-9255-0f7bdad46546 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085293 Jul 28 20:20:29.869544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1120/2095] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:29 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:30.033705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cde7d919-2ffd-49c5-a095-70dc16084ab1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:30.035905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cde7d919-2ffd-49c5-a095-70dc16084ab1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:30.042363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cde7d919-2ffd-49c5-a095-70dc16084ab1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:30.042744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cde7d919-2ffd-49c5-a095-70dc16084ab1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:30.043493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cde7d919-2ffd-49c5-a095-70dc16084ab1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:30.043951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cde7d919-2ffd-49c5-a095-70dc16084ab1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:30.072933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cde7d919-2ffd-49c5-a095-70dc16084ab1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Jul 28 20:20:30.073469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 976/2096] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:30.175118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-08e823e7-06db-430b-a1c3-4f996f4e152e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:30.175777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-08e823e7-06db-430b-a1c3-4f996f4e152e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:30.182200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08e823e7-06db-430b-a1c3-4f996f4e152e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:30.182643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08e823e7-06db-430b-a1c3-4f996f4e152e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:30.183384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08e823e7-06db-430b-a1c3-4f996f4e152e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:30.183809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08e823e7-06db-430b-a1c3-4f996f4e152e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:30.228477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:20:30.228743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:20:30.313873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-08e823e7-06db-430b-a1c3-4f996f4e152e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:30.321762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-08e823e7-06db-430b-a1c3-4f996f4e152e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151255 Jul 28 20:20:30.322310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1121/2097] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:30 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:30.890255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-061cb9a2-4f91-4f67-823e-6c03203d1b3d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:30.890868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-061cb9a2-4f91-4f67-823e-6c03203d1b3d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:30.897903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-061cb9a2-4f91-4f67-823e-6c03203d1b3d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:30.898349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-061cb9a2-4f91-4f67-823e-6c03203d1b3d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:30.899109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-061cb9a2-4f91-4f67-823e-6c03203d1b3d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:30.899549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-061cb9a2-4f91-4f67-823e-6c03203d1b3d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:30.962892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-061cb9a2-4f91-4f67-823e-6c03203d1b3d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:30.970627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-061cb9a2-4f91-4f67-823e-6c03203d1b3d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084280 Jul 28 20:20:30.971191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 977/2098] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:30 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:31.084892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cde82c8a-2b01-4a8f-b86b-2025c788845c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:31.087012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cde82c8a-2b01-4a8f-b86b-2025c788845c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:31.093007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cde82c8a-2b01-4a8f-b86b-2025c788845c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:31.093453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cde82c8a-2b01-4a8f-b86b-2025c788845c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:31.094197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cde82c8a-2b01-4a8f-b86b-2025c788845c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:31.095210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cde82c8a-2b01-4a8f-b86b-2025c788845c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:31.124155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cde82c8a-2b01-4a8f-b86b-2025c788845c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Jul 28 20:20:31.124718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1122/2099] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:31.343250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ff9df6f1-d4e5-4fad-8ce6-d3dc71485a0e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:31.343889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ff9df6f1-d4e5-4fad-8ce6-d3dc71485a0e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:31.350706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff9df6f1-d4e5-4fad-8ce6-d3dc71485a0e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:31.351145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff9df6f1-d4e5-4fad-8ce6-d3dc71485a0e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:31.351901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff9df6f1-d4e5-4fad-8ce6-d3dc71485a0e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:31.352335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ff9df6f1-d4e5-4fad-8ce6-d3dc71485a0e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:31.481523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ff9df6f1-d4e5-4fad-8ce6-d3dc71485a0e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:31.490009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ff9df6f1-d4e5-4fad-8ce6-d3dc71485a0e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150632 Jul 28 20:20:31.490560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 978/2100] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:31.991467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-78472e12-1bf2-40b0-8971-b46b6aaa7abf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:31.992078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-78472e12-1bf2-40b0-8971-b46b6aaa7abf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:31.998574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78472e12-1bf2-40b0-8971-b46b6aaa7abf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:31.999012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78472e12-1bf2-40b0-8971-b46b6aaa7abf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:31.999752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78472e12-1bf2-40b0-8971-b46b6aaa7abf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:32.000178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78472e12-1bf2-40b0-8971-b46b6aaa7abf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:32.060279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-78472e12-1bf2-40b0-8971-b46b6aaa7abf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:32.068188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-78472e12-1bf2-40b0-8971-b46b6aaa7abf tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080538 Jul 28 20:20:32.068761 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1123/2101] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:31 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:32.136104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ce34ab62-d901-433d-905a-a14a79ccc613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:32.138284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ce34ab62-d901-433d-905a-a14a79ccc613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:32.145932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce34ab62-d901-433d-905a-a14a79ccc613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:32.146380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce34ab62-d901-433d-905a-a14a79ccc613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:32.147140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce34ab62-d901-433d-905a-a14a79ccc613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:32.147582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce34ab62-d901-433d-905a-a14a79ccc613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:32.177314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ce34ab62-d901-433d-905a-a14a79ccc613 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045059 Jul 28 20:20:32.177860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 979/2102] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:32.512424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-422a20e6-f266-433d-812a-577bd3dc17d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:32.513009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-422a20e6-f266-433d-812a-577bd3dc17d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:32.519105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-422a20e6-f266-433d-812a-577bd3dc17d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:32.519562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-422a20e6-f266-433d-812a-577bd3dc17d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:32.520317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-422a20e6-f266-433d-812a-577bd3dc17d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:32.520790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-422a20e6-f266-433d-812a-577bd3dc17d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:32.647291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-422a20e6-f266-433d-812a-577bd3dc17d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:32.650788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:32.656499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-422a20e6-f266-433d-812a-577bd3dc17d7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148250 Jul 28 20:20:32.657083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1124/2103] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:33.089108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-df408360-466a-48c5-8d09-2c5ed66a2b3f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:33.089779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-df408360-466a-48c5-8d09-2c5ed66a2b3f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:33.096610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df408360-466a-48c5-8d09-2c5ed66a2b3f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:33.097059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df408360-466a-48c5-8d09-2c5ed66a2b3f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:33.097814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df408360-466a-48c5-8d09-2c5ed66a2b3f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:33.098250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df408360-466a-48c5-8d09-2c5ed66a2b3f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:33.102230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:33.159252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-df408360-466a-48c5-8d09-2c5ed66a2b3f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:33.167858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-df408360-466a-48c5-8d09-2c5ed66a2b3f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.082663 Jul 28 20:20:33.168420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 980/2104] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:33 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:33.189801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-70a9957b-bf4f-405f-91cf-a0bd764f199f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:33.192100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-70a9957b-bf4f-405f-91cf-a0bd764f199f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:33.198106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70a9957b-bf4f-405f-91cf-a0bd764f199f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:33.198552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70a9957b-bf4f-405f-91cf-a0bd764f199f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:33.199333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70a9957b-bf4f-405f-91cf-a0bd764f199f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:33.199768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-70a9957b-bf4f-405f-91cf-a0bd764f199f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:33.230410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-70a9957b-bf4f-405f-91cf-a0bd764f199f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Jul 28 20:20:33.230948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1125/2105] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:33.678447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f22d8a6a-c104-4cbb-b832-acd4927dc8a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:33.679062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f22d8a6a-c104-4cbb-b832-acd4927dc8a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:33.685156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f22d8a6a-c104-4cbb-b832-acd4927dc8a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:33.685606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f22d8a6a-c104-4cbb-b832-acd4927dc8a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:33.686363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f22d8a6a-c104-4cbb-b832-acd4927dc8a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:33.686795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f22d8a6a-c104-4cbb-b832-acd4927dc8a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:33.815409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f22d8a6a-c104-4cbb-b832-acd4927dc8a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:33.823281 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f22d8a6a-c104-4cbb-b832-acd4927dc8a0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149453 Jul 28 20:20:33.823830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 981/2106] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:34.188330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-43ec1df4-293e-4b01-a325-8a442259574e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:34.188986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-43ec1df4-293e-4b01-a325-8a442259574e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:34.195609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43ec1df4-293e-4b01-a325-8a442259574e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:34.196180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43ec1df4-293e-4b01-a325-8a442259574e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:34.196797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43ec1df4-293e-4b01-a325-8a442259574e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:34.197231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43ec1df4-293e-4b01-a325-8a442259574e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:34.246181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-774eaa38-e91d-43cb-8853-253ef89a7f86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:34.249887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-774eaa38-e91d-43cb-8853-253ef89a7f86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:34.256086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-774eaa38-e91d-43cb-8853-253ef89a7f86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:34.256530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-774eaa38-e91d-43cb-8853-253ef89a7f86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:34.257488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-774eaa38-e91d-43cb-8853-253ef89a7f86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:34.257915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-774eaa38-e91d-43cb-8853-253ef89a7f86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:34.277989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-43ec1df4-293e-4b01-a325-8a442259574e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:34.286287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-43ec1df4-293e-4b01-a325-8a442259574e tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.101775 Jul 28 20:20:34.286866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1126/2107] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:34 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:34.288977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-774eaa38-e91d-43cb-8853-253ef89a7f86 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048289 Jul 28 20:20:34.289520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 982/2108] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:20:34.843710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2e86baf8-75bb-4e43-9cc2-5841fb621bed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:34.844319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2e86baf8-75bb-4e43-9cc2-5841fb621bed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:34.850900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e86baf8-75bb-4e43-9cc2-5841fb621bed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:34.851347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e86baf8-75bb-4e43-9cc2-5841fb621bed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:34.852104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e86baf8-75bb-4e43-9cc2-5841fb621bed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:34.852555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2e86baf8-75bb-4e43-9cc2-5841fb621bed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:34.977790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2e86baf8-75bb-4e43-9cc2-5841fb621bed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:34.985673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2e86baf8-75bb-4e43-9cc2-5841fb621bed tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.145822 Jul 28 20:20:34.987194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1127/2109] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:34 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:35.301313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0f099156-c60c-4fd8-a93c-eea5ed0409cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:35.303572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0f099156-c60c-4fd8-a93c-eea5ed0409cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:35.308602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3fb13257-ae12-4fd5-8687-c49b5585d545 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:35.309211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3fb13257-ae12-4fd5-8687-c49b5585d545 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:35.310116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f099156-c60c-4fd8-a93c-eea5ed0409cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:35.310564 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f099156-c60c-4fd8-a93c-eea5ed0409cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:35.311329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f099156-c60c-4fd8-a93c-eea5ed0409cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:35.311800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f099156-c60c-4fd8-a93c-eea5ed0409cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:35.315802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fb13257-ae12-4fd5-8687-c49b5585d545 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:35.316244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fb13257-ae12-4fd5-8687-c49b5585d545 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:35.317030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fb13257-ae12-4fd5-8687-c49b5585d545 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:35.317454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3fb13257-ae12-4fd5-8687-c49b5585d545 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:35.341051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0f099156-c60c-4fd8-a93c-eea5ed0409cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043796 Jul 28 20:20:35.341605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 983/2110] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:35.378108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3fb13257-ae12-4fd5-8687-c49b5585d545 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:35.385426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3fb13257-ae12-4fd5-8687-c49b5585d545 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080610 Jul 28 20:20:35.385978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1128/2111] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:35 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:36.008417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cfd10104-e394-4504-8037-916a2b93e806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:36.009064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cfd10104-e394-4504-8037-916a2b93e806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:36.015031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfd10104-e394-4504-8037-916a2b93e806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:36.015471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfd10104-e394-4504-8037-916a2b93e806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:36.016217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfd10104-e394-4504-8037-916a2b93e806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:36.016676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfd10104-e394-4504-8037-916a2b93e806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:36.143228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cfd10104-e394-4504-8037-916a2b93e806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:36.151101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cfd10104-e394-4504-8037-916a2b93e806 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146605 Jul 28 20:20:36.151650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 984/2112] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:36 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:36.353311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fbd45919-37b2-4c21-954f-0bdc24cd5a5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:36.355455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fbd45919-37b2-4c21-954f-0bdc24cd5a5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:36.362079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fbd45919-37b2-4c21-954f-0bdc24cd5a5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:36.362596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fbd45919-37b2-4c21-954f-0bdc24cd5a5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:36.363351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fbd45919-37b2-4c21-954f-0bdc24cd5a5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:36.363779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fbd45919-37b2-4c21-954f-0bdc24cd5a5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:36.393454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fbd45919-37b2-4c21-954f-0bdc24cd5a5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043411 Jul 28 20:20:36.394002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1129/2113] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:36.406688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0a13b7b4-4c14-46aa-a7d6-0bb0a8300032 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:36.407305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0a13b7b4-4c14-46aa-a7d6-0bb0a8300032 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:36.413914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a13b7b4-4c14-46aa-a7d6-0bb0a8300032 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:36.414366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a13b7b4-4c14-46aa-a7d6-0bb0a8300032 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:36.415144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a13b7b4-4c14-46aa-a7d6-0bb0a8300032 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:36.415580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a13b7b4-4c14-46aa-a7d6-0bb0a8300032 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:36.475463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0a13b7b4-4c14-46aa-a7d6-0bb0a8300032 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:36.482954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0a13b7b4-4c14-46aa-a7d6-0bb0a8300032 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080357 Jul 28 20:20:36.483506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 985/2114] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:36 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:37.173266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc13cac0-9c52-45f5-97c7-898858f8fb86 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:37.173905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc13cac0-9c52-45f5-97c7-898858f8fb86 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:37.179898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc13cac0-9c52-45f5-97c7-898858f8fb86 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:37.180332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc13cac0-9c52-45f5-97c7-898858f8fb86 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:37.181110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc13cac0-9c52-45f5-97c7-898858f8fb86 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:37.181534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc13cac0-9c52-45f5-97c7-898858f8fb86 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:37.316723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cc13cac0-9c52-45f5-97c7-898858f8fb86 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:37.324524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc13cac0-9c52-45f5-97c7-898858f8fb86 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.155038 Jul 28 20:20:37.325124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1130/2115] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:37 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:37.405957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-91cc5e5b-48af-4fdf-9581-f8d9b8bf1604 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:37.408088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-91cc5e5b-48af-4fdf-9581-f8d9b8bf1604 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:37.414557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91cc5e5b-48af-4fdf-9581-f8d9b8bf1604 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:37.415004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91cc5e5b-48af-4fdf-9581-f8d9b8bf1604 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:37.415763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91cc5e5b-48af-4fdf-9581-f8d9b8bf1604 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:37.416197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91cc5e5b-48af-4fdf-9581-f8d9b8bf1604 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:37.445618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-91cc5e5b-48af-4fdf-9581-f8d9b8bf1604 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Jul 28 20:20:37.446161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 986/2116] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:37.504282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-146d9e72-210f-444f-826c-d35a7a125dc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:37.504861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-146d9e72-210f-444f-826c-d35a7a125dc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:37.511281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-146d9e72-210f-444f-826c-d35a7a125dc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:37.511727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-146d9e72-210f-444f-826c-d35a7a125dc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:37.512480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-146d9e72-210f-444f-826c-d35a7a125dc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:37.512939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-146d9e72-210f-444f-826c-d35a7a125dc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:37.576504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-146d9e72-210f-444f-826c-d35a7a125dc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:37.584269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-146d9e72-210f-444f-826c-d35a7a125dc9 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084877 Jul 28 20:20:37.584860 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1131/2117] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:37 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:38.347411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-28826fa7-3022-4142-bf41-02a71de7c1fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:38.348028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-28826fa7-3022-4142-bf41-02a71de7c1fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:38.354069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28826fa7-3022-4142-bf41-02a71de7c1fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:38.354522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28826fa7-3022-4142-bf41-02a71de7c1fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:38.355284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28826fa7-3022-4142-bf41-02a71de7c1fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:38.355718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28826fa7-3022-4142-bf41-02a71de7c1fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:38.458234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-347d8808-f5a0-4f2d-b8c2-8b36f8da640e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:38.460402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-347d8808-f5a0-4f2d-b8c2-8b36f8da640e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:38.466573 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-347d8808-f5a0-4f2d-b8c2-8b36f8da640e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:38.467022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-347d8808-f5a0-4f2d-b8c2-8b36f8da640e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:38.467892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-347d8808-f5a0-4f2d-b8c2-8b36f8da640e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:38.468332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-347d8808-f5a0-4f2d-b8c2-8b36f8da640e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:38.482609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-28826fa7-3022-4142-bf41-02a71de7c1fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:38.490967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-28826fa7-3022-4142-bf41-02a71de7c1fd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148169 Jul 28 20:20:38.491539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 987/2118] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:38.498070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-347d8808-f5a0-4f2d-b8c2-8b36f8da640e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Jul 28 20:20:38.498622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1132/2119] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:20:38.604845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f2cc59bb-0324-4031-a379-811511fc4b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:38.605468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f2cc59bb-0324-4031-a379-811511fc4b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:38.611431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f2cc59bb-0324-4031-a379-811511fc4b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:38.611889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f2cc59bb-0324-4031-a379-811511fc4b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:38.612683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f2cc59bb-0324-4031-a379-811511fc4b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:38.613125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f2cc59bb-0324-4031-a379-811511fc4b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:38.673305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f2cc59bb-0324-4031-a379-811511fc4b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:38.680858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f2cc59bb-0324-4031-a379-811511fc4b64 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.079766 Jul 28 20:20:38.681459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 988/2120] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:38 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:39.511030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-738b2ee7-26d9-4797-8d28-fa5a5e1a8305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:39.512280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1e78de5b-0b8f-4df0-86df-5d8605d13ede tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:39.512922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1e78de5b-0b8f-4df0-86df-5d8605d13ede tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:39.513154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-738b2ee7-26d9-4797-8d28-fa5a5e1a8305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:39.520274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1e78de5b-0b8f-4df0-86df-5d8605d13ede tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:39.520486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-738b2ee7-26d9-4797-8d28-fa5a5e1a8305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:39.520754 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1e78de5b-0b8f-4df0-86df-5d8605d13ede tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:39.520913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-738b2ee7-26d9-4797-8d28-fa5a5e1a8305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:39.521522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1e78de5b-0b8f-4df0-86df-5d8605d13ede tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:39.521658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-738b2ee7-26d9-4797-8d28-fa5a5e1a8305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:39.521956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1e78de5b-0b8f-4df0-86df-5d8605d13ede tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:39.522088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-738b2ee7-26d9-4797-8d28-fa5a5e1a8305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:39.551524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-738b2ee7-26d9-4797-8d28-fa5a5e1a8305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Jul 28 20:20:39.552076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1133/2121] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:39.651506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1e78de5b-0b8f-4df0-86df-5d8605d13ede tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:39.659755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1e78de5b-0b8f-4df0-86df-5d8605d13ede tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151287 Jul 28 20:20:39.660305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 989/2122] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:39 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:39.701917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6ceadb1a-f66b-4818-aedf-0a4da943aeb6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:39.702531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6ceadb1a-f66b-4818-aedf-0a4da943aeb6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:39.708897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ceadb1a-f66b-4818-aedf-0a4da943aeb6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:39.709348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ceadb1a-f66b-4818-aedf-0a4da943aeb6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:39.710100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ceadb1a-f66b-4818-aedf-0a4da943aeb6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:39.710579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ceadb1a-f66b-4818-aedf-0a4da943aeb6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:39.771033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6ceadb1a-f66b-4818-aedf-0a4da943aeb6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:39.778447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6ceadb1a-f66b-4818-aedf-0a4da943aeb6 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080414 Jul 28 20:20:39.779004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1134/2123] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:39 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:40.563535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-00ef2abf-2e75-4833-abb0-9d0bdf37ce4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:40.565852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-00ef2abf-2e75-4833-abb0-9d0bdf37ce4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:40.572288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00ef2abf-2e75-4833-abb0-9d0bdf37ce4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:40.572780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00ef2abf-2e75-4833-abb0-9d0bdf37ce4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:40.573615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00ef2abf-2e75-4833-abb0-9d0bdf37ce4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:40.573990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00ef2abf-2e75-4833-abb0-9d0bdf37ce4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:40.604422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-00ef2abf-2e75-4833-abb0-9d0bdf37ce4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Jul 28 20:20:40.605184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 990/2124] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:40.680864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-010eda91-8036-464a-b703-cf9c714627a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:40.681501 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-010eda91-8036-464a-b703-cf9c714627a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:40.687947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-010eda91-8036-464a-b703-cf9c714627a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:40.688387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-010eda91-8036-464a-b703-cf9c714627a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:40.689172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-010eda91-8036-464a-b703-cf9c714627a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:40.689598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-010eda91-8036-464a-b703-cf9c714627a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:40.800146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8a116440-a611-4770-ab63-102555159d97 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:40.800806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8a116440-a611-4770-ab63-102555159d97 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:40.806809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8a116440-a611-4770-ab63-102555159d97 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:40.807263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8a116440-a611-4770-ab63-102555159d97 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:40.808038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8a116440-a611-4770-ab63-102555159d97 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:40.808482 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8a116440-a611-4770-ab63-102555159d97 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:40.818563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-010eda91-8036-464a-b703-cf9c714627a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:40.826495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-010eda91-8036-464a-b703-cf9c714627a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149627 Jul 28 20:20:40.827048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1135/2125] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:40.873342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8a116440-a611-4770-ab63-102555159d97 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:40.880937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8a116440-a611-4770-ab63-102555159d97 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085560 Jul 28 20:20:40.881496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 991/2126] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:40 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:41.616696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-38063822-e7d6-413c-b3e5-089ec24d42cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:41.618903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-38063822-e7d6-413c-b3e5-089ec24d42cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:41.624874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38063822-e7d6-413c-b3e5-089ec24d42cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:41.625311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38063822-e7d6-413c-b3e5-089ec24d42cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:41.626052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38063822-e7d6-413c-b3e5-089ec24d42cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:41.626477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38063822-e7d6-413c-b3e5-089ec24d42cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:41.656847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-38063822-e7d6-413c-b3e5-089ec24d42cc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Jul 28 20:20:41.657409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1136/2127] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:41.849753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4e29b93a-13b0-4876-9ff2-530765acd9bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:41.850393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4e29b93a-13b0-4876-9ff2-530765acd9bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:41.856970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4e29b93a-13b0-4876-9ff2-530765acd9bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:41.857422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4e29b93a-13b0-4876-9ff2-530765acd9bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:41.858178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4e29b93a-13b0-4876-9ff2-530765acd9bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:41.858613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4e29b93a-13b0-4876-9ff2-530765acd9bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:41.901691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f13151d2-2ff6-4512-836b-4db1ce24f2ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:41.902410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f13151d2-2ff6-4512-836b-4db1ce24f2ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:41.909790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f13151d2-2ff6-4512-836b-4db1ce24f2ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:41.910228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f13151d2-2ff6-4512-836b-4db1ce24f2ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:41.910970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f13151d2-2ff6-4512-836b-4db1ce24f2ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:41.911394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f13151d2-2ff6-4512-836b-4db1ce24f2ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:41.986752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f13151d2-2ff6-4512-836b-4db1ce24f2ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:41.994570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f13151d2-2ff6-4512-836b-4db1ce24f2ba tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.096719 Jul 28 20:20:41.995148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1137/2128] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:41 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:42.016380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4e29b93a-13b0-4876-9ff2-530765acd9bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:42.024966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4e29b93a-13b0-4876-9ff2-530765acd9bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.179729 Jul 28 20:20:42.025527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 992/2129] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:41 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:42.670505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c962a5ce-fc58-4694-8758-9116bf0aa692 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:42.672713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c962a5ce-fc58-4694-8758-9116bf0aa692 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:42.681734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c962a5ce-fc58-4694-8758-9116bf0aa692 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:42.682189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c962a5ce-fc58-4694-8758-9116bf0aa692 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:42.682956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c962a5ce-fc58-4694-8758-9116bf0aa692 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:42.684532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c962a5ce-fc58-4694-8758-9116bf0aa692 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:42.713718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c962a5ce-fc58-4694-8758-9116bf0aa692 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Jul 28 20:20:42.714279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1138/2130] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:43.015440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d4e82e47-04c6-4a8c-b1b9-c5de80cdc242 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:43.015998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d4e82e47-04c6-4a8c-b1b9-c5de80cdc242 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:43.022865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4e82e47-04c6-4a8c-b1b9-c5de80cdc242 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:43.023319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4e82e47-04c6-4a8c-b1b9-c5de80cdc242 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:43.024084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4e82e47-04c6-4a8c-b1b9-c5de80cdc242 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:43.024519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d4e82e47-04c6-4a8c-b1b9-c5de80cdc242 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:43.047102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6d6190b7-d7d1-42b2-82e4-6274e058f1a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:43.047749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6d6190b7-d7d1-42b2-82e4-6274e058f1a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:43.055026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d6190b7-d7d1-42b2-82e4-6274e058f1a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:43.055475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d6190b7-d7d1-42b2-82e4-6274e058f1a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:43.056242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d6190b7-d7d1-42b2-82e4-6274e058f1a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:43.056702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d6190b7-d7d1-42b2-82e4-6274e058f1a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:43.089111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d4e82e47-04c6-4a8c-b1b9-c5de80cdc242 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:43.097389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d4e82e47-04c6-4a8c-b1b9-c5de80cdc242 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085888 Jul 28 20:20:43.098174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 993/2131] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:43 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:43.183521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6d6190b7-d7d1-42b2-82e4-6274e058f1a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:43.191363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6d6190b7-d7d1-42b2-82e4-6274e058f1a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148084 Jul 28 20:20:43.191906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1139/2132] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:43 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:43.726709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-33f03403-7334-4748-bd17-0a662b01ec57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:43.728941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-33f03403-7334-4748-bd17-0a662b01ec57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:43.735000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-33f03403-7334-4748-bd17-0a662b01ec57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:43.735450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-33f03403-7334-4748-bd17-0a662b01ec57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:43.736213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-33f03403-7334-4748-bd17-0a662b01ec57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:43.736881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-33f03403-7334-4748-bd17-0a662b01ec57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:43.765766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-33f03403-7334-4748-bd17-0a662b01ec57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Jul 28 20:20:43.766308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 994/2133] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:44.118656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2d98b5fc-2eb1-4abb-b623-5604ef98feb1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:44.119249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2d98b5fc-2eb1-4abb-b623-5604ef98feb1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:44.126033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d98b5fc-2eb1-4abb-b623-5604ef98feb1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:44.126446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d98b5fc-2eb1-4abb-b623-5604ef98feb1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:44.127538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d98b5fc-2eb1-4abb-b623-5604ef98feb1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:44.127661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d98b5fc-2eb1-4abb-b623-5604ef98feb1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:44.188787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2d98b5fc-2eb1-4abb-b623-5604ef98feb1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:44.196444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2d98b5fc-2eb1-4abb-b623-5604ef98feb1 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081604 Jul 28 20:20:44.197033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1140/2134] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:44 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:44.212557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a5ba7c88-d24f-45f4-8379-e5e74e0beaaf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:44.213210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a5ba7c88-d24f-45f4-8379-e5e74e0beaaf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:44.219521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5ba7c88-d24f-45f4-8379-e5e74e0beaaf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:44.219959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5ba7c88-d24f-45f4-8379-e5e74e0beaaf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:44.221434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5ba7c88-d24f-45f4-8379-e5e74e0beaaf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:44.221957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a5ba7c88-d24f-45f4-8379-e5e74e0beaaf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:44.351192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a5ba7c88-d24f-45f4-8379-e5e74e0beaaf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:44.362103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a5ba7c88-d24f-45f4-8379-e5e74e0beaaf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150302 Jul 28 20:20:44.362692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 995/2135] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:44 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:44.778510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f08501cc-4226-4e58-8635-33a25cb50f68 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:44.780948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f08501cc-4226-4e58-8635-33a25cb50f68 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:44.787646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f08501cc-4226-4e58-8635-33a25cb50f68 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:44.788093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f08501cc-4226-4e58-8635-33a25cb50f68 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:44.788880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f08501cc-4226-4e58-8635-33a25cb50f68 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:44.789323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f08501cc-4226-4e58-8635-33a25cb50f68 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:44.805931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:44.818913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f08501cc-4226-4e58-8635-33a25cb50f68 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Jul 28 20:20:44.819457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1141/2136] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:45.217584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-44384901-52b5-45c5-b639-e76570b5f39f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:45.218193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-44384901-52b5-45c5-b639-e76570b5f39f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:45.225250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-44384901-52b5-45c5-b639-e76570b5f39f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:45.225689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-44384901-52b5-45c5-b639-e76570b5f39f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:45.226438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-44384901-52b5-45c5-b639-e76570b5f39f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:45.226861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-44384901-52b5-45c5-b639-e76570b5f39f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:45.287104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-44384901-52b5-45c5-b639-e76570b5f39f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:45.290452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:45.295175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-44384901-52b5-45c5-b639-e76570b5f39f tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081478 Jul 28 20:20:45.295720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 996/2137] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:45 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:45.384317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6ffa27d7-5be1-4160-846f-999f096b6253 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:45.384957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6ffa27d7-5be1-4160-846f-999f096b6253 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:45.391435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ffa27d7-5be1-4160-846f-999f096b6253 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:45.391886 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ffa27d7-5be1-4160-846f-999f096b6253 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:45.393454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ffa27d7-5be1-4160-846f-999f096b6253 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:45.393936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ffa27d7-5be1-4160-846f-999f096b6253 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:45.523068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6ffa27d7-5be1-4160-846f-999f096b6253 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:45.531204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6ffa27d7-5be1-4160-846f-999f096b6253 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151062 Jul 28 20:20:45.531759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1142/2138] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:45.830814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-29785ce5-693d-4b15-827c-887987fe6cbd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:45.833077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-29785ce5-693d-4b15-827c-887987fe6cbd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:45.839143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29785ce5-693d-4b15-827c-887987fe6cbd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:45.839587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29785ce5-693d-4b15-827c-887987fe6cbd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:45.840331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29785ce5-693d-4b15-827c-887987fe6cbd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:45.840788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29785ce5-693d-4b15-827c-887987fe6cbd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:45.869034 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-29785ce5-693d-4b15-827c-887987fe6cbd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042316 Jul 28 20:20:45.869578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 997/2139] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:46.317451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1a6387b1-6c72-4650-ade8-1b5d762d9a17 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:46.318116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1a6387b1-6c72-4650-ade8-1b5d762d9a17 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:46.324412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a6387b1-6c72-4650-ade8-1b5d762d9a17 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:46.324932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a6387b1-6c72-4650-ade8-1b5d762d9a17 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:46.325690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a6387b1-6c72-4650-ade8-1b5d762d9a17 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:46.326127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a6387b1-6c72-4650-ade8-1b5d762d9a17 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:46.389675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1a6387b1-6c72-4650-ade8-1b5d762d9a17 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:46.398174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1a6387b1-6c72-4650-ade8-1b5d762d9a17 tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.084696 Jul 28 20:20:46.398734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1143/2140] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:46 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:46.553576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d6960b4f-78ea-47ef-a96c-7949e6be6aef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:46.554110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d6960b4f-78ea-47ef-a96c-7949e6be6aef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:46.561459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6960b4f-78ea-47ef-a96c-7949e6be6aef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:46.561903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6960b4f-78ea-47ef-a96c-7949e6be6aef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:46.562651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6960b4f-78ea-47ef-a96c-7949e6be6aef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:46.563078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6960b4f-78ea-47ef-a96c-7949e6be6aef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:46.693305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d6960b4f-78ea-47ef-a96c-7949e6be6aef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:46.701196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d6960b4f-78ea-47ef-a96c-7949e6be6aef tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152145 Jul 28 20:20:46.701747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 998/2141] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:46.880943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c2515b11-96f4-4c6c-a8d5-f8136a2559fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:46.883139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c2515b11-96f4-4c6c-a8d5-f8136a2559fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:46.889130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2515b11-96f4-4c6c-a8d5-f8136a2559fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:46.889582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2515b11-96f4-4c6c-a8d5-f8136a2559fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:46.890333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2515b11-96f4-4c6c-a8d5-f8136a2559fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:46.890762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2515b11-96f4-4c6c-a8d5-f8136a2559fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:46.920444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c2515b11-96f4-4c6c-a8d5-f8136a2559fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Jul 28 20:20:46.921021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1144/2142] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:20:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:47.419898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-04933898-c822-4890-a771-14b1ab59d6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:47.420420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-04933898-c822-4890-a771-14b1ab59d6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:47.426626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-04933898-c822-4890-a771-14b1ab59d6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:47.427067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-04933898-c822-4890-a771-14b1ab59d6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:47.427809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-04933898-c822-4890-a771-14b1ab59d6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:47.428233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-04933898-c822-4890-a771-14b1ab59d6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:47.488956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-04933898-c822-4890-a771-14b1ab59d6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:47.496381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-04933898-c822-4890-a771-14b1ab59d6af tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.080419 Jul 28 20:20:47.496972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 999/2143] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:47 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:47.723045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0372534f-8fa3-4e2a-8ee4-618aec2e94c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:47.723575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0372534f-8fa3-4e2a-8ee4-618aec2e94c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:47.730030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0372534f-8fa3-4e2a-8ee4-618aec2e94c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:47.730504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0372534f-8fa3-4e2a-8ee4-618aec2e94c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:47.731249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0372534f-8fa3-4e2a-8ee4-618aec2e94c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:47.731677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0372534f-8fa3-4e2a-8ee4-618aec2e94c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:47.862480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0372534f-8fa3-4e2a-8ee4-618aec2e94c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:47.870529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0372534f-8fa3-4e2a-8ee4-618aec2e94c6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152152 Jul 28 20:20:47.871087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1145/2144] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:47.933974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-303ee935-0f50-4e5e-9a84-54168679eb62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:20:47.936151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-303ee935-0f50-4e5e-9a84-54168679eb62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:47.942741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-303ee935-0f50-4e5e-9a84-54168679eb62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:47.943184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-303ee935-0f50-4e5e-9a84-54168679eb62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:47.943932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-303ee935-0f50-4e5e-9a84-54168679eb62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:47.944360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-303ee935-0f50-4e5e-9a84-54168679eb62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:48.063627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-303ee935-0f50-4e5e-9a84-54168679eb62 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "POST /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/action" status: 200 len: 76924 microversion: 2.1 time: 0.133258 Jul 28 20:20:48.064195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1000/2145] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:20:47 2022] POST /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed/action => generated 76924 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 20:20:48.517650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7edfb28d-7e23-45ff-9841-bac3b7f2813d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:48.518994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7edfb28d-7e23-45ff-9841-bac3b7f2813d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:48.525295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7edfb28d-7e23-45ff-9841-bac3b7f2813d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:48.525743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7edfb28d-7e23-45ff-9841-bac3b7f2813d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:48.526493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7edfb28d-7e23-45ff-9841-bac3b7f2813d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:48.526925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7edfb28d-7e23-45ff-9841-bac3b7f2813d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:48.587458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7edfb28d-7e23-45ff-9841-bac3b7f2813d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:48.595263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7edfb28d-7e23-45ff-9841-bac3b7f2813d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.081397 Jul 28 20:20:48.595817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1146/2146] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:48 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:48.891840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eec5451a-e492-4ea6-9dbb-96fd8857bc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:48.892523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eec5451a-e492-4ea6-9dbb-96fd8857bc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:48.899628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eec5451a-e492-4ea6-9dbb-96fd8857bc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:48.900068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eec5451a-e492-4ea6-9dbb-96fd8857bc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:48.900844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eec5451a-e492-4ea6-9dbb-96fd8857bc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:48.901277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eec5451a-e492-4ea6-9dbb-96fd8857bc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:49.029207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-eec5451a-e492-4ea6-9dbb-96fd8857bc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:49.038782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eec5451a-e492-4ea6-9dbb-96fd8857bc94 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151119 Jul 28 20:20:49.039336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1001/2147] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:48 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:49.615881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9248a6b6-92c9-475a-844b-6323a141b04d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:49.616483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9248a6b6-92c9-475a-844b-6323a141b04d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] [instance: f86779ed-0aff-43b5-a713-44e5384deb0d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:49.622911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9248a6b6-92c9-475a-844b-6323a141b04d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:49.623354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9248a6b6-92c9-475a-844b-6323a141b04d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:49.624097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9248a6b6-92c9-475a-844b-6323a141b04d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:49.624521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9248a6b6-92c9-475a-844b-6323a141b04d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:49.688623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9248a6b6-92c9-475a-844b-6323a141b04d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5131b18108f64f11ac1e0f4866a9cb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25002b31f4fc4ec78222fc4919aa5fb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:49.696782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9248a6b6-92c9-475a-844b-6323a141b04d tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d" status: 200 len: 1219 microversion: 2.1 time: 0.085429 Jul 28 20:20:49.697335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1147/2148] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:49 2022] GET /compute/v2.1/servers/f86779ed-0aff-43b5-a713-44e5384deb0d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:49.872591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-938989e1-a540-4c33-b7b2-5818bd1fa9fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] Calling method '.version_select at 0x7f5036e8c3a0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:49.882888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=82 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:49.897883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-938989e1-a540-4c33-b7b2-5818bd1fa9fd tempest-TestShelveInstance-1624781689 tempest-TestShelveInstance-1624781689-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1034975038" status: 202 len: 0 microversion: 2.1 time: 0.029254 Jul 28 20:20:49.898725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1002/2149] 10.222.0.67 () {58 vars in 1254 bytes} [Thu Jul 28 20:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1034975038 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:20:50.060288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc10314b-b103-41ef-94bd-795a05b05c63 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:50.060949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc10314b-b103-41ef-94bd-795a05b05c63 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:50.067166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc10314b-b103-41ef-94bd-795a05b05c63 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:50.067606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc10314b-b103-41ef-94bd-795a05b05c63 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:50.068348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc10314b-b103-41ef-94bd-795a05b05c63 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:50.068796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc10314b-b103-41ef-94bd-795a05b05c63 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:50.477199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cc10314b-b103-41ef-94bd-795a05b05c63 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:50.485282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc10314b-b103-41ef-94bd-795a05b05c63 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.428813 Jul 28 20:20:50.485845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1148/2150] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:50 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:51.508350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6c6c3a84-d20b-477d-aa44-c365b79e2d18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:51.509005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6c6c3a84-d20b-477d-aa44-c365b79e2d18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:51.514968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c6c3a84-d20b-477d-aa44-c365b79e2d18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.515420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c6c3a84-d20b-477d-aa44-c365b79e2d18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.516200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c6c3a84-d20b-477d-aa44-c365b79e2d18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.516659 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c6c3a84-d20b-477d-aa44-c365b79e2d18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.646729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b4f0fd4d-30ff-4a4a-9b3f-dde1222563a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:51.647265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b4f0fd4d-30ff-4a4a-9b3f-dde1222563a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:51.649572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=80 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:51.655767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b4f0fd4d-30ff-4a4a-9b3f-dde1222563a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.656462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b4f0fd4d-30ff-4a4a-9b3f-dde1222563a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.657323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b4f0fd4d-30ff-4a4a-9b3f-dde1222563a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.657998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b4f0fd4d-30ff-4a4a-9b3f-dde1222563a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.689462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b4f0fd4d-30ff-4a4a-9b3f-dde1222563a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Going to try to terminate instance {{(pid=117969) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:20:51.738054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6c6c3a84-d20b-477d-aa44-c365b79e2d18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:51.750433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6c6c3a84-d20b-477d-aa44-c365b79e2d18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.244443 Jul 28 20:20:51.752682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1003/2151] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:51.767944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8f6d3eeb-a150-49e5-becf-5bfbc6fc2626 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:51.768937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8f6d3eeb-a150-49e5-becf-5bfbc6fc2626 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:51.785200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f6d3eeb-a150-49e5-becf-5bfbc6fc2626 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.786160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f6d3eeb-a150-49e5-becf-5bfbc6fc2626 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.787291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f6d3eeb-a150-49e5-becf-5bfbc6fc2626 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.788092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f6d3eeb-a150-49e5-becf-5bfbc6fc2626 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.796227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b4f0fd4d-30ff-4a4a-9b3f-dde1222563a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 204 len: 0 microversion: 2.1 time: 0.153191 Jul 28 20:20:51.797045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1149/2152] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:20:51 2022] DELETE /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:20:51.806626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2306968d-dc5c-4e9c-a711-5babe1bdf626 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:51.807299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2306968d-dc5c-4e9c-a711-5babe1bdf626 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:51.813528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2306968d-dc5c-4e9c-a711-5babe1bdf626 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.813986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2306968d-dc5c-4e9c-a711-5babe1bdf626 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.814751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2306968d-dc5c-4e9c-a711-5babe1bdf626 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.815189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2306968d-dc5c-4e9c-a711-5babe1bdf626 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.818223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8f6d3eeb-a150-49e5-becf-5bfbc6fc2626 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:20:51.923218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8f6d3eeb-a150-49e5-becf-5bfbc6fc2626 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 204 len: 0 microversion: 2.1 time: 0.168109 Jul 28 20:20:51.923913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1004/2153] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:20:51 2022] DELETE /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:20:51.933953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fda2ab19-65e3-46e3-ab9c-46b7b4d9a42d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:51.934770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fda2ab19-65e3-46e3-ab9c-46b7b4d9a42d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:51.943739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fda2ab19-65e3-46e3-ab9c-46b7b4d9a42d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.945077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fda2ab19-65e3-46e3-ab9c-46b7b4d9a42d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.946013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fda2ab19-65e3-46e3-ab9c-46b7b4d9a42d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:51.947138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fda2ab19-65e3-46e3-ab9c-46b7b4d9a42d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:51.978572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2306968d-dc5c-4e9c-a711-5babe1bdf626 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:51.987023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2306968d-dc5c-4e9c-a711-5babe1bdf626 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1598 microversion: 2.1 time: 0.184753 Jul 28 20:20:51.987878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1150/2154] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1598 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:52.104268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fda2ab19-65e3-46e3-ab9c-46b7b4d9a42d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:52.114880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fda2ab19-65e3-46e3-ab9c-46b7b4d9a42d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.185650 Jul 28 20:20:52.121812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1005/2155] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:51 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:52.773100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-700084c5-6755-442c-9851-7a52858d9ccc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:52.774332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-700084c5-6755-442c-9851-7a52858d9ccc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:52.781116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-700084c5-6755-442c-9851-7a52858d9ccc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:52.781564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-700084c5-6755-442c-9851-7a52858d9ccc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:52.782537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-700084c5-6755-442c-9851-7a52858d9ccc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:52.782973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-700084c5-6755-442c-9851-7a52858d9ccc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:52.920422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-700084c5-6755-442c-9851-7a52858d9ccc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:52.928887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-700084c5-6755-442c-9851-7a52858d9ccc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.159524 Jul 28 20:20:52.929467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1151/2156] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:52 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:53.009108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3a8d832b-f46a-4ed8-bd2a-1f47df9d9a10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:53.009717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3a8d832b-f46a-4ed8-bd2a-1f47df9d9a10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:53.015814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a8d832b-f46a-4ed8-bd2a-1f47df9d9a10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:53.016254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a8d832b-f46a-4ed8-bd2a-1f47df9d9a10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:53.017075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a8d832b-f46a-4ed8-bd2a-1f47df9d9a10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:53.017605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a8d832b-f46a-4ed8-bd2a-1f47df9d9a10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:53.136569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c823eb3-0df2-4ffc-892a-3278307b1aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:53.137605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3c823eb3-0df2-4ffc-892a-3278307b1aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:53.144409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c823eb3-0df2-4ffc-892a-3278307b1aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:53.145629 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c823eb3-0df2-4ffc-892a-3278307b1aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:53.148103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c823eb3-0df2-4ffc-892a-3278307b1aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:53.148762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c823eb3-0df2-4ffc-892a-3278307b1aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:53.201896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3a8d832b-f46a-4ed8-bd2a-1f47df9d9a10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:53.220682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3a8d832b-f46a-4ed8-bd2a-1f47df9d9a10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1598 microversion: 2.1 time: 0.215249 Jul 28 20:20:53.221267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1006/2157] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1598 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:53.409704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3c823eb3-0df2-4ffc-892a-3278307b1aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:53.418757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3c823eb3-0df2-4ffc-892a-3278307b1aee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.287278 Jul 28 20:20:53.425641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1152/2158] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:53 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:53.467427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-25acfb68-931b-422b-8aff-c3af7585bfbd req-1dc31372-073b-49f3-8443-9fb6e6466291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed7c90e0-e87c-42b9-b14d-6c06761c1eef", "name": "network-vif-deleted", "tag": "65dd95c0-2195-45fd-8275-f4c90145660b"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:20:53.477845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-25acfb68-931b-422b-8aff-c3af7585bfbd req-1dc31372-073b-49f3-8443-9fb6e6466291 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:53.478550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-25acfb68-931b-422b-8aff-c3af7585bfbd req-1dc31372-073b-49f3-8443-9fb6e6466291 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:53.490274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-25acfb68-931b-422b-8aff-c3af7585bfbd req-1dc31372-073b-49f3-8443-9fb6e6466291 service nova] Creating event network-vif-deleted:65dd95c0-2195-45fd-8275-f4c90145660b for instance ed7c90e0-e87c-42b9-b14d-6c06761c1eef on hv-cinder-85144 Jul 28 20:20:53.495543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-25acfb68-931b-422b-8aff-c3af7585bfbd req-1dc31372-073b-49f3-8443-9fb6e6466291 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128042 Jul 28 20:20:53.500123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1007/2159] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:20:53.951278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e51e783f-1e21-41e3-9cfa-53bb89eeb099 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:53.951833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e51e783f-1e21-41e3-9cfa-53bb89eeb099 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:53.958412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e51e783f-1e21-41e3-9cfa-53bb89eeb099 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:53.958857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e51e783f-1e21-41e3-9cfa-53bb89eeb099 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:53.959614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e51e783f-1e21-41e3-9cfa-53bb89eeb099 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:53.960048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e51e783f-1e21-41e3-9cfa-53bb89eeb099 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:54.097916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e51e783f-1e21-41e3-9cfa-53bb89eeb099 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:54.106219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e51e783f-1e21-41e3-9cfa-53bb89eeb099 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.158832 Jul 28 20:20:54.106807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1153/2160] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:54.244148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-16dbd635-a0c3-4764-9cc3-da783c718fd2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:54.245658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-16dbd635-a0c3-4764-9cc3-da783c718fd2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:54.252445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16dbd635-a0c3-4764-9cc3-da783c718fd2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:54.253699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16dbd635-a0c3-4764-9cc3-da783c718fd2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:54.254550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16dbd635-a0c3-4764-9cc3-da783c718fd2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:54.255180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16dbd635-a0c3-4764-9cc3-da783c718fd2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:54.328156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-16dbd635-a0c3-4764-9cc3-da783c718fd2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:54.336758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-16dbd635-a0c3-4764-9cc3-da783c718fd2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.097245 Jul 28 20:20:54.337338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1008/2161] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:54.449917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c2e66289-602e-4db7-81cc-7604dc940a0a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:54.450691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c2e66289-602e-4db7-81cc-7604dc940a0a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:54.456826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2e66289-602e-4db7-81cc-7604dc940a0a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:54.457278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2e66289-602e-4db7-81cc-7604dc940a0a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:54.458031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2e66289-602e-4db7-81cc-7604dc940a0a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:54.458459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2e66289-602e-4db7-81cc-7604dc940a0a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:54.592370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c2e66289-602e-4db7-81cc-7604dc940a0a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:54.602052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c2e66289-602e-4db7-81cc-7604dc940a0a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.155913 Jul 28 20:20:54.602624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1154/2162] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:54 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:55.129250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-64fbc4fd-bdcc-45b7-91d8-9ca5eb89b9fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:55.129874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-64fbc4fd-bdcc-45b7-91d8-9ca5eb89b9fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:55.136108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64fbc4fd-bdcc-45b7-91d8-9ca5eb89b9fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:55.136577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64fbc4fd-bdcc-45b7-91d8-9ca5eb89b9fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:55.137349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64fbc4fd-bdcc-45b7-91d8-9ca5eb89b9fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:55.137783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64fbc4fd-bdcc-45b7-91d8-9ca5eb89b9fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:55.267815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-64fbc4fd-bdcc-45b7-91d8-9ca5eb89b9fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:55.276821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-64fbc4fd-bdcc-45b7-91d8-9ca5eb89b9fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152020 Jul 28 20:20:55.277628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1009/2163] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:55 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:55.358798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bc63cebd-d0b9-40d5-82c4-fe1d680d6cb9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:55.359409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bc63cebd-d0b9-40d5-82c4-fe1d680d6cb9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:55.367152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc63cebd-d0b9-40d5-82c4-fe1d680d6cb9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:55.367601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc63cebd-d0b9-40d5-82c4-fe1d680d6cb9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:55.368357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc63cebd-d0b9-40d5-82c4-fe1d680d6cb9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:55.368829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc63cebd-d0b9-40d5-82c4-fe1d680d6cb9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:55.431752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bc63cebd-d0b9-40d5-82c4-fe1d680d6cb9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:55.439753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bc63cebd-d0b9-40d5-82c4-fe1d680d6cb9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084795 Jul 28 20:20:55.441281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1155/2164] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:55.623251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f424dc77-35d8-41ba-b535-30be5e036485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:55.624035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f424dc77-35d8-41ba-b535-30be5e036485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:55.631240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f424dc77-35d8-41ba-b535-30be5e036485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:55.631823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f424dc77-35d8-41ba-b535-30be5e036485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:55.632742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f424dc77-35d8-41ba-b535-30be5e036485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:55.633283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f424dc77-35d8-41ba-b535-30be5e036485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:55.783386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f424dc77-35d8-41ba-b535-30be5e036485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:55.792011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f424dc77-35d8-41ba-b535-30be5e036485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.172582 Jul 28 20:20:55.792845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1010/2165] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:55 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:56.298661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7e925761-5d1d-429f-b39e-bf110026d5bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:56.299330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7e925761-5d1d-429f-b39e-bf110026d5bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:56.306119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e925761-5d1d-429f-b39e-bf110026d5bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:56.306558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e925761-5d1d-429f-b39e-bf110026d5bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:56.307305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e925761-5d1d-429f-b39e-bf110026d5bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:56.307731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e925761-5d1d-429f-b39e-bf110026d5bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:56.326700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:56.468415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7e925761-5d1d-429f-b39e-bf110026d5bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:56.469797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-59aa82a0-9723-4ae1-930a-672c6ced0d29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:56.470753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-59aa82a0-9723-4ae1-930a-672c6ced0d29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:56.478829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7e925761-5d1d-429f-b39e-bf110026d5bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.183961 Jul 28 20:20:56.479402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1156/2166] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:56.494293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59aa82a0-9723-4ae1-930a-672c6ced0d29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:56.495044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59aa82a0-9723-4ae1-930a-672c6ced0d29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:56.496372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59aa82a0-9723-4ae1-930a-672c6ced0d29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:56.497028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59aa82a0-9723-4ae1-930a-672c6ced0d29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:56.600421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-59aa82a0-9723-4ae1-930a-672c6ced0d29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:56.610199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-59aa82a0-9723-4ae1-930a-672c6ced0d29 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.152137 Jul 28 20:20:56.622483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1011/2167] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:56 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:56.814155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c14ff256-7f02-43f5-87b1-b50e5bd4610c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:56.814706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c14ff256-7f02-43f5-87b1-b50e5bd4610c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:56.821100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c14ff256-7f02-43f5-87b1-b50e5bd4610c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:56.821543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c14ff256-7f02-43f5-87b1-b50e5bd4610c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:56.822493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c14ff256-7f02-43f5-87b1-b50e5bd4610c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:56.822938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c14ff256-7f02-43f5-87b1-b50e5bd4610c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:57.008451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c14ff256-7f02-43f5-87b1-b50e5bd4610c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:57.023028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c14ff256-7f02-43f5-87b1-b50e5bd4610c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.212514 Jul 28 20:20:57.028654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1157/2168] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:56 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:57.501148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5606ed7c-f9b3-4db6-a66a-012a45e299ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:57.501850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5606ed7c-f9b3-4db6-a66a-012a45e299ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:57.508404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5606ed7c-f9b3-4db6-a66a-012a45e299ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:57.508879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5606ed7c-f9b3-4db6-a66a-012a45e299ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:57.509643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5606ed7c-f9b3-4db6-a66a-012a45e299ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:57.510075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5606ed7c-f9b3-4db6-a66a-012a45e299ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:57.634943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-08d00e70-9b9c-4061-8bd5-2bc05d60b640 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:57.636212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-08d00e70-9b9c-4061-8bd5-2bc05d60b640 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:57.643783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08d00e70-9b9c-4061-8bd5-2bc05d60b640 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:57.644499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08d00e70-9b9c-4061-8bd5-2bc05d60b640 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:57.645683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08d00e70-9b9c-4061-8bd5-2bc05d60b640 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:57.646124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-08d00e70-9b9c-4061-8bd5-2bc05d60b640 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:57.649004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5606ed7c-f9b3-4db6-a66a-012a45e299ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:57.657685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5606ed7c-f9b3-4db6-a66a-012a45e299ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.160336 Jul 28 20:20:57.658340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1012/2169] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:57 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:57.709243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-08d00e70-9b9c-4061-8bd5-2bc05d60b640 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:57.717272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-08d00e70-9b9c-4061-8bd5-2bc05d60b640 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087410 Jul 28 20:20:57.717838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1158/2170] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:58.044273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b0e2e1c9-6c50-40a3-8b8d-f0f68d403b77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:58.044937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b0e2e1c9-6c50-40a3-8b8d-f0f68d403b77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:58.051105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b0e2e1c9-6c50-40a3-8b8d-f0f68d403b77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:58.051564 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b0e2e1c9-6c50-40a3-8b8d-f0f68d403b77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:58.052305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b0e2e1c9-6c50-40a3-8b8d-f0f68d403b77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:58.052758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b0e2e1c9-6c50-40a3-8b8d-f0f68d403b77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:58.203234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b0e2e1c9-6c50-40a3-8b8d-f0f68d403b77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:58.207380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:20:58.214341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b0e2e1c9-6c50-40a3-8b8d-f0f68d403b77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.173783 Jul 28 20:20:58.214944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1013/2171] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:58 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:58.679798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-070ff8e1-29ac-4a78-9b6e-dab3f06410e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:58.680426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-070ff8e1-29ac-4a78-9b6e-dab3f06410e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:58.687019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-070ff8e1-29ac-4a78-9b6e-dab3f06410e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:58.687459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-070ff8e1-29ac-4a78-9b6e-dab3f06410e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:58.688199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-070ff8e1-29ac-4a78-9b6e-dab3f06410e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:58.688662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-070ff8e1-29ac-4a78-9b6e-dab3f06410e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:58.739801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9b3467e6-ec96-40c0-9784-e70c7f32446c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:58.740413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9b3467e6-ec96-40c0-9784-e70c7f32446c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:58.748579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b3467e6-ec96-40c0-9784-e70c7f32446c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:58.749058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b3467e6-ec96-40c0-9784-e70c7f32446c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:58.749814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b3467e6-ec96-40c0-9784-e70c7f32446c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:58.750243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9b3467e6-ec96-40c0-9784-e70c7f32446c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:58.822498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9b3467e6-ec96-40c0-9784-e70c7f32446c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:58.830350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9b3467e6-ec96-40c0-9784-e70c7f32446c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.095128 Jul 28 20:20:58.831032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1014/2172] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:20:58.844181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-070ff8e1-29ac-4a78-9b6e-dab3f06410e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:58.852868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-070ff8e1-29ac-4a78-9b6e-dab3f06410e9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.176703 Jul 28 20:20:58.853423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1159/2173] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:59.235850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1655a4b7-65f6-4bca-9322-b285891f6fdf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:59.236463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1655a4b7-65f6-4bca-9322-b285891f6fdf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:59.242943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1655a4b7-65f6-4bca-9322-b285891f6fdf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:59.243389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1655a4b7-65f6-4bca-9322-b285891f6fdf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:59.244150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1655a4b7-65f6-4bca-9322-b285891f6fdf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:59.244610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1655a4b7-65f6-4bca-9322-b285891f6fdf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:59.374666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1655a4b7-65f6-4bca-9322-b285891f6fdf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:59.382926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1655a4b7-65f6-4bca-9322-b285891f6fdf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150928 Jul 28 20:20:59.383517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1015/2174] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:59 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:20:59.851291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1bec1099-1a50-44aa-bc50-5bbaad6d8e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:59.852006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1bec1099-1a50-44aa-bc50-5bbaad6d8e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:59.858525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bec1099-1a50-44aa-bc50-5bbaad6d8e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:59.858979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bec1099-1a50-44aa-bc50-5bbaad6d8e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:59.859732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bec1099-1a50-44aa-bc50-5bbaad6d8e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:59.860230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1bec1099-1a50-44aa-bc50-5bbaad6d8e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:59.874650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6c7febac-fd6e-428d-98ce-5817bdbd5d26 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:20:59.875285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6c7febac-fd6e-428d-98ce-5817bdbd5d26 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:20:59.882526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c7febac-fd6e-428d-98ce-5817bdbd5d26 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:59.882969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c7febac-fd6e-428d-98ce-5817bdbd5d26 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:59.883724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c7febac-fd6e-428d-98ce-5817bdbd5d26 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:20:59.884153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c7febac-fd6e-428d-98ce-5817bdbd5d26 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:20:59.931293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1bec1099-1a50-44aa-bc50-5bbaad6d8e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:20:59.939420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1bec1099-1a50-44aa-bc50-5bbaad6d8e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.091998 Jul 28 20:20:59.939985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1160/2175] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:00.020927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6c7febac-fd6e-428d-98ce-5817bdbd5d26 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:00.028856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6c7febac-fd6e-428d-98ce-5817bdbd5d26 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.158055 Jul 28 20:21:00.029412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1016/2176] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:20:59 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:00.405618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f9482f17-baa3-45cf-b5ea-3636d498e2d1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:00.406231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f9482f17-baa3-45cf-b5ea-3636d498e2d1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:00.412844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9482f17-baa3-45cf-b5ea-3636d498e2d1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:00.413293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9482f17-baa3-45cf-b5ea-3636d498e2d1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:00.414041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9482f17-baa3-45cf-b5ea-3636d498e2d1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:00.414469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f9482f17-baa3-45cf-b5ea-3636d498e2d1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:00.551619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f9482f17-baa3-45cf-b5ea-3636d498e2d1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:00.559423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f9482f17-baa3-45cf-b5ea-3636d498e2d1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.157971 Jul 28 20:21:00.559978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1161/2177] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:00 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:00.961175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b369ce7-4a3c-4884-946f-bb67d733405b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:00.961780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b369ce7-4a3c-4884-946f-bb67d733405b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:00.968172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b369ce7-4a3c-4884-946f-bb67d733405b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:00.968627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b369ce7-4a3c-4884-946f-bb67d733405b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:00.969371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b369ce7-4a3c-4884-946f-bb67d733405b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:00.969795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b369ce7-4a3c-4884-946f-bb67d733405b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:01.029539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b369ce7-4a3c-4884-946f-bb67d733405b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:01.038208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b369ce7-4a3c-4884-946f-bb67d733405b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080851 Jul 28 20:21:01.038764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1017/2178] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:01.051779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a1c8205c-6d07-41fb-8c24-920a8b7ad3ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:01.052510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a1c8205c-6d07-41fb-8c24-920a8b7ad3ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:01.059026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1c8205c-6d07-41fb-8c24-920a8b7ad3ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:01.059471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1c8205c-6d07-41fb-8c24-920a8b7ad3ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:01.060222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1c8205c-6d07-41fb-8c24-920a8b7ad3ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:01.060679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1c8205c-6d07-41fb-8c24-920a8b7ad3ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:01.189393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a1c8205c-6d07-41fb-8c24-920a8b7ad3ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:01.197522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a1c8205c-6d07-41fb-8c24-920a8b7ad3ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150153 Jul 28 20:21:01.198076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1162/2179] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:01.579835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b62b7d00-8a97-4a09-8a46-3ff101e783b8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:01.580437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b62b7d00-8a97-4a09-8a46-3ff101e783b8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:01.587064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b62b7d00-8a97-4a09-8a46-3ff101e783b8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:01.587509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b62b7d00-8a97-4a09-8a46-3ff101e783b8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:01.588266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b62b7d00-8a97-4a09-8a46-3ff101e783b8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:01.588717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b62b7d00-8a97-4a09-8a46-3ff101e783b8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:01.718406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b62b7d00-8a97-4a09-8a46-3ff101e783b8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:01.726425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b62b7d00-8a97-4a09-8a46-3ff101e783b8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150475 Jul 28 20:21:01.726981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1018/2180] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:01 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:02.062487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-83f49189-cad5-4c91-80a4-b7988a3fee68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:02.063047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-83f49189-cad5-4c91-80a4-b7988a3fee68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:02.069767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83f49189-cad5-4c91-80a4-b7988a3fee68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:02.070219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83f49189-cad5-4c91-80a4-b7988a3fee68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:02.070981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83f49189-cad5-4c91-80a4-b7988a3fee68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:02.071415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83f49189-cad5-4c91-80a4-b7988a3fee68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:02.137555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-83f49189-cad5-4c91-80a4-b7988a3fee68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:02.147760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-83f49189-cad5-4c91-80a4-b7988a3fee68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.089153 Jul 28 20:21:02.148315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1163/2181] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:02 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:02.218915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-56add82f-606e-4f61-b90a-6d32b9f2c148 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:02.219519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-56add82f-606e-4f61-b90a-6d32b9f2c148 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:02.226759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-56add82f-606e-4f61-b90a-6d32b9f2c148 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:02.227196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-56add82f-606e-4f61-b90a-6d32b9f2c148 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:02.228053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-56add82f-606e-4f61-b90a-6d32b9f2c148 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:02.228573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-56add82f-606e-4f61-b90a-6d32b9f2c148 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:02.358949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-56add82f-606e-4f61-b90a-6d32b9f2c148 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:02.367005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-56add82f-606e-4f61-b90a-6d32b9f2c148 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152076 Jul 28 20:21:02.367560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1019/2182] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:02 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:02.747299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b88cb6c5-cd2e-4338-bca1-42517c5840f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:02.747822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b88cb6c5-cd2e-4338-bca1-42517c5840f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:02.754598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b88cb6c5-cd2e-4338-bca1-42517c5840f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:02.755039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b88cb6c5-cd2e-4338-bca1-42517c5840f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:02.755789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b88cb6c5-cd2e-4338-bca1-42517c5840f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:02.756215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b88cb6c5-cd2e-4338-bca1-42517c5840f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:03.092379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b88cb6c5-cd2e-4338-bca1-42517c5840f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:03.101098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b88cb6c5-cd2e-4338-bca1-42517c5840f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.357669 Jul 28 20:21:03.101650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1164/2183] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:02 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:03.388131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-727942ae-6137-406b-b802-11d148b4fed8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:03.388831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-727942ae-6137-406b-b802-11d148b4fed8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:03.395400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-727942ae-6137-406b-b802-11d148b4fed8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:03.395848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-727942ae-6137-406b-b802-11d148b4fed8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:03.396640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-727942ae-6137-406b-b802-11d148b4fed8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:03.397078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-727942ae-6137-406b-b802-11d148b4fed8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:03.405758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-27b328fe-3e49-40a7-9cf1-7575d6ebe229 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:03.406368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-27b328fe-3e49-40a7-9cf1-7575d6ebe229 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:03.413363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27b328fe-3e49-40a7-9cf1-7575d6ebe229 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:03.413808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27b328fe-3e49-40a7-9cf1-7575d6ebe229 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:03.414569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27b328fe-3e49-40a7-9cf1-7575d6ebe229 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:03.415264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27b328fe-3e49-40a7-9cf1-7575d6ebe229 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:03.489661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-27b328fe-3e49-40a7-9cf1-7575d6ebe229 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:03.497720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-27b328fe-3e49-40a7-9cf1-7575d6ebe229 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.331944 Jul 28 20:21:03.498140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1020/2184] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:03 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:03.554018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-727942ae-6137-406b-b802-11d148b4fed8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:03.562053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-727942ae-6137-406b-b802-11d148b4fed8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.177660 Jul 28 20:21:03.562575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1165/2185] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:03 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:04.122086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c9280fe7-96c9-496c-97e9-195c47e4d273 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:04.122691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c9280fe7-96c9-496c-97e9-195c47e4d273 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:04.129441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9280fe7-96c9-496c-97e9-195c47e4d273 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:04.129881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9280fe7-96c9-496c-97e9-195c47e4d273 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:04.130625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9280fe7-96c9-496c-97e9-195c47e4d273 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:04.131050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9280fe7-96c9-496c-97e9-195c47e4d273 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:04.257732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c9280fe7-96c9-496c-97e9-195c47e4d273 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:04.265657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c9280fe7-96c9-496c-97e9-195c47e4d273 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147423 Jul 28 20:21:04.266218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1021/2186] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:04 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:04.519444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-661ec6bd-1d36-4084-bf51-be203c895f01 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:04.519978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-661ec6bd-1d36-4084-bf51-be203c895f01 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:04.526445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-661ec6bd-1d36-4084-bf51-be203c895f01 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:04.526889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-661ec6bd-1d36-4084-bf51-be203c895f01 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:04.527637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-661ec6bd-1d36-4084-bf51-be203c895f01 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:04.528067 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-661ec6bd-1d36-4084-bf51-be203c895f01 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:04.583369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-499189c3-df64-4813-9c61-e590f182e71f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:04.583985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-499189c3-df64-4813-9c61-e590f182e71f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:04.588297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-661ec6bd-1d36-4084-bf51-be203c895f01 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:04.590203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-499189c3-df64-4813-9c61-e590f182e71f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:04.590649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-499189c3-df64-4813-9c61-e590f182e71f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:04.591415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-499189c3-df64-4813-9c61-e590f182e71f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:04.591842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-499189c3-df64-4813-9c61-e590f182e71f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:04.596400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-661ec6bd-1d36-4084-bf51-be203c895f01 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081069 Jul 28 20:21:04.597184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1166/2187] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:04.730895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-499189c3-df64-4813-9c61-e590f182e71f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:04.739533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-499189c3-df64-4813-9c61-e590f182e71f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.160089 Jul 28 20:21:04.740086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1022/2188] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:04 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:05.287783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0bc6376c-1d3c-4bc6-a60f-d320a59fdf62 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:05.288395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0bc6376c-1d3c-4bc6-a60f-d320a59fdf62 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:05.294411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0bc6376c-1d3c-4bc6-a60f-d320a59fdf62 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:05.294853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0bc6376c-1d3c-4bc6-a60f-d320a59fdf62 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:05.295608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0bc6376c-1d3c-4bc6-a60f-d320a59fdf62 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:05.296040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0bc6376c-1d3c-4bc6-a60f-d320a59fdf62 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:05.422577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0bc6376c-1d3c-4bc6-a60f-d320a59fdf62 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:05.430842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0bc6376c-1d3c-4bc6-a60f-d320a59fdf62 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147445 Jul 28 20:21:05.431398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1167/2189] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:05 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:05.617262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-957e9883-ce9f-4732-994d-8945128eb58b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:05.617876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-957e9883-ce9f-4732-994d-8945128eb58b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:05.624395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-957e9883-ce9f-4732-994d-8945128eb58b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:05.624834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-957e9883-ce9f-4732-994d-8945128eb58b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:05.625625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-957e9883-ce9f-4732-994d-8945128eb58b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:05.626064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-957e9883-ce9f-4732-994d-8945128eb58b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:05.690887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-957e9883-ce9f-4732-994d-8945128eb58b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:05.698926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-957e9883-ce9f-4732-994d-8945128eb58b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085542 Jul 28 20:21:05.699486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1023/2190] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:05 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:05.760353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b5bbf7bf-87d2-4b2f-9cab-7ab924aa182a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:05.761030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b5bbf7bf-87d2-4b2f-9cab-7ab924aa182a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:05.767437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5bbf7bf-87d2-4b2f-9cab-7ab924aa182a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:05.767882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5bbf7bf-87d2-4b2f-9cab-7ab924aa182a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:05.769408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5bbf7bf-87d2-4b2f-9cab-7ab924aa182a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:05.769839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5bbf7bf-87d2-4b2f-9cab-7ab924aa182a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:05.903735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b5bbf7bf-87d2-4b2f-9cab-7ab924aa182a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:05.912898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b5bbf7bf-87d2-4b2f-9cab-7ab924aa182a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.156393 Jul 28 20:21:05.913461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1168/2191] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:05 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:06.454184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9afb5709-8eb3-47ef-b08e-406538a1e044 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:06.454720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9afb5709-8eb3-47ef-b08e-406538a1e044 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:06.461820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afb5709-8eb3-47ef-b08e-406538a1e044 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:06.462259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afb5709-8eb3-47ef-b08e-406538a1e044 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:06.463020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afb5709-8eb3-47ef-b08e-406538a1e044 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:06.463447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9afb5709-8eb3-47ef-b08e-406538a1e044 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:06.597084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9afb5709-8eb3-47ef-b08e-406538a1e044 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:06.605749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9afb5709-8eb3-47ef-b08e-406538a1e044 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.155535 Jul 28 20:21:06.606315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1024/2192] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:06 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:06.721300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ef2a29fb-a326-4c92-8e64-8ace840b6183 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:06.722052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ef2a29fb-a326-4c92-8e64-8ace840b6183 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:06.728192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef2a29fb-a326-4c92-8e64-8ace840b6183 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:06.728743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef2a29fb-a326-4c92-8e64-8ace840b6183 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:06.730017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef2a29fb-a326-4c92-8e64-8ace840b6183 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:06.730846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef2a29fb-a326-4c92-8e64-8ace840b6183 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:06.798378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ef2a29fb-a326-4c92-8e64-8ace840b6183 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:06.806841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ef2a29fb-a326-4c92-8e64-8ace840b6183 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.090619 Jul 28 20:21:06.807395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1169/2193] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:06.934604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b07f6034-ea1f-492d-ad33-d511d94c331b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:06.935821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b07f6034-ea1f-492d-ad33-d511d94c331b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:06.943259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b07f6034-ea1f-492d-ad33-d511d94c331b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:06.943700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b07f6034-ea1f-492d-ad33-d511d94c331b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:06.944459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b07f6034-ea1f-492d-ad33-d511d94c331b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:06.944915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b07f6034-ea1f-492d-ad33-d511d94c331b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:07.074848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b07f6034-ea1f-492d-ad33-d511d94c331b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:07.082864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b07f6034-ea1f-492d-ad33-d511d94c331b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152153 Jul 28 20:21:07.083431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1025/2194] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:06 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:07.627396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5f1e3656-b54f-4172-9bb2-d4c677d4c6cc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:07.628225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5f1e3656-b54f-4172-9bb2-d4c677d4c6cc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:07.634217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f1e3656-b54f-4172-9bb2-d4c677d4c6cc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:07.634655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f1e3656-b54f-4172-9bb2-d4c677d4c6cc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:07.635394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f1e3656-b54f-4172-9bb2-d4c677d4c6cc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:07.635818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f1e3656-b54f-4172-9bb2-d4c677d4c6cc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:07.761655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5f1e3656-b54f-4172-9bb2-d4c677d4c6cc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:07.770764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5f1e3656-b54f-4172-9bb2-d4c677d4c6cc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147238 Jul 28 20:21:07.771316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1170/2195] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:07 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:07.828138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-69742ae3-f376-4167-85be-fdac5d85fb23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:07.828776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-69742ae3-f376-4167-85be-fdac5d85fb23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:07.834862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69742ae3-f376-4167-85be-fdac5d85fb23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:07.835309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69742ae3-f376-4167-85be-fdac5d85fb23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:07.836060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69742ae3-f376-4167-85be-fdac5d85fb23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:07.836488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69742ae3-f376-4167-85be-fdac5d85fb23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:07.900568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-69742ae3-f376-4167-85be-fdac5d85fb23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:07.908899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-69742ae3-f376-4167-85be-fdac5d85fb23 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084538 Jul 28 20:21:07.910104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1026/2196] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:08.103930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-90bf92de-d3b4-45fc-a69e-c26255998fd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:08.104602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-90bf92de-d3b4-45fc-a69e-c26255998fd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:08.110555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90bf92de-d3b4-45fc-a69e-c26255998fd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:08.111002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90bf92de-d3b4-45fc-a69e-c26255998fd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:08.111755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90bf92de-d3b4-45fc-a69e-c26255998fd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:08.112843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90bf92de-d3b4-45fc-a69e-c26255998fd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:08.255422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-90bf92de-d3b4-45fc-a69e-c26255998fd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:08.263307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-90bf92de-d3b4-45fc-a69e-c26255998fd1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.163245 Jul 28 20:21:08.263870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1171/2197] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:08 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:08.792458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7c78a30a-e3a8-46ea-b1a1-9e4b17c01c58 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:08.793044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7c78a30a-e3a8-46ea-b1a1-9e4b17c01c58 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:08.799526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7c78a30a-e3a8-46ea-b1a1-9e4b17c01c58 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:08.801136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7c78a30a-e3a8-46ea-b1a1-9e4b17c01c58 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:08.801906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7c78a30a-e3a8-46ea-b1a1-9e4b17c01c58 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:08.802338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7c78a30a-e3a8-46ea-b1a1-9e4b17c01c58 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:08.929506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7c78a30a-e3a8-46ea-b1a1-9e4b17c01c58 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:08.930502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8593d33f-63de-41ab-84b4-32b69045d1cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:08.931135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8593d33f-63de-41ab-84b4-32b69045d1cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:08.937320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8593d33f-63de-41ab-84b4-32b69045d1cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:08.937465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7c78a30a-e3a8-46ea-b1a1-9e4b17c01c58 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148865 Jul 28 20:21:08.937760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8593d33f-63de-41ab-84b4-32b69045d1cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:08.941415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1027/2198] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:08 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:08.941589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8593d33f-63de-41ab-84b4-32b69045d1cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:08.941589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8593d33f-63de-41ab-84b4-32b69045d1cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:09.002263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8593d33f-63de-41ab-84b4-32b69045d1cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:09.010427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8593d33f-63de-41ab-84b4-32b69045d1cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083645 Jul 28 20:21:09.010979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1172/2199] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:09.286200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2da335a2-529b-4495-b812-c1672078ed7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:09.286814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2da335a2-529b-4495-b812-c1672078ed7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:09.293262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2da335a2-529b-4495-b812-c1672078ed7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:09.293709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2da335a2-529b-4495-b812-c1672078ed7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:09.294459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2da335a2-529b-4495-b812-c1672078ed7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:09.294892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2da335a2-529b-4495-b812-c1672078ed7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:09.422831 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2da335a2-529b-4495-b812-c1672078ed7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:09.431036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2da335a2-529b-4495-b812-c1672078ed7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149148 Jul 28 20:21:09.431592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1028/2200] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:09 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:09.959206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3626a88c-b0c7-4d93-95c6-822afe8fc71b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:09.959817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3626a88c-b0c7-4d93-95c6-822afe8fc71b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:09.966300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3626a88c-b0c7-4d93-95c6-822afe8fc71b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:09.966745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3626a88c-b0c7-4d93-95c6-822afe8fc71b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:09.967497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3626a88c-b0c7-4d93-95c6-822afe8fc71b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:09.967925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3626a88c-b0c7-4d93-95c6-822afe8fc71b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:09.972365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:10.031554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b9cba37a-c304-4bb8-be09-24f1ed397519 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:10.032172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b9cba37a-c304-4bb8-be09-24f1ed397519 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:10.039850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b9cba37a-c304-4bb8-be09-24f1ed397519 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:10.040298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b9cba37a-c304-4bb8-be09-24f1ed397519 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:10.041103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b9cba37a-c304-4bb8-be09-24f1ed397519 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:10.041545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b9cba37a-c304-4bb8-be09-24f1ed397519 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:10.119808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b9cba37a-c304-4bb8-be09-24f1ed397519 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:10.123160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3626a88c-b0c7-4d93-95c6-822afe8fc71b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:10.128346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b9cba37a-c304-4bb8-be09-24f1ed397519 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.100322 Jul 28 20:21:10.129348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1029/2201] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:10 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:10.131591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3626a88c-b0c7-4d93-95c6-822afe8fc71b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.176296 Jul 28 20:21:10.132148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1173/2202] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:09 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:10.453175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-15377157-29bb-44fa-8b61-2e814f7d6e85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:10.453711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-15377157-29bb-44fa-8b61-2e814f7d6e85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:10.459876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-15377157-29bb-44fa-8b61-2e814f7d6e85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:10.460319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-15377157-29bb-44fa-8b61-2e814f7d6e85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:10.461113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-15377157-29bb-44fa-8b61-2e814f7d6e85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:10.461540 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-15377157-29bb-44fa-8b61-2e814f7d6e85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:10.479012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:10.590695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-15377157-29bb-44fa-8b61-2e814f7d6e85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:10.598734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-15377157-29bb-44fa-8b61-2e814f7d6e85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149531 Jul 28 20:21:10.599294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1030/2203] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:10 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:11.150888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0ba1a514-837c-4525-a393-fd048fc6d2ee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:11.151479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0ba1a514-837c-4525-a393-fd048fc6d2ee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:11.153058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a3a1b7c2-1f00-4e3b-9368-a3158104df85 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:11.153674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a3a1b7c2-1f00-4e3b-9368-a3158104df85 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:11.158273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ba1a514-837c-4525-a393-fd048fc6d2ee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:11.158772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ba1a514-837c-4525-a393-fd048fc6d2ee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:11.160084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ba1a514-837c-4525-a393-fd048fc6d2ee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:11.160940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ba1a514-837c-4525-a393-fd048fc6d2ee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:11.161575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a3a1b7c2-1f00-4e3b-9368-a3158104df85 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:11.162023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a3a1b7c2-1f00-4e3b-9368-a3158104df85 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:11.162794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a3a1b7c2-1f00-4e3b-9368-a3158104df85 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:11.163232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a3a1b7c2-1f00-4e3b-9368-a3158104df85 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:11.245541 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0ba1a514-837c-4525-a393-fd048fc6d2ee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:11.253758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0ba1a514-837c-4525-a393-fd048fc6d2ee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.106603 Jul 28 20:21:11.254337 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1174/2204] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:11.314184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a3a1b7c2-1f00-4e3b-9368-a3158104df85 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:11.322791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a3a1b7c2-1f00-4e3b-9368-a3158104df85 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.173682 Jul 28 20:21:11.323357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1031/2205] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:11 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:11.619158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ffed0714-f6be-4816-8816-e7f33659fc65 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:11.619792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ffed0714-f6be-4816-8816-e7f33659fc65 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:11.625783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ffed0714-f6be-4816-8816-e7f33659fc65 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:11.626224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ffed0714-f6be-4816-8816-e7f33659fc65 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:11.626956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ffed0714-f6be-4816-8816-e7f33659fc65 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:11.627381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ffed0714-f6be-4816-8816-e7f33659fc65 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:11.754253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ffed0714-f6be-4816-8816-e7f33659fc65 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:11.762129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ffed0714-f6be-4816-8816-e7f33659fc65 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146784 Jul 28 20:21:11.762683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1175/2206] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:11 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:12.276229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-249d76be-c727-4b0b-99a8-b6fefafb4453 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:12.276881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-249d76be-c727-4b0b-99a8-b6fefafb4453 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:12.283587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-249d76be-c727-4b0b-99a8-b6fefafb4453 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:12.284709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-249d76be-c727-4b0b-99a8-b6fefafb4453 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:12.285435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-249d76be-c727-4b0b-99a8-b6fefafb4453 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:12.285869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-249d76be-c727-4b0b-99a8-b6fefafb4453 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:12.343622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-86761859-d87e-4d92-929a-710cc49d5837 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:12.344260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-86761859-d87e-4d92-929a-710cc49d5837 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:12.345319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-249d76be-c727-4b0b-99a8-b6fefafb4453 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:12.351523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86761859-d87e-4d92-929a-710cc49d5837 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:12.351978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86761859-d87e-4d92-929a-710cc49d5837 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:12.352777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86761859-d87e-4d92-929a-710cc49d5837 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:12.353214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86761859-d87e-4d92-929a-710cc49d5837 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:12.353866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-249d76be-c727-4b0b-99a8-b6fefafb4453 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082002 Jul 28 20:21:12.354422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1032/2207] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:12.483314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-86761859-d87e-4d92-929a-710cc49d5837 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:12.492473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-86761859-d87e-4d92-929a-710cc49d5837 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152716 Jul 28 20:21:12.493064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1176/2208] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:12 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:12.784783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e052a784-fdb2-40b7-b3aa-046bc0f71e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:12.785314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e052a784-fdb2-40b7-b3aa-046bc0f71e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:12.791217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e052a784-fdb2-40b7-b3aa-046bc0f71e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:12.791656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e052a784-fdb2-40b7-b3aa-046bc0f71e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:12.792402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e052a784-fdb2-40b7-b3aa-046bc0f71e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:12.792868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e052a784-fdb2-40b7-b3aa-046bc0f71e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:12.919533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e052a784-fdb2-40b7-b3aa-046bc0f71e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:12.928618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e052a784-fdb2-40b7-b3aa-046bc0f71e02 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148745 Jul 28 20:21:12.929180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1033/2209] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:12 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:13.375621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8be379f0-f962-409e-a1fc-1344ffb9dfb1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:13.376233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8be379f0-f962-409e-a1fc-1344ffb9dfb1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:13.383369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8be379f0-f962-409e-a1fc-1344ffb9dfb1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:13.383836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8be379f0-f962-409e-a1fc-1344ffb9dfb1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:13.384580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8be379f0-f962-409e-a1fc-1344ffb9dfb1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:13.385022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8be379f0-f962-409e-a1fc-1344ffb9dfb1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:13.451168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8be379f0-f962-409e-a1fc-1344ffb9dfb1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:13.459638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8be379f0-f962-409e-a1fc-1344ffb9dfb1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087941 Jul 28 20:21:13.460191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1177/2210] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:13 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:13.514224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-94a2c8bd-ab7c-4f6c-a017-100124a0d2d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:13.514918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-94a2c8bd-ab7c-4f6c-a017-100124a0d2d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:13.521865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94a2c8bd-ab7c-4f6c-a017-100124a0d2d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:13.522312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94a2c8bd-ab7c-4f6c-a017-100124a0d2d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:13.523053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94a2c8bd-ab7c-4f6c-a017-100124a0d2d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:13.523480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-94a2c8bd-ab7c-4f6c-a017-100124a0d2d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:13.660888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-94a2c8bd-ab7c-4f6c-a017-100124a0d2d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:13.668771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-94a2c8bd-ab7c-4f6c-a017-100124a0d2d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.158354 Jul 28 20:21:13.669331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1034/2211] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:13 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:13.950970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b52fb556-f9d7-4cf5-92a1-c62cb765f384 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:13.951574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b52fb556-f9d7-4cf5-92a1-c62cb765f384 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:13.958089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b52fb556-f9d7-4cf5-92a1-c62cb765f384 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:13.958528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b52fb556-f9d7-4cf5-92a1-c62cb765f384 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:13.959292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b52fb556-f9d7-4cf5-92a1-c62cb765f384 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:13.959714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b52fb556-f9d7-4cf5-92a1-c62cb765f384 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:14.087583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b52fb556-f9d7-4cf5-92a1-c62cb765f384 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:14.095336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b52fb556-f9d7-4cf5-92a1-c62cb765f384 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148511 Jul 28 20:21:14.095884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1178/2212] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:13 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:14.481785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0303c394-9f1a-475a-91a0-c65ba0f0701e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:14.482389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0303c394-9f1a-475a-91a0-c65ba0f0701e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:14.488865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0303c394-9f1a-475a-91a0-c65ba0f0701e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:14.489306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0303c394-9f1a-475a-91a0-c65ba0f0701e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:14.490352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0303c394-9f1a-475a-91a0-c65ba0f0701e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:14.490789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0303c394-9f1a-475a-91a0-c65ba0f0701e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:14.555407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0303c394-9f1a-475a-91a0-c65ba0f0701e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:14.563210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0303c394-9f1a-475a-91a0-c65ba0f0701e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085328 Jul 28 20:21:14.563764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1035/2213] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:14.691145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a2bc90ce-beb7-449e-b849-b747081bebe9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:14.691756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a2bc90ce-beb7-449e-b849-b747081bebe9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:14.698271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2bc90ce-beb7-449e-b849-b747081bebe9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:14.698715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2bc90ce-beb7-449e-b849-b747081bebe9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:14.699459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2bc90ce-beb7-449e-b849-b747081bebe9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:14.699887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2bc90ce-beb7-449e-b849-b747081bebe9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:14.830095 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a2bc90ce-beb7-449e-b849-b747081bebe9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:14.837891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a2bc90ce-beb7-449e-b849-b747081bebe9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151269 Jul 28 20:21:14.838443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1179/2214] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:14 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:15.117843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f6cdc7a1-d109-4313-8127-a31e05603cc3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:15.118368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f6cdc7a1-d109-4313-8127-a31e05603cc3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:15.124374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6cdc7a1-d109-4313-8127-a31e05603cc3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:15.124872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6cdc7a1-d109-4313-8127-a31e05603cc3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:15.125885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6cdc7a1-d109-4313-8127-a31e05603cc3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:15.126320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f6cdc7a1-d109-4313-8127-a31e05603cc3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:15.255730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f6cdc7a1-d109-4313-8127-a31e05603cc3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:15.263647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f6cdc7a1-d109-4313-8127-a31e05603cc3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149700 Jul 28 20:21:15.264209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1036/2215] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:15 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:15.585464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-31827672-f82c-49d8-8055-d4cbcd187601 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:15.586069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-31827672-f82c-49d8-8055-d4cbcd187601 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:15.593624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31827672-f82c-49d8-8055-d4cbcd187601 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:15.594062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31827672-f82c-49d8-8055-d4cbcd187601 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:15.594811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31827672-f82c-49d8-8055-d4cbcd187601 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:15.595514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31827672-f82c-49d8-8055-d4cbcd187601 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:15.663375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-31827672-f82c-49d8-8055-d4cbcd187601 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:15.671582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-31827672-f82c-49d8-8055-d4cbcd187601 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.090683 Jul 28 20:21:15.672152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1180/2216] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:15.858981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-223b9e8e-ed3d-4707-84aa-98dfc604665a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:15.859597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-223b9e8e-ed3d-4707-84aa-98dfc604665a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:15.866247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223b9e8e-ed3d-4707-84aa-98dfc604665a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:15.866698 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223b9e8e-ed3d-4707-84aa-98dfc604665a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:15.867452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223b9e8e-ed3d-4707-84aa-98dfc604665a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:15.867890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-223b9e8e-ed3d-4707-84aa-98dfc604665a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:16.009335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-223b9e8e-ed3d-4707-84aa-98dfc604665a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:16.017131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-223b9e8e-ed3d-4707-84aa-98dfc604665a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.162069 Jul 28 20:21:16.017683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1037/2217] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:15 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:16.286304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-81032816-97a6-421b-80bf-fda20e66adcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:16.286951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-81032816-97a6-421b-80bf-fda20e66adcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:16.293556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81032816-97a6-421b-80bf-fda20e66adcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:16.294007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81032816-97a6-421b-80bf-fda20e66adcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:16.294764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81032816-97a6-421b-80bf-fda20e66adcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:16.295196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81032816-97a6-421b-80bf-fda20e66adcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:16.421390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-81032816-97a6-421b-80bf-fda20e66adcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:16.430433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-81032816-97a6-421b-80bf-fda20e66adcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148597 Jul 28 20:21:16.430992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1181/2218] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:16 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:16.693754 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-10d63803-e6ba-48cc-aa36-8fe17edc2eff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:16.694361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-10d63803-e6ba-48cc-aa36-8fe17edc2eff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:16.700286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10d63803-e6ba-48cc-aa36-8fe17edc2eff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:16.700866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10d63803-e6ba-48cc-aa36-8fe17edc2eff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:16.701616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10d63803-e6ba-48cc-aa36-8fe17edc2eff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:16.702041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10d63803-e6ba-48cc-aa36-8fe17edc2eff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:16.764435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-10d63803-e6ba-48cc-aa36-8fe17edc2eff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:16.772316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-10d63803-e6ba-48cc-aa36-8fe17edc2eff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083288 Jul 28 20:21:16.772903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1038/2219] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:16 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:17.039712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c219cf19-de59-401c-bd1a-66f2537be0b9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:17.040268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c219cf19-de59-401c-bd1a-66f2537be0b9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:17.046378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c219cf19-de59-401c-bd1a-66f2537be0b9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:17.046821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c219cf19-de59-401c-bd1a-66f2537be0b9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:17.047569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c219cf19-de59-401c-bd1a-66f2537be0b9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:17.048000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c219cf19-de59-401c-bd1a-66f2537be0b9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:17.178750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c219cf19-de59-401c-bd1a-66f2537be0b9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:17.186676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c219cf19-de59-401c-bd1a-66f2537be0b9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151009 Jul 28 20:21:17.187231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1182/2220] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:17 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:17.452734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d2414afb-2a8f-4362-9378-bdcdd75b8572 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:17.453406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d2414afb-2a8f-4362-9378-bdcdd75b8572 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:17.460976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2414afb-2a8f-4362-9378-bdcdd75b8572 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:17.461421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2414afb-2a8f-4362-9378-bdcdd75b8572 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:17.462175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2414afb-2a8f-4362-9378-bdcdd75b8572 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:17.462606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d2414afb-2a8f-4362-9378-bdcdd75b8572 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:17.590787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d2414afb-2a8f-4362-9378-bdcdd75b8572 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:17.599080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d2414afb-2a8f-4362-9378-bdcdd75b8572 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150577 Jul 28 20:21:17.599631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1039/2221] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:17 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:17.794371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71c20ad7-40f2-42bd-a793-b95b1e37be86 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:17.794914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-71c20ad7-40f2-42bd-a793-b95b1e37be86 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:17.802266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71c20ad7-40f2-42bd-a793-b95b1e37be86 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:17.802704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71c20ad7-40f2-42bd-a793-b95b1e37be86 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:17.803554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71c20ad7-40f2-42bd-a793-b95b1e37be86 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:17.803981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71c20ad7-40f2-42bd-a793-b95b1e37be86 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:17.866499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-71c20ad7-40f2-42bd-a793-b95b1e37be86 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:17.874473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-71c20ad7-40f2-42bd-a793-b95b1e37be86 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084012 Jul 28 20:21:17.875065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1183/2222] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:18.207895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-655e02e9-f87b-4e8c-b1f2-025c96c6116e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:18.208503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-655e02e9-f87b-4e8c-b1f2-025c96c6116e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:18.215289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-655e02e9-f87b-4e8c-b1f2-025c96c6116e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:18.215739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-655e02e9-f87b-4e8c-b1f2-025c96c6116e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:18.216533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-655e02e9-f87b-4e8c-b1f2-025c96c6116e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:18.216992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-655e02e9-f87b-4e8c-b1f2-025c96c6116e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:18.345171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-655e02e9-f87b-4e8c-b1f2-025c96c6116e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:18.353003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-655e02e9-f87b-4e8c-b1f2-025c96c6116e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149560 Jul 28 20:21:18.353558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1040/2223] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:18 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:18.620627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-439ea2d0-465f-4e76-92d8-51e39a7f54e8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:18.621242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-439ea2d0-465f-4e76-92d8-51e39a7f54e8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:18.627280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-439ea2d0-465f-4e76-92d8-51e39a7f54e8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:18.628389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-439ea2d0-465f-4e76-92d8-51e39a7f54e8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:18.629174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-439ea2d0-465f-4e76-92d8-51e39a7f54e8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:18.629601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-439ea2d0-465f-4e76-92d8-51e39a7f54e8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:18.755085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-439ea2d0-465f-4e76-92d8-51e39a7f54e8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:18.763333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-439ea2d0-465f-4e76-92d8-51e39a7f54e8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146581 Jul 28 20:21:18.763899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1184/2224] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:18 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:18.895293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1d206c0f-21c4-4839-b2ed-676f986e0dc8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:18.895847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1d206c0f-21c4-4839-b2ed-676f986e0dc8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:18.902235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d206c0f-21c4-4839-b2ed-676f986e0dc8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:18.902681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d206c0f-21c4-4839-b2ed-676f986e0dc8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:18.903426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d206c0f-21c4-4839-b2ed-676f986e0dc8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:18.903854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d206c0f-21c4-4839-b2ed-676f986e0dc8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:18.967490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1d206c0f-21c4-4839-b2ed-676f986e0dc8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:18.975951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1d206c0f-21c4-4839-b2ed-676f986e0dc8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084559 Jul 28 20:21:18.976501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1041/2225] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:19.374811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0fd8b44d-cdb8-4410-8a9d-5e92caa29f4f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:19.375411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0fd8b44d-cdb8-4410-8a9d-5e92caa29f4f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:19.381964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0fd8b44d-cdb8-4410-8a9d-5e92caa29f4f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:19.382411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0fd8b44d-cdb8-4410-8a9d-5e92caa29f4f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:19.383158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0fd8b44d-cdb8-4410-8a9d-5e92caa29f4f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:19.383587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0fd8b44d-cdb8-4410-8a9d-5e92caa29f4f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:19.511232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0fd8b44d-cdb8-4410-8a9d-5e92caa29f4f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:19.519674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0fd8b44d-cdb8-4410-8a9d-5e92caa29f4f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148734 Jul 28 20:21:19.520237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1185/2226] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:19 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:19.785743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-949d272e-be36-4a56-8238-0528b65a966c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:19.786305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-949d272e-be36-4a56-8238-0528b65a966c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:19.792293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-949d272e-be36-4a56-8238-0528b65a966c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:19.792776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-949d272e-be36-4a56-8238-0528b65a966c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:19.793534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-949d272e-be36-4a56-8238-0528b65a966c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:19.793967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-949d272e-be36-4a56-8238-0528b65a966c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:19.921439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-949d272e-be36-4a56-8238-0528b65a966c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:19.930056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-949d272e-be36-4a56-8238-0528b65a966c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148823 Jul 28 20:21:19.930616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1042/2227] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:19 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:19.997756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cf9d0a67-57c4-462c-9fb7-c88fd30ee19c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:19.998364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cf9d0a67-57c4-462c-9fb7-c88fd30ee19c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:20.005077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf9d0a67-57c4-462c-9fb7-c88fd30ee19c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:20.005554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf9d0a67-57c4-462c-9fb7-c88fd30ee19c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:20.006302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf9d0a67-57c4-462c-9fb7-c88fd30ee19c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:20.006729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf9d0a67-57c4-462c-9fb7-c88fd30ee19c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:20.070253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cf9d0a67-57c4-462c-9fb7-c88fd30ee19c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:20.078091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cf9d0a67-57c4-462c-9fb7-c88fd30ee19c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084219 Jul 28 20:21:20.078643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1186/2228] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:20.540807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1869041d-7454-48d2-8add-0811c2e9f467 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:20.541416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1869041d-7454-48d2-8add-0811c2e9f467 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:20.543411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:20.548823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1869041d-7454-48d2-8add-0811c2e9f467 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:20.549272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1869041d-7454-48d2-8add-0811c2e9f467 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:20.550021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1869041d-7454-48d2-8add-0811c2e9f467 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:20.550444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1869041d-7454-48d2-8add-0811c2e9f467 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:20.684838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1869041d-7454-48d2-8add-0811c2e9f467 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:20.693543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1869041d-7454-48d2-8add-0811c2e9f467 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.156604 Jul 28 20:21:20.694388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1043/2229] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:20 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:20.951684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9cfc54b4-4d5a-4a7d-8c00-49898ded83c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:20.952267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9cfc54b4-4d5a-4a7d-8c00-49898ded83c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:20.959333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9cfc54b4-4d5a-4a7d-8c00-49898ded83c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:20.959770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9cfc54b4-4d5a-4a7d-8c00-49898ded83c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:20.960511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9cfc54b4-4d5a-4a7d-8c00-49898ded83c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:20.960958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9cfc54b4-4d5a-4a7d-8c00-49898ded83c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:21.086861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9cfc54b4-4d5a-4a7d-8c00-49898ded83c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:21.094934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9cfc54b4-4d5a-4a7d-8c00-49898ded83c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147056 Jul 28 20:21:21.095643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1187/2230] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:20 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:21.099621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-186869be-dac4-4e52-ac3c-44fe1204305d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:21.100237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-186869be-dac4-4e52-ac3c-44fe1204305d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:21.106624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-186869be-dac4-4e52-ac3c-44fe1204305d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:21.107075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-186869be-dac4-4e52-ac3c-44fe1204305d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:21.107819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-186869be-dac4-4e52-ac3c-44fe1204305d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:21.108246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-186869be-dac4-4e52-ac3c-44fe1204305d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:21.172035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-186869be-dac4-4e52-ac3c-44fe1204305d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:21.180782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-186869be-dac4-4e52-ac3c-44fe1204305d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085492 Jul 28 20:21:21.181335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1044/2231] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:21.715040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7bafe878-52a8-4be3-97cd-b123c0964652 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:21.715565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7bafe878-52a8-4be3-97cd-b123c0964652 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:21.717470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:21.722935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bafe878-52a8-4be3-97cd-b123c0964652 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:21.723389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bafe878-52a8-4be3-97cd-b123c0964652 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:21.724167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bafe878-52a8-4be3-97cd-b123c0964652 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:21.724689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7bafe878-52a8-4be3-97cd-b123c0964652 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:21.857342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7bafe878-52a8-4be3-97cd-b123c0964652 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:21.866088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7bafe878-52a8-4be3-97cd-b123c0964652 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.155021 Jul 28 20:21:21.866645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1188/2232] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:21 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:22.117072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7e6f0775-f723-4712-8d8d-a21013abdb99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:22.117682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7e6f0775-f723-4712-8d8d-a21013abdb99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:22.124101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e6f0775-f723-4712-8d8d-a21013abdb99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:22.124568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e6f0775-f723-4712-8d8d-a21013abdb99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:22.125412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e6f0775-f723-4712-8d8d-a21013abdb99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:22.125837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e6f0775-f723-4712-8d8d-a21013abdb99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:22.202254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-717faa71-84a3-4f55-b4c7-4e52fd96eed1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:22.202874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-717faa71-84a3-4f55-b4c7-4e52fd96eed1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:22.210165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-717faa71-84a3-4f55-b4c7-4e52fd96eed1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:22.210614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-717faa71-84a3-4f55-b4c7-4e52fd96eed1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:22.211371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-717faa71-84a3-4f55-b4c7-4e52fd96eed1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:22.211799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-717faa71-84a3-4f55-b4c7-4e52fd96eed1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:22.263762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7e6f0775-f723-4712-8d8d-a21013abdb99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:22.272474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7e6f0775-f723-4712-8d8d-a21013abdb99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.159183 Jul 28 20:21:22.273065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1045/2233] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:22 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:22.283392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-717faa71-84a3-4f55-b4c7-4e52fd96eed1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:22.288004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:22.293633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-717faa71-84a3-4f55-b4c7-4e52fd96eed1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.095300 Jul 28 20:21:22.294187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1189/2234] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:22 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:22.888421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-80d8a969-9508-4022-8f80-4a0aadadfbf4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:22.889063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-80d8a969-9508-4022-8f80-4a0aadadfbf4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:22.895619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80d8a969-9508-4022-8f80-4a0aadadfbf4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:22.896058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80d8a969-9508-4022-8f80-4a0aadadfbf4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:22.896834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80d8a969-9508-4022-8f80-4a0aadadfbf4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:22.897264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80d8a969-9508-4022-8f80-4a0aadadfbf4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:23.024882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-80d8a969-9508-4022-8f80-4a0aadadfbf4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:23.033213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-80d8a969-9508-4022-8f80-4a0aadadfbf4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149041 Jul 28 20:21:23.034261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1046/2235] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:22 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:23.294539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4cb150ea-1f07-456c-a496-947d8f271d7a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:23.295149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4cb150ea-1f07-456c-a496-947d8f271d7a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:23.301963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4cb150ea-1f07-456c-a496-947d8f271d7a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:23.302437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4cb150ea-1f07-456c-a496-947d8f271d7a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:23.303190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4cb150ea-1f07-456c-a496-947d8f271d7a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:23.303624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4cb150ea-1f07-456c-a496-947d8f271d7a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:23.314494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-60405292-194e-4679-9d6c-9c597ff44052 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:23.315113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-60405292-194e-4679-9d6c-9c597ff44052 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:23.322341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60405292-194e-4679-9d6c-9c597ff44052 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:23.322790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60405292-194e-4679-9d6c-9c597ff44052 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:23.323550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60405292-194e-4679-9d6c-9c597ff44052 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:23.323990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60405292-194e-4679-9d6c-9c597ff44052 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:23.328060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:23.404094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-60405292-194e-4679-9d6c-9c597ff44052 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:23.413374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-60405292-194e-4679-9d6c-9c597ff44052 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.102944 Jul 28 20:21:23.413935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1047/2236] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:23.463617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4cb150ea-1f07-456c-a496-947d8f271d7a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:23.471591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4cb150ea-1f07-456c-a496-947d8f271d7a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.180881 Jul 28 20:21:23.472147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1190/2237] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:23 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:24.055198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-830355d8-118f-4987-aac9-35ca393e5d78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:24.055806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-830355d8-118f-4987-aac9-35ca393e5d78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:24.062007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-830355d8-118f-4987-aac9-35ca393e5d78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:24.062454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-830355d8-118f-4987-aac9-35ca393e5d78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:24.063236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-830355d8-118f-4987-aac9-35ca393e5d78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:24.063694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-830355d8-118f-4987-aac9-35ca393e5d78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:24.192098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-830355d8-118f-4987-aac9-35ca393e5d78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:24.200147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-830355d8-118f-4987-aac9-35ca393e5d78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149151 Jul 28 20:21:24.200729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1048/2238] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:24 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:24.434807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-76b3cb95-78f6-4c2f-91a1-f09d351ff55f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:24.435487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-76b3cb95-78f6-4c2f-91a1-f09d351ff55f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:24.442765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76b3cb95-78f6-4c2f-91a1-f09d351ff55f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:24.443213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76b3cb95-78f6-4c2f-91a1-f09d351ff55f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:24.443966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76b3cb95-78f6-4c2f-91a1-f09d351ff55f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:24.444419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76b3cb95-78f6-4c2f-91a1-f09d351ff55f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:24.492847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ee0532bd-8b14-4158-947e-f0cf98a8c645 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:24.493603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ee0532bd-8b14-4158-947e-f0cf98a8c645 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:24.500053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee0532bd-8b14-4158-947e-f0cf98a8c645 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:24.500498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee0532bd-8b14-4158-947e-f0cf98a8c645 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:24.501275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee0532bd-8b14-4158-947e-f0cf98a8c645 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:24.501727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee0532bd-8b14-4158-947e-f0cf98a8c645 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:24.506825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-76b3cb95-78f6-4c2f-91a1-f09d351ff55f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:24.514739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-76b3cb95-78f6-4c2f-91a1-f09d351ff55f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083951 Jul 28 20:21:24.515296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1191/2239] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:24.633296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ee0532bd-8b14-4158-947e-f0cf98a8c645 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:24.641175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ee0532bd-8b14-4158-947e-f0cf98a8c645 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152274 Jul 28 20:21:24.641733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1049/2240] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:25.221959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b64f195f-8cfc-4c33-bcd4-0822b8459012 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:25.222567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b64f195f-8cfc-4c33-bcd4-0822b8459012 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:25.228517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b64f195f-8cfc-4c33-bcd4-0822b8459012 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:25.228995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b64f195f-8cfc-4c33-bcd4-0822b8459012 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:25.229742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b64f195f-8cfc-4c33-bcd4-0822b8459012 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:25.230170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b64f195f-8cfc-4c33-bcd4-0822b8459012 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:25.356865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b64f195f-8cfc-4c33-bcd4-0822b8459012 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:25.365453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b64f195f-8cfc-4c33-bcd4-0822b8459012 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147326 Jul 28 20:21:25.366003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1192/2241] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:25 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:25.537036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f59b88f3-1bee-4120-8a59-49e73ea1ab31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:25.537658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f59b88f3-1bee-4120-8a59-49e73ea1ab31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:25.544081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f59b88f3-1bee-4120-8a59-49e73ea1ab31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:25.544532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f59b88f3-1bee-4120-8a59-49e73ea1ab31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:25.545326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f59b88f3-1bee-4120-8a59-49e73ea1ab31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:25.545761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f59b88f3-1bee-4120-8a59-49e73ea1ab31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:25.606135 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f59b88f3-1bee-4120-8a59-49e73ea1ab31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:25.614078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f59b88f3-1bee-4120-8a59-49e73ea1ab31 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081774 Jul 28 20:21:25.614638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1050/2242] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:25.664003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ff6ff4d0-903c-47d8-8089-b53dc2f5b7c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:25.664633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ff6ff4d0-903c-47d8-8089-b53dc2f5b7c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:25.671105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff6ff4d0-903c-47d8-8089-b53dc2f5b7c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:25.671569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff6ff4d0-903c-47d8-8089-b53dc2f5b7c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:25.672286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff6ff4d0-903c-47d8-8089-b53dc2f5b7c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:25.672747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff6ff4d0-903c-47d8-8089-b53dc2f5b7c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:25.804262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ff6ff4d0-903c-47d8-8089-b53dc2f5b7c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:25.812105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ff6ff4d0-903c-47d8-8089-b53dc2f5b7c8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151970 Jul 28 20:21:25.812681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1193/2243] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:26.387024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-93923861-17c1-4cea-933b-08e04b7a8c9e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:26.387638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-93923861-17c1-4cea-933b-08e04b7a8c9e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:26.394388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-93923861-17c1-4cea-933b-08e04b7a8c9e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:26.394833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-93923861-17c1-4cea-933b-08e04b7a8c9e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:26.395588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-93923861-17c1-4cea-933b-08e04b7a8c9e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:26.396024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-93923861-17c1-4cea-933b-08e04b7a8c9e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:26.522984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-93923861-17c1-4cea-933b-08e04b7a8c9e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:26.531048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-93923861-17c1-4cea-933b-08e04b7a8c9e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147890 Jul 28 20:21:26.531764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1051/2244] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:26 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:26.635114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c8755d9a-a8b6-469d-830d-cb0344d773d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:26.635723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c8755d9a-a8b6-469d-830d-cb0344d773d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:26.641725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8755d9a-a8b6-469d-830d-cb0344d773d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:26.642165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8755d9a-a8b6-469d-830d-cb0344d773d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:26.642903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8755d9a-a8b6-469d-830d-cb0344d773d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:26.644038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8755d9a-a8b6-469d-830d-cb0344d773d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:26.708925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c8755d9a-a8b6-469d-830d-cb0344d773d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:26.718017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c8755d9a-a8b6-469d-830d-cb0344d773d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086623 Jul 28 20:21:26.718710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1194/2245] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:26.834625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-39f45a4b-c776-409b-9c33-44ef9a8ffe1c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:26.835234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-39f45a4b-c776-409b-9c33-44ef9a8ffe1c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:26.841757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-39f45a4b-c776-409b-9c33-44ef9a8ffe1c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:26.842199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-39f45a4b-c776-409b-9c33-44ef9a8ffe1c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:26.842938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-39f45a4b-c776-409b-9c33-44ef9a8ffe1c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:26.843405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-39f45a4b-c776-409b-9c33-44ef9a8ffe1c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:26.977852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-39f45a4b-c776-409b-9c33-44ef9a8ffe1c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:26.985897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-39f45a4b-c776-409b-9c33-44ef9a8ffe1c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.156068 Jul 28 20:21:26.986396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1052/2246] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:27.552858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f4d3b502-c871-41d3-8ca3-079a5b1003bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:27.553460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f4d3b502-c871-41d3-8ca3-079a5b1003bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:27.559418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4d3b502-c871-41d3-8ca3-079a5b1003bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:27.559858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4d3b502-c871-41d3-8ca3-079a5b1003bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:27.560621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4d3b502-c871-41d3-8ca3-079a5b1003bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:27.561047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4d3b502-c871-41d3-8ca3-079a5b1003bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:27.688431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f4d3b502-c871-41d3-8ca3-079a5b1003bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:27.696328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f4d3b502-c871-41d3-8ca3-079a5b1003bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148044 Jul 28 20:21:27.696913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1195/2247] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:27 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:27.738646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d7e5aacb-6eac-4639-80ec-938c25123d66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:27.739282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d7e5aacb-6eac-4639-80ec-938c25123d66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:27.745399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7e5aacb-6eac-4639-80ec-938c25123d66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:27.745841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7e5aacb-6eac-4639-80ec-938c25123d66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:27.746580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7e5aacb-6eac-4639-80ec-938c25123d66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:27.747006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7e5aacb-6eac-4639-80ec-938c25123d66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:27.810634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d7e5aacb-6eac-4639-80ec-938c25123d66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:27.818949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d7e5aacb-6eac-4639-80ec-938c25123d66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084280 Jul 28 20:21:27.819500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1053/2248] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:27 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:28.007125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ccf56d70-719a-4b61-bbe7-36e3b89c7aec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:28.007730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ccf56d70-719a-4b61-bbe7-36e3b89c7aec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:28.013725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccf56d70-719a-4b61-bbe7-36e3b89c7aec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:28.014167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccf56d70-719a-4b61-bbe7-36e3b89c7aec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:28.014905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccf56d70-719a-4b61-bbe7-36e3b89c7aec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:28.015328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ccf56d70-719a-4b61-bbe7-36e3b89c7aec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:28.142430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ccf56d70-719a-4b61-bbe7-36e3b89c7aec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:28.151205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ccf56d70-719a-4b61-bbe7-36e3b89c7aec tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148579 Jul 28 20:21:28.151758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1196/2249] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:28 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:28.717576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-db7b3600-a1a8-4890-b49d-aef9ce7c7475 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:28.718187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-db7b3600-a1a8-4890-b49d-aef9ce7c7475 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:28.724722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db7b3600-a1a8-4890-b49d-aef9ce7c7475 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:28.725165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db7b3600-a1a8-4890-b49d-aef9ce7c7475 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:28.725911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db7b3600-a1a8-4890-b49d-aef9ce7c7475 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:28.726338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db7b3600-a1a8-4890-b49d-aef9ce7c7475 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:28.840582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f5b56e86-1ed4-4c94-bca6-5639bd5921be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:28.841353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f5b56e86-1ed4-4c94-bca6-5639bd5921be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:28.848270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5b56e86-1ed4-4c94-bca6-5639bd5921be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:28.848759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5b56e86-1ed4-4c94-bca6-5639bd5921be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:28.849521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5b56e86-1ed4-4c94-bca6-5639bd5921be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:28.849957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f5b56e86-1ed4-4c94-bca6-5639bd5921be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:28.857341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-db7b3600-a1a8-4890-b49d-aef9ce7c7475 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:28.865352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-db7b3600-a1a8-4890-b49d-aef9ce7c7475 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151582 Jul 28 20:21:28.865915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1054/2250] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:28 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:28.919835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f5b56e86-1ed4-4c94-bca6-5639bd5921be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:28.928508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f5b56e86-1ed4-4c94-bca6-5639bd5921be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.091865 Jul 28 20:21:28.929101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1197/2251] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:29.173121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-58302198-cab0-42f7-847a-23d03b93bf75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:29.173740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-58302198-cab0-42f7-847a-23d03b93bf75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:29.179949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58302198-cab0-42f7-847a-23d03b93bf75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:29.180391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58302198-cab0-42f7-847a-23d03b93bf75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:29.181255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58302198-cab0-42f7-847a-23d03b93bf75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:29.181686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58302198-cab0-42f7-847a-23d03b93bf75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:29.308821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-58302198-cab0-42f7-847a-23d03b93bf75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:29.316817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-58302198-cab0-42f7-847a-23d03b93bf75 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147462 Jul 28 20:21:29.317378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1055/2252] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:29 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:29.886829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-29900dff-5a6e-44e4-b970-5d1c90d18ad5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:29.887432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-29900dff-5a6e-44e4-b970-5d1c90d18ad5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:29.894849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29900dff-5a6e-44e4-b970-5d1c90d18ad5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:29.895339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29900dff-5a6e-44e4-b970-5d1c90d18ad5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:29.896214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29900dff-5a6e-44e4-b970-5d1c90d18ad5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:29.896746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29900dff-5a6e-44e4-b970-5d1c90d18ad5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:29.951074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-14bfe761-52e0-4565-bdd1-ee8650ad4554 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:29.951684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-14bfe761-52e0-4565-bdd1-ee8650ad4554 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:29.958880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14bfe761-52e0-4565-bdd1-ee8650ad4554 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:29.959331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14bfe761-52e0-4565-bdd1-ee8650ad4554 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:29.960088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14bfe761-52e0-4565-bdd1-ee8650ad4554 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:29.960525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14bfe761-52e0-4565-bdd1-ee8650ad4554 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:30.036506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-14bfe761-52e0-4565-bdd1-ee8650ad4554 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:30.044445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-14bfe761-52e0-4565-bdd1-ee8650ad4554 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.097275 Jul 28 20:21:30.045109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1056/2253] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:30.053128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-29900dff-5a6e-44e4-b970-5d1c90d18ad5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:30.061129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-29900dff-5a6e-44e4-b970-5d1c90d18ad5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.178134 Jul 28 20:21:30.061690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1198/2254] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:29 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:30.338055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-523c92c0-55f9-4fdb-be22-cb0f97e78d49 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:30.338666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-523c92c0-55f9-4fdb-be22-cb0f97e78d49 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:30.344725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-523c92c0-55f9-4fdb-be22-cb0f97e78d49 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:30.345176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-523c92c0-55f9-4fdb-be22-cb0f97e78d49 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:30.345926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-523c92c0-55f9-4fdb-be22-cb0f97e78d49 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:30.346413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-523c92c0-55f9-4fdb-be22-cb0f97e78d49 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:30.478419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-523c92c0-55f9-4fdb-be22-cb0f97e78d49 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:30.486361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-523c92c0-55f9-4fdb-be22-cb0f97e78d49 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152199 Jul 28 20:21:30.487075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1057/2255] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:30 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:31.066145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ddd5525b-1f21-4a2c-989e-52e718fe29ef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:31.066742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ddd5525b-1f21-4a2c-989e-52e718fe29ef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:31.073194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddd5525b-1f21-4a2c-989e-52e718fe29ef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:31.073638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddd5525b-1f21-4a2c-989e-52e718fe29ef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:31.074381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddd5525b-1f21-4a2c-989e-52e718fe29ef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:31.074806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddd5525b-1f21-4a2c-989e-52e718fe29ef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:31.082853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1986dc62-c4f6-4f8f-ba78-115b6fa2ce54 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:31.083469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1986dc62-c4f6-4f8f-ba78-115b6fa2ce54 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:31.089523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1986dc62-c4f6-4f8f-ba78-115b6fa2ce54 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:31.089979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1986dc62-c4f6-4f8f-ba78-115b6fa2ce54 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:31.090735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1986dc62-c4f6-4f8f-ba78-115b6fa2ce54 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:31.091166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1986dc62-c4f6-4f8f-ba78-115b6fa2ce54 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:31.143896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ddd5525b-1f21-4a2c-989e-52e718fe29ef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:31.151898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ddd5525b-1f21-4a2c-989e-52e718fe29ef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.090156 Jul 28 20:21:31.152463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1199/2256] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:31.235648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1986dc62-c4f6-4f8f-ba78-115b6fa2ce54 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:31.244507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1986dc62-c4f6-4f8f-ba78-115b6fa2ce54 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.166532 Jul 28 20:21:31.245087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1058/2257] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:31 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:31.507497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fd7c7985-29b4-4c22-8408-e7ef8217a36f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:31.508105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fd7c7985-29b4-4c22-8408-e7ef8217a36f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:31.514162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd7c7985-29b4-4c22-8408-e7ef8217a36f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:31.514606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd7c7985-29b4-4c22-8408-e7ef8217a36f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:31.515355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd7c7985-29b4-4c22-8408-e7ef8217a36f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:31.515790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fd7c7985-29b4-4c22-8408-e7ef8217a36f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:31.641732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fd7c7985-29b4-4c22-8408-e7ef8217a36f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:31.650224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fd7c7985-29b4-4c22-8408-e7ef8217a36f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146610 Jul 28 20:21:31.650797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1200/2258] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:32.174617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-900e8eea-8ed6-4d1e-8b63-87170f92e4d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:32.175218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-900e8eea-8ed6-4d1e-8b63-87170f92e4d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:32.181660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-900e8eea-8ed6-4d1e-8b63-87170f92e4d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:32.182101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-900e8eea-8ed6-4d1e-8b63-87170f92e4d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:32.182845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-900e8eea-8ed6-4d1e-8b63-87170f92e4d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:32.183273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-900e8eea-8ed6-4d1e-8b63-87170f92e4d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:32.244098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-900e8eea-8ed6-4d1e-8b63-87170f92e4d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:32.252480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-900e8eea-8ed6-4d1e-8b63-87170f92e4d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081511 Jul 28 20:21:32.253020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1059/2259] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:32.265755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b183ff22-22ef-47c1-9edf-807d4b7d5ed9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:32.266365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b183ff22-22ef-47c1-9edf-807d4b7d5ed9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:32.273390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b183ff22-22ef-47c1-9edf-807d4b7d5ed9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:32.273831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b183ff22-22ef-47c1-9edf-807d4b7d5ed9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:32.274567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b183ff22-22ef-47c1-9edf-807d4b7d5ed9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:32.274993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b183ff22-22ef-47c1-9edf-807d4b7d5ed9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:32.405251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b183ff22-22ef-47c1-9edf-807d4b7d5ed9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:32.413691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b183ff22-22ef-47c1-9edf-807d4b7d5ed9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151672 Jul 28 20:21:32.414244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1201/2260] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:32 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:32.672188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0f77c6b7-6afa-4b5b-8b78-2cbb635fb133 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:32.672840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0f77c6b7-6afa-4b5b-8b78-2cbb635fb133 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:32.678923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f77c6b7-6afa-4b5b-8b78-2cbb635fb133 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:32.679372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f77c6b7-6afa-4b5b-8b78-2cbb635fb133 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:32.680123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f77c6b7-6afa-4b5b-8b78-2cbb635fb133 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:32.680573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f77c6b7-6afa-4b5b-8b78-2cbb635fb133 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:32.807458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0f77c6b7-6afa-4b5b-8b78-2cbb635fb133 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:32.815581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0f77c6b7-6afa-4b5b-8b78-2cbb635fb133 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147206 Jul 28 20:21:32.816133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1060/2261] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:33.273361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bf15a08f-a03f-4cca-8f41-a20e9ffc6c59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:33.273976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bf15a08f-a03f-4cca-8f41-a20e9ffc6c59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:33.280285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf15a08f-a03f-4cca-8f41-a20e9ffc6c59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:33.280778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf15a08f-a03f-4cca-8f41-a20e9ffc6c59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:33.281534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf15a08f-a03f-4cca-8f41-a20e9ffc6c59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:33.281968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf15a08f-a03f-4cca-8f41-a20e9ffc6c59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:33.345770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bf15a08f-a03f-4cca-8f41-a20e9ffc6c59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:33.354349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bf15a08f-a03f-4cca-8f41-a20e9ffc6c59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085034 Jul 28 20:21:33.354910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1202/2262] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:33.435029 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e34553a6-38a8-46bd-939b-0038446803f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:33.435560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e34553a6-38a8-46bd-939b-0038446803f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:33.442131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34553a6-38a8-46bd-939b-0038446803f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:33.442574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34553a6-38a8-46bd-939b-0038446803f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:33.443351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34553a6-38a8-46bd-939b-0038446803f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:33.443786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e34553a6-38a8-46bd-939b-0038446803f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:33.570456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e34553a6-38a8-46bd-939b-0038446803f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:33.578374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e34553a6-38a8-46bd-939b-0038446803f3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147286 Jul 28 20:21:33.578927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1061/2263] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:33 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:33.837294 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5c9af4eb-1625-4a57-a4cf-a1d7472f3400 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:33.837898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5c9af4eb-1625-4a57-a4cf-a1d7472f3400 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:33.843915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c9af4eb-1625-4a57-a4cf-a1d7472f3400 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:33.844353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c9af4eb-1625-4a57-a4cf-a1d7472f3400 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:33.845122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c9af4eb-1625-4a57-a4cf-a1d7472f3400 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:33.845548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c9af4eb-1625-4a57-a4cf-a1d7472f3400 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:33.971692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5c9af4eb-1625-4a57-a4cf-a1d7472f3400 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:33.979800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5c9af4eb-1625-4a57-a4cf-a1d7472f3400 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146431 Jul 28 20:21:33.980355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1203/2264] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:34.375823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b6cb6f3f-579f-4129-9478-4cc733732851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:34.376460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b6cb6f3f-579f-4129-9478-4cc733732851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:34.383098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6cb6f3f-579f-4129-9478-4cc733732851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:34.383535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6cb6f3f-579f-4129-9478-4cc733732851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:34.384277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6cb6f3f-579f-4129-9478-4cc733732851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:34.384737 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6cb6f3f-579f-4129-9478-4cc733732851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:34.448633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b6cb6f3f-579f-4129-9478-4cc733732851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:34.456904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b6cb6f3f-579f-4129-9478-4cc733732851 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084932 Jul 28 20:21:34.457439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1062/2265] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:34.600187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cfc2428a-419b-4b86-8794-2dd0cd462f04 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:34.600809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cfc2428a-419b-4b86-8794-2dd0cd462f04 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:34.607294 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfc2428a-419b-4b86-8794-2dd0cd462f04 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:34.607741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfc2428a-419b-4b86-8794-2dd0cd462f04 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:34.608489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfc2428a-419b-4b86-8794-2dd0cd462f04 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:34.608950 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfc2428a-419b-4b86-8794-2dd0cd462f04 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:34.735211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cfc2428a-419b-4b86-8794-2dd0cd462f04 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:34.743196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cfc2428a-419b-4b86-8794-2dd0cd462f04 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147601 Jul 28 20:21:34.743784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1204/2266] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:34 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:35.001328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ced833ba-3820-44ac-8f4f-95a70b159298 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:35.001865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ced833ba-3820-44ac-8f4f-95a70b159298 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:35.007885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ced833ba-3820-44ac-8f4f-95a70b159298 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:35.008330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ced833ba-3820-44ac-8f4f-95a70b159298 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:35.009109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ced833ba-3820-44ac-8f4f-95a70b159298 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:35.009544 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ced833ba-3820-44ac-8f4f-95a70b159298 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:35.134764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ced833ba-3820-44ac-8f4f-95a70b159298 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:35.138128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:35.143990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ced833ba-3820-44ac-8f4f-95a70b159298 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146494 Jul 28 20:21:35.144571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1063/2267] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:34 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:35.477672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-df0df821-9474-4979-8cfb-095e83c04d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:35.478304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-df0df821-9474-4979-8cfb-095e83c04d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:35.484220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df0df821-9474-4979-8cfb-095e83c04d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:35.484688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df0df821-9474-4979-8cfb-095e83c04d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:35.485428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df0df821-9474-4979-8cfb-095e83c04d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:35.485849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df0df821-9474-4979-8cfb-095e83c04d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:35.548827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-df0df821-9474-4979-8cfb-095e83c04d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:35.557299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-df0df821-9474-4979-8cfb-095e83c04d74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083536 Jul 28 20:21:35.557858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1205/2268] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:35.763928 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1ec8d18f-e966-4d2e-ad52-3f0ba114c7a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:35.764574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1ec8d18f-e966-4d2e-ad52-3f0ba114c7a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:35.771732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ec8d18f-e966-4d2e-ad52-3f0ba114c7a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:35.772171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ec8d18f-e966-4d2e-ad52-3f0ba114c7a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:35.773014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ec8d18f-e966-4d2e-ad52-3f0ba114c7a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:35.773446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ec8d18f-e966-4d2e-ad52-3f0ba114c7a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:35.902218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1ec8d18f-e966-4d2e-ad52-3f0ba114c7a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:35.910345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1ec8d18f-e966-4d2e-ad52-3f0ba114c7a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150356 Jul 28 20:21:35.910902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1064/2269] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:35 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:36.165784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-16f9f7e8-2638-49e0-b9e0-d2496d0574f7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:36.166415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-16f9f7e8-2638-49e0-b9e0-d2496d0574f7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:36.172921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16f9f7e8-2638-49e0-b9e0-d2496d0574f7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:36.173348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16f9f7e8-2638-49e0-b9e0-d2496d0574f7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:36.174426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16f9f7e8-2638-49e0-b9e0-d2496d0574f7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:36.175027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16f9f7e8-2638-49e0-b9e0-d2496d0574f7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:36.194924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:36.313952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-16f9f7e8-2638-49e0-b9e0-d2496d0574f7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:36.322365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-16f9f7e8-2638-49e0-b9e0-d2496d0574f7 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.160587 Jul 28 20:21:36.322913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1206/2270] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:36 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:36.579307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c9f6775e-a4da-4589-8f41-86a367ddfb61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:36.579918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c9f6775e-a4da-4589-8f41-86a367ddfb61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:36.585983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9f6775e-a4da-4589-8f41-86a367ddfb61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:36.586431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9f6775e-a4da-4589-8f41-86a367ddfb61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:36.587182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9f6775e-a4da-4589-8f41-86a367ddfb61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:36.587613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c9f6775e-a4da-4589-8f41-86a367ddfb61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:36.650103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c9f6775e-a4da-4589-8f41-86a367ddfb61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:36.658196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c9f6775e-a4da-4589-8f41-86a367ddfb61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082730 Jul 28 20:21:36.658824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1065/2271] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:36 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:36.931315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71987350-ccee-4201-bb27-428d17acf462 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:36.931870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-71987350-ccee-4201-bb27-428d17acf462 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:36.937906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71987350-ccee-4201-bb27-428d17acf462 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:36.938342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71987350-ccee-4201-bb27-428d17acf462 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:36.939078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71987350-ccee-4201-bb27-428d17acf462 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:36.939500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71987350-ccee-4201-bb27-428d17acf462 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:37.071949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-71987350-ccee-4201-bb27-428d17acf462 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:37.079885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-71987350-ccee-4201-bb27-428d17acf462 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152571 Jul 28 20:21:37.080910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1207/2272] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:36 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:37.344138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-59725762-79ee-43a5-ba1c-93ed6fc7bc0b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:37.344777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-59725762-79ee-43a5-ba1c-93ed6fc7bc0b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:37.351649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59725762-79ee-43a5-ba1c-93ed6fc7bc0b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:37.352099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59725762-79ee-43a5-ba1c-93ed6fc7bc0b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:37.352877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59725762-79ee-43a5-ba1c-93ed6fc7bc0b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:37.353315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59725762-79ee-43a5-ba1c-93ed6fc7bc0b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:37.480156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-59725762-79ee-43a5-ba1c-93ed6fc7bc0b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:37.488825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-59725762-79ee-43a5-ba1c-93ed6fc7bc0b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148426 Jul 28 20:21:37.489389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1066/2273] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:37 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:37.679312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-20431305-d2c9-456b-ad5d-c3c0e55d1960 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:37.679929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-20431305-d2c9-456b-ad5d-c3c0e55d1960 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:37.686454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20431305-d2c9-456b-ad5d-c3c0e55d1960 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:37.686905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20431305-d2c9-456b-ad5d-c3c0e55d1960 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:37.687656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20431305-d2c9-456b-ad5d-c3c0e55d1960 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:37.688092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20431305-d2c9-456b-ad5d-c3c0e55d1960 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:37.750602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-20431305-d2c9-456b-ad5d-c3c0e55d1960 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:37.759109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-20431305-d2c9-456b-ad5d-c3c0e55d1960 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083609 Jul 28 20:21:37.759677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1208/2274] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:38.100486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-23a06dac-f184-4693-81e3-e0b449aa6921 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:38.101122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-23a06dac-f184-4693-81e3-e0b449aa6921 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:38.107112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-23a06dac-f184-4693-81e3-e0b449aa6921 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:38.107550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-23a06dac-f184-4693-81e3-e0b449aa6921 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:38.108296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-23a06dac-f184-4693-81e3-e0b449aa6921 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:38.108800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-23a06dac-f184-4693-81e3-e0b449aa6921 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:38.237955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-23a06dac-f184-4693-81e3-e0b449aa6921 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:38.245900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-23a06dac-f184-4693-81e3-e0b449aa6921 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149348 Jul 28 20:21:38.246458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1067/2275] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:38 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:38.511223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cea7afb8-b0cf-48fa-9224-2f694cdf7929 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:38.511753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cea7afb8-b0cf-48fa-9224-2f694cdf7929 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:38.517803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cea7afb8-b0cf-48fa-9224-2f694cdf7929 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:38.518441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cea7afb8-b0cf-48fa-9224-2f694cdf7929 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:38.519228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cea7afb8-b0cf-48fa-9224-2f694cdf7929 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:38.519659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cea7afb8-b0cf-48fa-9224-2f694cdf7929 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:38.647794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cea7afb8-b0cf-48fa-9224-2f694cdf7929 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:38.656018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cea7afb8-b0cf-48fa-9224-2f694cdf7929 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148699 Jul 28 20:21:38.656589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1209/2276] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:38.780930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7b4bc95a-32ac-494f-b799-a9385099440d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:38.781456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7b4bc95a-32ac-494f-b799-a9385099440d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:38.788476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b4bc95a-32ac-494f-b799-a9385099440d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:38.788958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b4bc95a-32ac-494f-b799-a9385099440d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:38.789716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b4bc95a-32ac-494f-b799-a9385099440d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:38.790151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b4bc95a-32ac-494f-b799-a9385099440d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:38.853909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7b4bc95a-32ac-494f-b799-a9385099440d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:38.862116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7b4bc95a-32ac-494f-b799-a9385099440d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085251 Jul 28 20:21:38.862680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1068/2277] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:39.267891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-946b989d-eec1-429d-a014-8f2ce152a0ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:39.268841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-946b989d-eec1-429d-a014-8f2ce152a0ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:39.274986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-946b989d-eec1-429d-a014-8f2ce152a0ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:39.275436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-946b989d-eec1-429d-a014-8f2ce152a0ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:39.276186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-946b989d-eec1-429d-a014-8f2ce152a0ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:39.276647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-946b989d-eec1-429d-a014-8f2ce152a0ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:39.403179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-946b989d-eec1-429d-a014-8f2ce152a0ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:39.412850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-946b989d-eec1-429d-a014-8f2ce152a0ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148878 Jul 28 20:21:39.413410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1210/2278] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:39 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:39.677873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b6d94eba-4cd0-4150-81a5-f9873cf96fe0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:39.678486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b6d94eba-4cd0-4150-81a5-f9873cf96fe0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:39.684492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6d94eba-4cd0-4150-81a5-f9873cf96fe0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:39.684973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6d94eba-4cd0-4150-81a5-f9873cf96fe0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:39.685727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6d94eba-4cd0-4150-81a5-f9873cf96fe0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:39.686159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6d94eba-4cd0-4150-81a5-f9873cf96fe0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:39.813090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b6d94eba-4cd0-4150-81a5-f9873cf96fe0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:39.821798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b6d94eba-4cd0-4150-81a5-f9873cf96fe0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147996 Jul 28 20:21:39.822554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1069/2279] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:39 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:39.883386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5870dd68-b49b-45d2-8a23-c2f81617d086 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:39.883991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5870dd68-b49b-45d2-8a23-c2f81617d086 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:39.890008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5870dd68-b49b-45d2-8a23-c2f81617d086 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:39.890444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5870dd68-b49b-45d2-8a23-c2f81617d086 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:39.891183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5870dd68-b49b-45d2-8a23-c2f81617d086 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:39.891613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5870dd68-b49b-45d2-8a23-c2f81617d086 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:39.955780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5870dd68-b49b-45d2-8a23-c2f81617d086 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:39.963911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5870dd68-b49b-45d2-8a23-c2f81617d086 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084696 Jul 28 20:21:39.964463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1211/2280] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:40.433609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-79fa32c6-f139-41b1-9af3-83ecec5ec132 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:40.434215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-79fa32c6-f139-41b1-9af3-83ecec5ec132 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:40.441142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79fa32c6-f139-41b1-9af3-83ecec5ec132 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:40.441586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79fa32c6-f139-41b1-9af3-83ecec5ec132 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:40.442332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79fa32c6-f139-41b1-9af3-83ecec5ec132 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:40.442778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79fa32c6-f139-41b1-9af3-83ecec5ec132 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:40.572270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-79fa32c6-f139-41b1-9af3-83ecec5ec132 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:40.580850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-79fa32c6-f139-41b1-9af3-83ecec5ec132 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150473 Jul 28 20:21:40.581626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1070/2281] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:40 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:40.843212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3df31f88-83e9-43fe-8522-072f98f153f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:40.843778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3df31f88-83e9-43fe-8522-072f98f153f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:40.850712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3df31f88-83e9-43fe-8522-072f98f153f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:40.851159 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3df31f88-83e9-43fe-8522-072f98f153f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:40.851902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3df31f88-83e9-43fe-8522-072f98f153f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:40.852329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3df31f88-83e9-43fe-8522-072f98f153f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:40.978318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3df31f88-83e9-43fe-8522-072f98f153f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:40.984909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-077bba85-92bb-45b2-9a2e-4ee33768a477 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:40.985655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-077bba85-92bb-45b2-9a2e-4ee33768a477 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:40.987308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3df31f88-83e9-43fe-8522-072f98f153f9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147332 Jul 28 20:21:40.988268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1212/2282] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:41.001581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-077bba85-92bb-45b2-9a2e-4ee33768a477 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:41.002171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-077bba85-92bb-45b2-9a2e-4ee33768a477 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:41.002989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-077bba85-92bb-45b2-9a2e-4ee33768a477 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:41.003424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-077bba85-92bb-45b2-9a2e-4ee33768a477 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:41.067050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-077bba85-92bb-45b2-9a2e-4ee33768a477 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:41.074986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-077bba85-92bb-45b2-9a2e-4ee33768a477 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.094012 Jul 28 20:21:41.075546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1071/2283] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:41.602238 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-555eae2d-11e9-48c7-94f5-bd854f07e853 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:41.602850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-555eae2d-11e9-48c7-94f5-bd854f07e853 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:41.608990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-555eae2d-11e9-48c7-94f5-bd854f07e853 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:41.609433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-555eae2d-11e9-48c7-94f5-bd854f07e853 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:41.610181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-555eae2d-11e9-48c7-94f5-bd854f07e853 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:41.610610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-555eae2d-11e9-48c7-94f5-bd854f07e853 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:41.736407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-555eae2d-11e9-48c7-94f5-bd854f07e853 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:41.744337 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-555eae2d-11e9-48c7-94f5-bd854f07e853 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.145930 Jul 28 20:21:41.744919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1213/2284] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:41 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:42.009336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f1bcc6f1-eb72-4cbb-b613-2295432c6635 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:42.009885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f1bcc6f1-eb72-4cbb-b613-2295432c6635 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:42.016504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1bcc6f1-eb72-4cbb-b613-2295432c6635 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:42.016979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1bcc6f1-eb72-4cbb-b613-2295432c6635 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:42.017981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1bcc6f1-eb72-4cbb-b613-2295432c6635 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:42.018497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f1bcc6f1-eb72-4cbb-b613-2295432c6635 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:42.098155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-28773f2d-a8f9-460c-b075-48da00e83f78 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:42.098904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-28773f2d-a8f9-460c-b075-48da00e83f78 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:42.105418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28773f2d-a8f9-460c-b075-48da00e83f78 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:42.105864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28773f2d-a8f9-460c-b075-48da00e83f78 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:42.106620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28773f2d-a8f9-460c-b075-48da00e83f78 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:42.107048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28773f2d-a8f9-460c-b075-48da00e83f78 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:42.153990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f1bcc6f1-eb72-4cbb-b613-2295432c6635 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:42.163293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f1bcc6f1-eb72-4cbb-b613-2295432c6635 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157842 Jul 28 20:21:42.172742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1072/2285] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:42 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:42.174611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-28773f2d-a8f9-460c-b075-48da00e83f78 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:42.182528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-28773f2d-a8f9-460c-b075-48da00e83f78 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.088901 Jul 28 20:21:42.183079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1214/2286] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:42.765968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d814c542-2c3a-4b97-8891-1f534643fcec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:42.766590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d814c542-2c3a-4b97-8891-1f534643fcec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:42.772635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d814c542-2c3a-4b97-8891-1f534643fcec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:42.773087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d814c542-2c3a-4b97-8891-1f534643fcec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:42.773854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d814c542-2c3a-4b97-8891-1f534643fcec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:42.774292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d814c542-2c3a-4b97-8891-1f534643fcec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:43.109006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d814c542-2c3a-4b97-8891-1f534643fcec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:43.116933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d814c542-2c3a-4b97-8891-1f534643fcec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.354810 Jul 28 20:21:43.117487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1073/2287] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:42 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:43.185706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5df1333a-251d-4ca5-84c0-f9a75e1858cb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:43.186346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5df1333a-251d-4ca5-84c0-f9a75e1858cb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:43.193510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5df1333a-251d-4ca5-84c0-f9a75e1858cb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:43.193957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5df1333a-251d-4ca5-84c0-f9a75e1858cb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:43.194700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5df1333a-251d-4ca5-84c0-f9a75e1858cb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:43.195122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5df1333a-251d-4ca5-84c0-f9a75e1858cb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:43.203896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-91dc4cb0-a4a3-429d-bc92-74870795b0d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:43.204572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-91dc4cb0-a4a3-429d-bc92-74870795b0d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:43.211514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91dc4cb0-a4a3-429d-bc92-74870795b0d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:43.211954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91dc4cb0-a4a3-429d-bc92-74870795b0d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:43.212754 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91dc4cb0-a4a3-429d-bc92-74870795b0d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:43.213183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91dc4cb0-a4a3-429d-bc92-74870795b0d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:43.292618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-91dc4cb0-a4a3-429d-bc92-74870795b0d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:43.301734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-91dc4cb0-a4a3-429d-bc92-74870795b0d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.101852 Jul 28 20:21:43.302312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1074/2288] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:43.350110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5df1333a-251d-4ca5-84c0-f9a75e1858cb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:43.358248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5df1333a-251d-4ca5-84c0-f9a75e1858cb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.176352 Jul 28 20:21:43.358747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1215/2289] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:43 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:44.139154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3c82f84b-84a5-49dd-a013-a17f8fd4b961 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:44.139747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3c82f84b-84a5-49dd-a013-a17f8fd4b961 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:44.146757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c82f84b-84a5-49dd-a013-a17f8fd4b961 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:44.147206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c82f84b-84a5-49dd-a013-a17f8fd4b961 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:44.147956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c82f84b-84a5-49dd-a013-a17f8fd4b961 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:44.148389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3c82f84b-84a5-49dd-a013-a17f8fd4b961 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:44.276149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3c82f84b-84a5-49dd-a013-a17f8fd4b961 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:44.285766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3c82f84b-84a5-49dd-a013-a17f8fd4b961 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150457 Jul 28 20:21:44.286349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1075/2290] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:44 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:44.323163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e3582ab1-3597-4f86-98ad-a22ba012c975 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:44.323765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e3582ab1-3597-4f86-98ad-a22ba012c975 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:44.331109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3582ab1-3597-4f86-98ad-a22ba012c975 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:44.331548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3582ab1-3597-4f86-98ad-a22ba012c975 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:44.332296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3582ab1-3597-4f86-98ad-a22ba012c975 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:44.332752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3582ab1-3597-4f86-98ad-a22ba012c975 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:44.380290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6055ddcd-8c0b-42db-acdd-473ef2f72866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:44.380929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6055ddcd-8c0b-42db-acdd-473ef2f72866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:44.386860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6055ddcd-8c0b-42db-acdd-473ef2f72866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:44.387299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6055ddcd-8c0b-42db-acdd-473ef2f72866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:44.388045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6055ddcd-8c0b-42db-acdd-473ef2f72866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:44.388472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6055ddcd-8c0b-42db-acdd-473ef2f72866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:44.393019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e3582ab1-3597-4f86-98ad-a22ba012c975 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:44.400980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e3582ab1-3597-4f86-98ad-a22ba012c975 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081590 Jul 28 20:21:44.401527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1216/2291] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:44.520278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6055ddcd-8c0b-42db-acdd-473ef2f72866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:44.528314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6055ddcd-8c0b-42db-acdd-473ef2f72866 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152223 Jul 28 20:21:44.528909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1076/2292] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:44 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:45.307225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b8642a16-c09b-4881-9177-6faffc876e78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:45.307832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b8642a16-c09b-4881-9177-6faffc876e78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:45.315132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8642a16-c09b-4881-9177-6faffc876e78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:45.315611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8642a16-c09b-4881-9177-6faffc876e78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:45.316364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8642a16-c09b-4881-9177-6faffc876e78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:45.316825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b8642a16-c09b-4881-9177-6faffc876e78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:45.423669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d250fc45-f7ec-4026-ada0-af75b053159d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:45.424337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d250fc45-f7ec-4026-ada0-af75b053159d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:45.430872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d250fc45-f7ec-4026-ada0-af75b053159d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:45.431311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d250fc45-f7ec-4026-ada0-af75b053159d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:45.432093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d250fc45-f7ec-4026-ada0-af75b053159d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:45.432505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d250fc45-f7ec-4026-ada0-af75b053159d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:45.447985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b8642a16-c09b-4881-9177-6faffc876e78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:45.457187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b8642a16-c09b-4881-9177-6faffc876e78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153782 Jul 28 20:21:45.457757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1217/2293] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:45 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:45.494923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d250fc45-f7ec-4026-ada0-af75b053159d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:45.503521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d250fc45-f7ec-4026-ada0-af75b053159d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084005 Jul 28 20:21:45.504113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1077/2294] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:45.550569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a367b12e-5dcc-43dc-ae8e-1e3c01843b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:45.551267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a367b12e-5dcc-43dc-ae8e-1e3c01843b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:45.557329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a367b12e-5dcc-43dc-ae8e-1e3c01843b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:45.557780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a367b12e-5dcc-43dc-ae8e-1e3c01843b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:45.558536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a367b12e-5dcc-43dc-ae8e-1e3c01843b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:45.558972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a367b12e-5dcc-43dc-ae8e-1e3c01843b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:45.690624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a367b12e-5dcc-43dc-ae8e-1e3c01843b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:45.698762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a367b12e-5dcc-43dc-ae8e-1e3c01843b68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152770 Jul 28 20:21:45.699317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1218/2295] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:46.477655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1b71834c-3be5-494d-a495-8cd25fe8f34b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:46.478185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1b71834c-3be5-494d-a495-8cd25fe8f34b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:46.484828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b71834c-3be5-494d-a495-8cd25fe8f34b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:46.485276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b71834c-3be5-494d-a495-8cd25fe8f34b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:46.486025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b71834c-3be5-494d-a495-8cd25fe8f34b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:46.487083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b71834c-3be5-494d-a495-8cd25fe8f34b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:46.524023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-77cbb759-410e-4685-865f-634a3bf55ce6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:46.524752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-77cbb759-410e-4685-865f-634a3bf55ce6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:46.531604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77cbb759-410e-4685-865f-634a3bf55ce6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:46.532121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77cbb759-410e-4685-865f-634a3bf55ce6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:46.532979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77cbb759-410e-4685-865f-634a3bf55ce6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:46.533948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77cbb759-410e-4685-865f-634a3bf55ce6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:46.607167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-77cbb759-410e-4685-865f-634a3bf55ce6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:46.615171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-77cbb759-410e-4685-865f-634a3bf55ce6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.094940 Jul 28 20:21:46.615744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1219/2296] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:46.647496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1b71834c-3be5-494d-a495-8cd25fe8f34b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:46.655622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1b71834c-3be5-494d-a495-8cd25fe8f34b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.181864 Jul 28 20:21:46.656180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1078/2297] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:46 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:46.721267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3eef04f3-ecfc-4740-a765-59361eb9ae32 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:46.721883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3eef04f3-ecfc-4740-a765-59361eb9ae32 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:46.727908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3eef04f3-ecfc-4740-a765-59361eb9ae32 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:46.728289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3eef04f3-ecfc-4740-a765-59361eb9ae32 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:46.729081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3eef04f3-ecfc-4740-a765-59361eb9ae32 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:46.729537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3eef04f3-ecfc-4740-a765-59361eb9ae32 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:46.860219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3eef04f3-ecfc-4740-a765-59361eb9ae32 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:46.869123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3eef04f3-ecfc-4740-a765-59361eb9ae32 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151781 Jul 28 20:21:46.869674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1220/2298] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:47.636251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-877ca0ad-1fee-4d02-8f56-fe14e7819d4c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:47.636894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-877ca0ad-1fee-4d02-8f56-fe14e7819d4c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:47.644082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-877ca0ad-1fee-4d02-8f56-fe14e7819d4c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:47.644527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-877ca0ad-1fee-4d02-8f56-fe14e7819d4c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:47.645304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-877ca0ad-1fee-4d02-8f56-fe14e7819d4c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:47.645763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-877ca0ad-1fee-4d02-8f56-fe14e7819d4c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:47.677633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3f3da096-d1ad-43c9-ae7a-45a42d8397c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:47.678270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3f3da096-d1ad-43c9-ae7a-45a42d8397c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:47.684756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f3da096-d1ad-43c9-ae7a-45a42d8397c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:47.685197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f3da096-d1ad-43c9-ae7a-45a42d8397c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:47.685948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f3da096-d1ad-43c9-ae7a-45a42d8397c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:47.686373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f3da096-d1ad-43c9-ae7a-45a42d8397c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:47.708432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-877ca0ad-1fee-4d02-8f56-fe14e7819d4c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:47.716405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-877ca0ad-1fee-4d02-8f56-fe14e7819d4c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083978 Jul 28 20:21:47.717000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1079/2299] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:47 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:47.818098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f3da096-d1ad-43c9-ae7a-45a42d8397c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:47.825902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3f3da096-d1ad-43c9-ae7a-45a42d8397c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152094 Jul 28 20:21:47.826457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1221/2300] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:47 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:47.890633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5a2cb8c9-4d6b-4ee7-ab86-e0d0d246d386 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:47.891170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5a2cb8c9-4d6b-4ee7-ab86-e0d0d246d386 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:47.897753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a2cb8c9-4d6b-4ee7-ab86-e0d0d246d386 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:47.898195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a2cb8c9-4d6b-4ee7-ab86-e0d0d246d386 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:47.898968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a2cb8c9-4d6b-4ee7-ab86-e0d0d246d386 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:47.899396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a2cb8c9-4d6b-4ee7-ab86-e0d0d246d386 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:47.917718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:48.027919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5a2cb8c9-4d6b-4ee7-ab86-e0d0d246d386 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:48.036999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5a2cb8c9-4d6b-4ee7-ab86-e0d0d246d386 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150248 Jul 28 20:21:48.037557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1080/2301] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:48.313159 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:21:48.313316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:21:48.738529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2726ac28-7cc5-4ae6-a71b-a83414b93d10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:48.739202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2726ac28-7cc5-4ae6-a71b-a83414b93d10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:48.745738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2726ac28-7cc5-4ae6-a71b-a83414b93d10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:48.746184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2726ac28-7cc5-4ae6-a71b-a83414b93d10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:48.746939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2726ac28-7cc5-4ae6-a71b-a83414b93d10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:48.747379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2726ac28-7cc5-4ae6-a71b-a83414b93d10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:48.809726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2726ac28-7cc5-4ae6-a71b-a83414b93d10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:48.818260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2726ac28-7cc5-4ae6-a71b-a83414b93d10 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083637 Jul 28 20:21:48.818812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1222/2302] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:48.846580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6241afcf-6abc-4f11-b8eb-6558d7922747 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:48.847196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6241afcf-6abc-4f11-b8eb-6558d7922747 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:48.854099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6241afcf-6abc-4f11-b8eb-6558d7922747 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:48.854545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6241afcf-6abc-4f11-b8eb-6558d7922747 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:48.855294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6241afcf-6abc-4f11-b8eb-6558d7922747 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:48.855726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6241afcf-6abc-4f11-b8eb-6558d7922747 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:48.990297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6241afcf-6abc-4f11-b8eb-6558d7922747 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:48.998076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6241afcf-6abc-4f11-b8eb-6558d7922747 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.155795 Jul 28 20:21:48.998635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1081/2303] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:48 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:49.060292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-49082b73-c7ac-4c6a-8d46-1afbbbbe0b5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:49.060931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-49082b73-c7ac-4c6a-8d46-1afbbbbe0b5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:49.066918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49082b73-c7ac-4c6a-8d46-1afbbbbe0b5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:49.067360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49082b73-c7ac-4c6a-8d46-1afbbbbe0b5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:49.068108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49082b73-c7ac-4c6a-8d46-1afbbbbe0b5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:49.068560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49082b73-c7ac-4c6a-8d46-1afbbbbe0b5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:49.072476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:49.204484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-49082b73-c7ac-4c6a-8d46-1afbbbbe0b5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:49.212482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-49082b73-c7ac-4c6a-8d46-1afbbbbe0b5d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157858 Jul 28 20:21:49.213128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1223/2304] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:49 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:49.838487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9cb25ed5-807c-4fac-acc0-acf412e26279 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:49.839122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9cb25ed5-807c-4fac-acc0-acf412e26279 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:49.845300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9cb25ed5-807c-4fac-acc0-acf412e26279 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:49.846227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9cb25ed5-807c-4fac-acc0-acf412e26279 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:49.846981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9cb25ed5-807c-4fac-acc0-acf412e26279 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:49.847510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9cb25ed5-807c-4fac-acc0-acf412e26279 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:49.908433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9cb25ed5-807c-4fac-acc0-acf412e26279 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:49.916242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9cb25ed5-807c-4fac-acc0-acf412e26279 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081599 Jul 28 20:21:49.916830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1082/2305] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:50.019803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a7c56492-6880-471b-b0a7-2e0077890585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:50.020411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a7c56492-6880-471b-b0a7-2e0077890585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:50.026935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a7c56492-6880-471b-b0a7-2e0077890585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:50.027380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a7c56492-6880-471b-b0a7-2e0077890585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:50.028122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a7c56492-6880-471b-b0a7-2e0077890585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:50.028566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a7c56492-6880-471b-b0a7-2e0077890585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:50.160795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a7c56492-6880-471b-b0a7-2e0077890585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:50.168879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a7c56492-6880-471b-b0a7-2e0077890585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153584 Jul 28 20:21:50.169432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1224/2306] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:50 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:50.233260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-97156ed1-c215-4aac-8b23-85f5512b644e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:50.233885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-97156ed1-c215-4aac-8b23-85f5512b644e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:50.239883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97156ed1-c215-4aac-8b23-85f5512b644e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:50.240331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97156ed1-c215-4aac-8b23-85f5512b644e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:50.241115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97156ed1-c215-4aac-8b23-85f5512b644e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:50.241573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-97156ed1-c215-4aac-8b23-85f5512b644e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:50.369678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-97156ed1-c215-4aac-8b23-85f5512b644e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:50.378074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-97156ed1-c215-4aac-8b23-85f5512b644e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148648 Jul 28 20:21:50.378630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1083/2307] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:50 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:50.937439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-86becbaa-2a94-4480-8a63-b659259b1f73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:50.938044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-86becbaa-2a94-4480-8a63-b659259b1f73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:50.944391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86becbaa-2a94-4480-8a63-b659259b1f73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:50.944878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86becbaa-2a94-4480-8a63-b659259b1f73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:50.945615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86becbaa-2a94-4480-8a63-b659259b1f73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:50.946032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-86becbaa-2a94-4480-8a63-b659259b1f73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:51.006214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-86becbaa-2a94-4480-8a63-b659259b1f73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:51.014167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-86becbaa-2a94-4480-8a63-b659259b1f73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080598 Jul 28 20:21:51.014712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1225/2308] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:51.190453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-02ae9ed4-1b94-4f57-815d-06cf1344ee30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:51.190994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-02ae9ed4-1b94-4f57-815d-06cf1344ee30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:51.193327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=82 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:51.198615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02ae9ed4-1b94-4f57-815d-06cf1344ee30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:51.199066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02ae9ed4-1b94-4f57-815d-06cf1344ee30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:51.199814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02ae9ed4-1b94-4f57-815d-06cf1344ee30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:51.200246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02ae9ed4-1b94-4f57-815d-06cf1344ee30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:51.330371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-02ae9ed4-1b94-4f57-815d-06cf1344ee30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:51.338692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-02ae9ed4-1b94-4f57-815d-06cf1344ee30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152540 Jul 28 20:21:51.339252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1084/2309] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:51 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:51.399875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-39f6f591-82fa-4e95-a860-a685fca75efa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:51.400482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-39f6f591-82fa-4e95-a860-a685fca75efa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:51.407258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39f6f591-82fa-4e95-a860-a685fca75efa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:51.407702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39f6f591-82fa-4e95-a860-a685fca75efa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:51.409621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39f6f591-82fa-4e95-a860-a685fca75efa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:51.410060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-39f6f591-82fa-4e95-a860-a685fca75efa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:51.538409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-39f6f591-82fa-4e95-a860-a685fca75efa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:51.546312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-39f6f591-82fa-4e95-a860-a685fca75efa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150295 Jul 28 20:21:51.546871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1226/2310] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:52.028102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:21:52.028320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:21:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:21:52.035807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-adfacbb2-01cd-4440-bece-e31ae9157c73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:52.036496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-adfacbb2-01cd-4440-bece-e31ae9157c73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:52.043290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-adfacbb2-01cd-4440-bece-e31ae9157c73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:52.043804 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-adfacbb2-01cd-4440-bece-e31ae9157c73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:52.044636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-adfacbb2-01cd-4440-bece-e31ae9157c73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:52.045348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-adfacbb2-01cd-4440-bece-e31ae9157c73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:52.105922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-adfacbb2-01cd-4440-bece-e31ae9157c73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:52.114062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-adfacbb2-01cd-4440-bece-e31ae9157c73 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082939 Jul 28 20:21:52.114609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1085/2311] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:21:52.360279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-461e1152-0a85-4b08-8091-ad59d5b4cce6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:52.361015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-461e1152-0a85-4b08-8091-ad59d5b4cce6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:52.363184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:21:52.368820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-461e1152-0a85-4b08-8091-ad59d5b4cce6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:52.369262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-461e1152-0a85-4b08-8091-ad59d5b4cce6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:52.370006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-461e1152-0a85-4b08-8091-ad59d5b4cce6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:52.370430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-461e1152-0a85-4b08-8091-ad59d5b4cce6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:52.501176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-461e1152-0a85-4b08-8091-ad59d5b4cce6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:52.509949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-461e1152-0a85-4b08-8091-ad59d5b4cce6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153542 Jul 28 20:21:52.510508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1227/2312] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:52 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:52.569120 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c5358cd5-bf2d-48ce-afa1-b4e5022dd5d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:52.569746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c5358cd5-bf2d-48ce-afa1-b4e5022dd5d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:52.576190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5358cd5-bf2d-48ce-afa1-b4e5022dd5d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:52.576664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5358cd5-bf2d-48ce-afa1-b4e5022dd5d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:52.577417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5358cd5-bf2d-48ce-afa1-b4e5022dd5d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:52.577841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5358cd5-bf2d-48ce-afa1-b4e5022dd5d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:52.704495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c5358cd5-bf2d-48ce-afa1-b4e5022dd5d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:52.713550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c5358cd5-bf2d-48ce-afa1-b4e5022dd5d5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149005 Jul 28 20:21:52.714104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1086/2313] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:52 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:53.134610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b616912b-c9e2-4a40-a334-902908265c2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:53.135226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b616912b-c9e2-4a40-a334-902908265c2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:53.141172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b616912b-c9e2-4a40-a334-902908265c2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:53.141610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b616912b-c9e2-4a40-a334-902908265c2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:53.143063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b616912b-c9e2-4a40-a334-902908265c2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:53.143491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b616912b-c9e2-4a40-a334-902908265c2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:53.209439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b616912b-c9e2-4a40-a334-902908265c2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:53.217345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b616912b-c9e2-4a40-a334-902908265c2f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086568 Jul 28 20:21:53.217909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1228/2314] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:53.531652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8067a53a-bab0-47f7-84c1-841b22a9ab6a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:53.532242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8067a53a-bab0-47f7-84c1-841b22a9ab6a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:53.539374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8067a53a-bab0-47f7-84c1-841b22a9ab6a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:53.539820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8067a53a-bab0-47f7-84c1-841b22a9ab6a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:53.540594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8067a53a-bab0-47f7-84c1-841b22a9ab6a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:53.541030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8067a53a-bab0-47f7-84c1-841b22a9ab6a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:53.666409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8067a53a-bab0-47f7-84c1-841b22a9ab6a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:53.674764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8067a53a-bab0-47f7-84c1-841b22a9ab6a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147316 Jul 28 20:21:53.675319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1087/2315] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:53 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:53.735136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0190a7ef-46a0-451d-9173-8d1d8619a658 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:53.735777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0190a7ef-46a0-451d-9173-8d1d8619a658 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:53.742488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0190a7ef-46a0-451d-9173-8d1d8619a658 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:53.742935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0190a7ef-46a0-451d-9173-8d1d8619a658 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:53.743683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0190a7ef-46a0-451d-9173-8d1d8619a658 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:53.744110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0190a7ef-46a0-451d-9173-8d1d8619a658 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:53.872210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0190a7ef-46a0-451d-9173-8d1d8619a658 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:53.881150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0190a7ef-46a0-451d-9173-8d1d8619a658 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149832 Jul 28 20:21:53.881702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1229/2316] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:54.238941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-75e81b4e-edb2-4480-885d-3ce210d1c71a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:54.239582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-75e81b4e-edb2-4480-885d-3ce210d1c71a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:54.245690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75e81b4e-edb2-4480-885d-3ce210d1c71a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:54.246139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75e81b4e-edb2-4480-885d-3ce210d1c71a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:54.246893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75e81b4e-edb2-4480-885d-3ce210d1c71a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:54.247323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-75e81b4e-edb2-4480-885d-3ce210d1c71a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:54.312782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-75e81b4e-edb2-4480-885d-3ce210d1c71a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:54.321408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-75e81b4e-edb2-4480-885d-3ce210d1c71a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087111 Jul 28 20:21:54.321962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1088/2317] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:54.696016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e3589af5-7ab5-466f-9e66-1cfca385e7ff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:54.696653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e3589af5-7ab5-466f-9e66-1cfca385e7ff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:54.703423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3589af5-7ab5-466f-9e66-1cfca385e7ff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:54.703863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3589af5-7ab5-466f-9e66-1cfca385e7ff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:54.705356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3589af5-7ab5-466f-9e66-1cfca385e7ff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:54.705851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e3589af5-7ab5-466f-9e66-1cfca385e7ff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:54.834071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e3589af5-7ab5-466f-9e66-1cfca385e7ff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:54.841925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e3589af5-7ab5-466f-9e66-1cfca385e7ff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149738 Jul 28 20:21:54.842477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1230/2318] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:54 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:54.903139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ab346cf-5a50-4b3c-9a5c-613da9164dbb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:54.903762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0ab346cf-5a50-4b3c-9a5c-613da9164dbb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:54.911587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ab346cf-5a50-4b3c-9a5c-613da9164dbb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:54.912228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ab346cf-5a50-4b3c-9a5c-613da9164dbb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:54.913043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ab346cf-5a50-4b3c-9a5c-613da9164dbb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:54.913479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ab346cf-5a50-4b3c-9a5c-613da9164dbb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:55.042514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0ab346cf-5a50-4b3c-9a5c-613da9164dbb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:55.050845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0ab346cf-5a50-4b3c-9a5c-613da9164dbb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151615 Jul 28 20:21:55.051399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1089/2319] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:55.342747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ca05863f-eec4-4119-8127-146add36b5c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:55.343356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ca05863f-eec4-4119-8127-146add36b5c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:55.350556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca05863f-eec4-4119-8127-146add36b5c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:55.351003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca05863f-eec4-4119-8127-146add36b5c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:55.351757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca05863f-eec4-4119-8127-146add36b5c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:55.352186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ca05863f-eec4-4119-8127-146add36b5c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:55.416459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ca05863f-eec4-4119-8127-146add36b5c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:55.424477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ca05863f-eec4-4119-8127-146add36b5c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085720 Jul 28 20:21:55.425064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1231/2320] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:55.862997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0add2264-d415-4c29-a15a-e57631ed233c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:55.863617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0add2264-d415-4c29-a15a-e57631ed233c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:55.869658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0add2264-d415-4c29-a15a-e57631ed233c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:55.870112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0add2264-d415-4c29-a15a-e57631ed233c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:55.870863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0add2264-d415-4c29-a15a-e57631ed233c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:55.871300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0add2264-d415-4c29-a15a-e57631ed233c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:55.998985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0add2264-d415-4c29-a15a-e57631ed233c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:56.007694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0add2264-d415-4c29-a15a-e57631ed233c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149111 Jul 28 20:21:56.008248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1090/2321] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:55 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:56.072642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8853b055-9aec-4e57-b918-fe2f7fcebbaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:56.073256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8853b055-9aec-4e57-b918-fe2f7fcebbaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:56.080203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8853b055-9aec-4e57-b918-fe2f7fcebbaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:56.080696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8853b055-9aec-4e57-b918-fe2f7fcebbaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:56.081438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8853b055-9aec-4e57-b918-fe2f7fcebbaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:56.081863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8853b055-9aec-4e57-b918-fe2f7fcebbaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:56.212107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8853b055-9aec-4e57-b918-fe2f7fcebbaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:56.220292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8853b055-9aec-4e57-b918-fe2f7fcebbaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151432 Jul 28 20:21:56.220900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1232/2322] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:56.445865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5b845b45-cf71-4c9f-a1ba-554292fdc8d0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:56.446406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5b845b45-cf71-4c9f-a1ba-554292fdc8d0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:56.452362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b845b45-cf71-4c9f-a1ba-554292fdc8d0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:56.452839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b845b45-cf71-4c9f-a1ba-554292fdc8d0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:56.453589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b845b45-cf71-4c9f-a1ba-554292fdc8d0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:56.454022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b845b45-cf71-4c9f-a1ba-554292fdc8d0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:56.518547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5b845b45-cf71-4c9f-a1ba-554292fdc8d0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:56.526380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5b845b45-cf71-4c9f-a1ba-554292fdc8d0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084541 Jul 28 20:21:56.526931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1091/2323] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:56 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:57.028708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a4ebfe79-cafa-463c-8cbd-7f999d85e1ee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:57.029246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a4ebfe79-cafa-463c-8cbd-7f999d85e1ee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:57.036247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe79-cafa-463c-8cbd-7f999d85e1ee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:57.036734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe79-cafa-463c-8cbd-7f999d85e1ee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:57.037489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe79-cafa-463c-8cbd-7f999d85e1ee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:57.037922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe79-cafa-463c-8cbd-7f999d85e1ee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:57.166964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a4ebfe79-cafa-463c-8cbd-7f999d85e1ee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:57.175075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a4ebfe79-cafa-463c-8cbd-7f999d85e1ee tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150313 Jul 28 20:21:57.175659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1233/2324] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:57 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:57.242028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1ec9ce85-9819-4181-9e3d-ffa1e0d78392 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:57.242673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1ec9ce85-9819-4181-9e3d-ffa1e0d78392 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:57.249290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ec9ce85-9819-4181-9e3d-ffa1e0d78392 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:57.249740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ec9ce85-9819-4181-9e3d-ffa1e0d78392 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:57.250911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ec9ce85-9819-4181-9e3d-ffa1e0d78392 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:57.252074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ec9ce85-9819-4181-9e3d-ffa1e0d78392 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:57.380098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1ec9ce85-9819-4181-9e3d-ffa1e0d78392 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:57.389356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1ec9ce85-9819-4181-9e3d-ffa1e0d78392 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151140 Jul 28 20:21:57.390114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1092/2325] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:57 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:57.547558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-10008a61-ec66-4890-942d-e5d295030a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:57.549041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-10008a61-ec66-4890-942d-e5d295030a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:57.555285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10008a61-ec66-4890-942d-e5d295030a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:57.555813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10008a61-ec66-4890-942d-e5d295030a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:57.556658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10008a61-ec66-4890-942d-e5d295030a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:57.557151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10008a61-ec66-4890-942d-e5d295030a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:57.624387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-10008a61-ec66-4890-942d-e5d295030a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:57.633609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-10008a61-ec66-4890-942d-e5d295030a3e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.089811 Jul 28 20:21:57.634175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1234/2326] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:58.196104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0891e5e6-1f2d-4efd-9a04-cd87e5cbd146 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:58.196770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0891e5e6-1f2d-4efd-9a04-cd87e5cbd146 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:58.202849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0891e5e6-1f2d-4efd-9a04-cd87e5cbd146 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:58.203288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0891e5e6-1f2d-4efd-9a04-cd87e5cbd146 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:58.204031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0891e5e6-1f2d-4efd-9a04-cd87e5cbd146 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:58.205101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0891e5e6-1f2d-4efd-9a04-cd87e5cbd146 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:58.338287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0891e5e6-1f2d-4efd-9a04-cd87e5cbd146 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:58.346819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0891e5e6-1f2d-4efd-9a04-cd87e5cbd146 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154540 Jul 28 20:21:58.347366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1093/2327] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:58 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:58.410815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d3db81f2-1a03-4fb9-8075-9f343269be0c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:58.411402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d3db81f2-1a03-4fb9-8075-9f343269be0c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:58.418079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3db81f2-1a03-4fb9-8075-9f343269be0c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:58.418495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3db81f2-1a03-4fb9-8075-9f343269be0c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:58.419334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3db81f2-1a03-4fb9-8075-9f343269be0c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:58.419769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3db81f2-1a03-4fb9-8075-9f343269be0c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:58.549688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d3db81f2-1a03-4fb9-8075-9f343269be0c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:58.557592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d3db81f2-1a03-4fb9-8075-9f343269be0c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150608 Jul 28 20:21:58.558146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1235/2328] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:58.655619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fe762ca8-f05c-4e77-80f3-bfac273d6375 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:58.656229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fe762ca8-f05c-4e77-80f3-bfac273d6375 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:58.662290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe762ca8-f05c-4e77-80f3-bfac273d6375 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:58.662732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe762ca8-f05c-4e77-80f3-bfac273d6375 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:58.663484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe762ca8-f05c-4e77-80f3-bfac273d6375 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:58.663916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe762ca8-f05c-4e77-80f3-bfac273d6375 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:58.726987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fe762ca8-f05c-4e77-80f3-bfac273d6375 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:58.734815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fe762ca8-f05c-4e77-80f3-bfac273d6375 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083427 Jul 28 20:21:58.735372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1094/2329] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:59.367620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-56333ea6-8d3a-4f23-b554-40d0fc761c2a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:59.368225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-56333ea6-8d3a-4f23-b554-40d0fc761c2a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:59.374268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56333ea6-8d3a-4f23-b554-40d0fc761c2a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:59.374709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56333ea6-8d3a-4f23-b554-40d0fc761c2a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:59.375471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56333ea6-8d3a-4f23-b554-40d0fc761c2a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:59.375893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-56333ea6-8d3a-4f23-b554-40d0fc761c2a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:59.510544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-56333ea6-8d3a-4f23-b554-40d0fc761c2a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:59.518577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-56333ea6-8d3a-4f23-b554-40d0fc761c2a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154771 Jul 28 20:21:59.519168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1236/2330] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:59 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:59.578972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ee7e6c62-41f5-475e-b12b-8673907ad877 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:59.580170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ee7e6c62-41f5-475e-b12b-8673907ad877 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:59.586686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee7e6c62-41f5-475e-b12b-8673907ad877 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:59.587128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee7e6c62-41f5-475e-b12b-8673907ad877 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:59.587867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee7e6c62-41f5-475e-b12b-8673907ad877 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:59.588295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee7e6c62-41f5-475e-b12b-8673907ad877 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:59.714569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ee7e6c62-41f5-475e-b12b-8673907ad877 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:59.723416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ee7e6c62-41f5-475e-b12b-8673907ad877 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148237 Jul 28 20:21:59.723967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1095/2331] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:59 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:21:59.756565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e6136ed4-8a7a-4999-ad41-d1d2f8d7d5a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:21:59.757181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e6136ed4-8a7a-4999-ad41-d1d2f8d7d5a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:21:59.763163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6136ed4-8a7a-4999-ad41-d1d2f8d7d5a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:59.763614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6136ed4-8a7a-4999-ad41-d1d2f8d7d5a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:59.764361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6136ed4-8a7a-4999-ad41-d1d2f8d7d5a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:21:59.764812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6136ed4-8a7a-4999-ad41-d1d2f8d7d5a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:21:59.830456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e6136ed4-8a7a-4999-ad41-d1d2f8d7d5a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:21:59.838546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e6136ed4-8a7a-4999-ad41-d1d2f8d7d5a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085954 Jul 28 20:21:59.839103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1237/2332] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:21:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:00.539906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9122a6ce-2bf2-4496-b5c8-56d9312235b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:00.540460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9122a6ce-2bf2-4496-b5c8-56d9312235b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:00.546578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9122a6ce-2bf2-4496-b5c8-56d9312235b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:00.547021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9122a6ce-2bf2-4496-b5c8-56d9312235b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:00.547762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9122a6ce-2bf2-4496-b5c8-56d9312235b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:00.548246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9122a6ce-2bf2-4496-b5c8-56d9312235b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:00.676338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9122a6ce-2bf2-4496-b5c8-56d9312235b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:00.684288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9122a6ce-2bf2-4496-b5c8-56d9312235b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148293 Jul 28 20:22:00.696749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1096/2333] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:00 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:00.745242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f160535e-4964-484b-a668-b62b04f92046 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:00.746128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f160535e-4964-484b-a668-b62b04f92046 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:00.753829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f160535e-4964-484b-a668-b62b04f92046 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:00.754375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f160535e-4964-484b-a668-b62b04f92046 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:00.755222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f160535e-4964-484b-a668-b62b04f92046 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:00.755754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f160535e-4964-484b-a668-b62b04f92046 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:00.859262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3da3df3b-319c-4b00-9e60-3e9f29befdc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:00.859869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3da3df3b-319c-4b00-9e60-3e9f29befdc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:00.866143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3da3df3b-319c-4b00-9e60-3e9f29befdc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:00.866585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3da3df3b-319c-4b00-9e60-3e9f29befdc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:00.867331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3da3df3b-319c-4b00-9e60-3e9f29befdc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:00.867763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3da3df3b-319c-4b00-9e60-3e9f29befdc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:00.871817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:00.893644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f160535e-4964-484b-a668-b62b04f92046 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:00.901731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f160535e-4964-484b-a668-b62b04f92046 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.160371 Jul 28 20:22:00.902308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1238/2334] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:00.936746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3da3df3b-319c-4b00-9e60-3e9f29befdc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:00.945307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3da3df3b-319c-4b00-9e60-3e9f29befdc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.090048 Jul 28 20:22:00.945862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1097/2335] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:01.707432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-adcc8a62-22a0-4fc4-b003-388c70aa8081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:01.708041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-adcc8a62-22a0-4fc4-b003-388c70aa8081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:01.714067 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-adcc8a62-22a0-4fc4-b003-388c70aa8081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:01.714512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-adcc8a62-22a0-4fc4-b003-388c70aa8081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:01.715259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-adcc8a62-22a0-4fc4-b003-388c70aa8081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:01.715688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-adcc8a62-22a0-4fc4-b003-388c70aa8081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:01.845809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-adcc8a62-22a0-4fc4-b003-388c70aa8081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:01.849195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:01.854516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-adcc8a62-22a0-4fc4-b003-388c70aa8081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151897 Jul 28 20:22:01.855069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1239/2336] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:01 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:01.923909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-10e34bef-4e8a-4c87-8faa-ebb57415a741 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:01.924648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-10e34bef-4e8a-4c87-8faa-ebb57415a741 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:01.931089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10e34bef-4e8a-4c87-8faa-ebb57415a741 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:01.931534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10e34bef-4e8a-4c87-8faa-ebb57415a741 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:01.932280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10e34bef-4e8a-4c87-8faa-ebb57415a741 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:01.932747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10e34bef-4e8a-4c87-8faa-ebb57415a741 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:01.966855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3e354683-f488-46d7-867a-3a8ef50e3805 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:01.967750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3e354683-f488-46d7-867a-3a8ef50e3805 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:01.975127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e354683-f488-46d7-867a-3a8ef50e3805 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:01.975639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e354683-f488-46d7-867a-3a8ef50e3805 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:01.976463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e354683-f488-46d7-867a-3a8ef50e3805 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:01.976951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e354683-f488-46d7-867a-3a8ef50e3805 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:02.053154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3e354683-f488-46d7-867a-3a8ef50e3805 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:02.060972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3e354683-f488-46d7-867a-3a8ef50e3805 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.097986 Jul 28 20:22:02.061529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1240/2337] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:02.085715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-10e34bef-4e8a-4c87-8faa-ebb57415a741 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:02.093662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-10e34bef-4e8a-4c87-8faa-ebb57415a741 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.174461 Jul 28 20:22:02.094216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1098/2338] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:02.875101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b5ff41e0-c270-48cb-b240-75b8b585b0a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:02.875694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b5ff41e0-c270-48cb-b240-75b8b585b0a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:02.882542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5ff41e0-c270-48cb-b240-75b8b585b0a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:02.882990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5ff41e0-c270-48cb-b240-75b8b585b0a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:02.883739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5ff41e0-c270-48cb-b240-75b8b585b0a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:02.884200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b5ff41e0-c270-48cb-b240-75b8b585b0a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:03.009877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b5ff41e0-c270-48cb-b240-75b8b585b0a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:03.018764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b5ff41e0-c270-48cb-b240-75b8b585b0a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147480 Jul 28 20:22:03.019313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1241/2339] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:02 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:03.083850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e5f7aa0-15b9-48f4-9fa8-b820a1b64219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:03.084456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9e5f7aa0-15b9-48f4-9fa8-b820a1b64219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:03.090881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e5f7aa0-15b9-48f4-9fa8-b820a1b64219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:03.091326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e5f7aa0-15b9-48f4-9fa8-b820a1b64219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:03.092068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e5f7aa0-15b9-48f4-9fa8-b820a1b64219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:03.092498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e5f7aa0-15b9-48f4-9fa8-b820a1b64219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:03.119156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-da76b443-0b40-4878-b941-c292bc2e2e78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:03.119773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-da76b443-0b40-4878-b941-c292bc2e2e78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:03.125830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da76b443-0b40-4878-b941-c292bc2e2e78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:03.127480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da76b443-0b40-4878-b941-c292bc2e2e78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:03.128275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da76b443-0b40-4878-b941-c292bc2e2e78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:03.128750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da76b443-0b40-4878-b941-c292bc2e2e78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:03.153594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9e5f7aa0-15b9-48f4-9fa8-b820a1b64219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:03.162081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e5f7aa0-15b9-48f4-9fa8-b820a1b64219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082893 Jul 28 20:22:03.162992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1099/2340] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:03 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:03.267864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-da76b443-0b40-4878-b941-c292bc2e2e78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:03.276269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-da76b443-0b40-4878-b941-c292bc2e2e78 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.161120 Jul 28 20:22:03.276880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1242/2341] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:03 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:04.039646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cc855478-c55d-4a84-b6c7-de58fe2794f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:04.040275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cc855478-c55d-4a84-b6c7-de58fe2794f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:04.046313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc855478-c55d-4a84-b6c7-de58fe2794f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:04.046756 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc855478-c55d-4a84-b6c7-de58fe2794f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:04.047500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc855478-c55d-4a84-b6c7-de58fe2794f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:04.048458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc855478-c55d-4a84-b6c7-de58fe2794f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:04.175187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cc855478-c55d-4a84-b6c7-de58fe2794f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:04.183240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cc855478-c55d-4a84-b6c7-de58fe2794f8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147430 Jul 28 20:22:04.183791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1100/2342] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:04 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:04.184898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eef71939-c065-4e9c-a853-e08c697e123e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:04.185504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eef71939-c065-4e9c-a853-e08c697e123e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:04.192053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eef71939-c065-4e9c-a853-e08c697e123e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:04.192499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eef71939-c065-4e9c-a853-e08c697e123e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:04.193275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eef71939-c065-4e9c-a853-e08c697e123e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:04.193697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eef71939-c065-4e9c-a853-e08c697e123e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:04.253759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eef71939-c065-4e9c-a853-e08c697e123e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:04.261589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eef71939-c065-4e9c-a853-e08c697e123e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080476 Jul 28 20:22:04.262131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1243/2343] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:04.298004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3d9348cc-d66e-4595-9876-7e171e41d212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:04.298664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3d9348cc-d66e-4595-9876-7e171e41d212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:04.305341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3d9348cc-d66e-4595-9876-7e171e41d212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:04.305915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3d9348cc-d66e-4595-9876-7e171e41d212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:04.306539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3d9348cc-d66e-4595-9876-7e171e41d212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:04.306982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3d9348cc-d66e-4595-9876-7e171e41d212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:04.441456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3d9348cc-d66e-4595-9876-7e171e41d212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:04.449489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3d9348cc-d66e-4595-9876-7e171e41d212 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.155346 Jul 28 20:22:04.450033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1101/2344] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:04 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:05.205518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-12b2443d-f8a7-45d3-99bb-581bf2c8a3cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:05.206134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-12b2443d-f8a7-45d3-99bb-581bf2c8a3cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:05.212685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12b2443d-f8a7-45d3-99bb-581bf2c8a3cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:05.213140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12b2443d-f8a7-45d3-99bb-581bf2c8a3cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:05.213893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12b2443d-f8a7-45d3-99bb-581bf2c8a3cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:05.214328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12b2443d-f8a7-45d3-99bb-581bf2c8a3cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:05.282509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7f7d5c74-f311-4854-9bbb-f13f1fdb23df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:05.283343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7f7d5c74-f311-4854-9bbb-f13f1fdb23df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:05.289977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c74-f311-4854-9bbb-f13f1fdb23df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:05.290428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c74-f311-4854-9bbb-f13f1fdb23df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:05.291200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c74-f311-4854-9bbb-f13f1fdb23df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:05.291639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f7d5c74-f311-4854-9bbb-f13f1fdb23df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:05.362553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7f7d5c74-f311-4854-9bbb-f13f1fdb23df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:05.366178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-12b2443d-f8a7-45d3-99bb-581bf2c8a3cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:05.370512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7f7d5c74-f311-4854-9bbb-f13f1fdb23df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.092140 Jul 28 20:22:05.371084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1102/2345] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:05 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:05.374139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-12b2443d-f8a7-45d3-99bb-581bf2c8a3cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.173317 Jul 28 20:22:05.374685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1244/2346] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:05 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:05.471332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ed2e66cf-c825-4627-8276-391c2174c22d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:05.471952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ed2e66cf-c825-4627-8276-391c2174c22d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:05.478101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed2e66cf-c825-4627-8276-391c2174c22d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:05.478546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed2e66cf-c825-4627-8276-391c2174c22d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:05.479301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed2e66cf-c825-4627-8276-391c2174c22d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:05.479738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ed2e66cf-c825-4627-8276-391c2174c22d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:05.610263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ed2e66cf-c825-4627-8276-391c2174c22d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:05.618112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ed2e66cf-c825-4627-8276-391c2174c22d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150721 Jul 28 20:22:05.618663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1103/2347] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:05 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:06.391890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e6467bc0-60bc-41b3-aa27-16d803a8cc47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:06.392498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e6467bc0-60bc-41b3-aa27-16d803a8cc47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:06.395650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-190f3961-c210-4d09-ac54-bcf62cb9113b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:06.397482 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-190f3961-c210-4d09-ac54-bcf62cb9113b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:06.399560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6467bc0-60bc-41b3-aa27-16d803a8cc47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:06.399884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6467bc0-60bc-41b3-aa27-16d803a8cc47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:06.400934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6467bc0-60bc-41b3-aa27-16d803a8cc47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:06.401524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6467bc0-60bc-41b3-aa27-16d803a8cc47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:06.406937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-190f3961-c210-4d09-ac54-bcf62cb9113b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:06.407533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-190f3961-c210-4d09-ac54-bcf62cb9113b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:06.408878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-190f3961-c210-4d09-ac54-bcf62cb9113b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:06.409602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-190f3961-c210-4d09-ac54-bcf62cb9113b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:06.481659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e6467bc0-60bc-41b3-aa27-16d803a8cc47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:06.490587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e6467bc0-60bc-41b3-aa27-16d803a8cc47 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.102735 Jul 28 20:22:06.491367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1245/2348] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:06.569044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-190f3961-c210-4d09-ac54-bcf62cb9113b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:06.577124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-190f3961-c210-4d09-ac54-bcf62cb9113b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.185874 Jul 28 20:22:06.577690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1104/2349] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:06 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:06.639509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-98c5377f-f717-48f2-a587-28abfb8a088f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:06.640110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-98c5377f-f717-48f2-a587-28abfb8a088f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:06.647099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98c5377f-f717-48f2-a587-28abfb8a088f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:06.647536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98c5377f-f717-48f2-a587-28abfb8a088f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:06.648676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98c5377f-f717-48f2-a587-28abfb8a088f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:06.649119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98c5377f-f717-48f2-a587-28abfb8a088f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:06.786764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-98c5377f-f717-48f2-a587-28abfb8a088f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:06.794560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-98c5377f-f717-48f2-a587-28abfb8a088f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.159386 Jul 28 20:22:06.795238 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1246/2350] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:06 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:07.513333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8a0ab5f9-e90b-4e22-85fa-782b883f4ef9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:07.513902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8a0ab5f9-e90b-4e22-85fa-782b883f4ef9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:07.520510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8a0ab5f9-e90b-4e22-85fa-782b883f4ef9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:07.520981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8a0ab5f9-e90b-4e22-85fa-782b883f4ef9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:07.521723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8a0ab5f9-e90b-4e22-85fa-782b883f4ef9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:07.522149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8a0ab5f9-e90b-4e22-85fa-782b883f4ef9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:07.582771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8a0ab5f9-e90b-4e22-85fa-782b883f4ef9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:07.590635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8a0ab5f9-e90b-4e22-85fa-782b883f4ef9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081240 Jul 28 20:22:07.591198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1105/2351] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:07.600827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-84bda882-bc76-4d46-8aed-9852f084b203 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:07.601442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-84bda882-bc76-4d46-8aed-9852f084b203 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:07.607871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84bda882-bc76-4d46-8aed-9852f084b203 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:07.608311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84bda882-bc76-4d46-8aed-9852f084b203 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:07.609099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84bda882-bc76-4d46-8aed-9852f084b203 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:07.609530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-84bda882-bc76-4d46-8aed-9852f084b203 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:07.741193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-84bda882-bc76-4d46-8aed-9852f084b203 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:07.749136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-84bda882-bc76-4d46-8aed-9852f084b203 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152108 Jul 28 20:22:07.749690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1247/2352] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:07 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:07.815448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-51553870-59f4-4c3b-acd3-35fa7526e1e2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:07.815982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-51553870-59f4-4c3b-acd3-35fa7526e1e2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:07.821938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51553870-59f4-4c3b-acd3-35fa7526e1e2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:07.822380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51553870-59f4-4c3b-acd3-35fa7526e1e2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:07.823123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51553870-59f4-4c3b-acd3-35fa7526e1e2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:07.823549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-51553870-59f4-4c3b-acd3-35fa7526e1e2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:07.950319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-51553870-59f4-4c3b-acd3-35fa7526e1e2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:07.958763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-51553870-59f4-4c3b-acd3-35fa7526e1e2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147476 Jul 28 20:22:07.959321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1106/2353] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:07 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:08.611854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d70a3b23-67ca-4f79-8ab0-6293ac2c017f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:08.612496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d70a3b23-67ca-4f79-8ab0-6293ac2c017f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:08.618963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d70a3b23-67ca-4f79-8ab0-6293ac2c017f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:08.619412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d70a3b23-67ca-4f79-8ab0-6293ac2c017f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:08.620154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d70a3b23-67ca-4f79-8ab0-6293ac2c017f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:08.620611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d70a3b23-67ca-4f79-8ab0-6293ac2c017f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:08.681965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d70a3b23-67ca-4f79-8ab0-6293ac2c017f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:08.690755 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d70a3b23-67ca-4f79-8ab0-6293ac2c017f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083644 Jul 28 20:22:08.691312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1248/2354] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:08.770045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fbc3d00a-fff0-4f54-958a-04bd02d2b7aa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:08.770654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fbc3d00a-fff0-4f54-958a-04bd02d2b7aa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:08.777191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbc3d00a-fff0-4f54-958a-04bd02d2b7aa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:08.777629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbc3d00a-fff0-4f54-958a-04bd02d2b7aa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:08.778368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbc3d00a-fff0-4f54-958a-04bd02d2b7aa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:08.778794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbc3d00a-fff0-4f54-958a-04bd02d2b7aa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:08.908898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fbc3d00a-fff0-4f54-958a-04bd02d2b7aa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:08.916735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fbc3d00a-fff0-4f54-958a-04bd02d2b7aa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150681 Jul 28 20:22:08.917291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1107/2355] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:08 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:08.980533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d578ce10-77bc-4b59-a126-f23d84c6364c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:08.981171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d578ce10-77bc-4b59-a126-f23d84c6364c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:08.988239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d578ce10-77bc-4b59-a126-f23d84c6364c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:08.988709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d578ce10-77bc-4b59-a126-f23d84c6364c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:08.989452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d578ce10-77bc-4b59-a126-f23d84c6364c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:08.989877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d578ce10-77bc-4b59-a126-f23d84c6364c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:09.117107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d578ce10-77bc-4b59-a126-f23d84c6364c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:09.124984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d578ce10-77bc-4b59-a126-f23d84c6364c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148217 Jul 28 20:22:09.125538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1249/2356] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:08 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:09.711548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dc456905-fdb2-4b50-a462-f7228863cf21 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:09.712195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dc456905-fdb2-4b50-a462-f7228863cf21 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:09.718276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc456905-fdb2-4b50-a462-f7228863cf21 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:09.718725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc456905-fdb2-4b50-a462-f7228863cf21 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:09.719467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc456905-fdb2-4b50-a462-f7228863cf21 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:09.720460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc456905-fdb2-4b50-a462-f7228863cf21 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:09.780298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dc456905-fdb2-4b50-a462-f7228863cf21 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:09.788116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dc456905-fdb2-4b50-a462-f7228863cf21 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080415 Jul 28 20:22:09.788691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1108/2357] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:09 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:09.937837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-35a7a436-967a-4d2b-a239-ba68574a2241 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:09.939145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-35a7a436-967a-4d2b-a239-ba68574a2241 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:09.945844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35a7a436-967a-4d2b-a239-ba68574a2241 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:09.946287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35a7a436-967a-4d2b-a239-ba68574a2241 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:09.947028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35a7a436-967a-4d2b-a239-ba68574a2241 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:09.947453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-35a7a436-967a-4d2b-a239-ba68574a2241 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:10.078218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-35a7a436-967a-4d2b-a239-ba68574a2241 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:10.086550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-35a7a436-967a-4d2b-a239-ba68574a2241 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152671 Jul 28 20:22:10.087100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1250/2358] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:09 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:10.147460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ebcde1f3-0d9f-489e-829d-7988226604c9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:10.148064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ebcde1f3-0d9f-489e-829d-7988226604c9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:10.153984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ebcde1f3-0d9f-489e-829d-7988226604c9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:10.154744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ebcde1f3-0d9f-489e-829d-7988226604c9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:10.155489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ebcde1f3-0d9f-489e-829d-7988226604c9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:10.155918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ebcde1f3-0d9f-489e-829d-7988226604c9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:10.285261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ebcde1f3-0d9f-489e-829d-7988226604c9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:10.293030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ebcde1f3-0d9f-489e-829d-7988226604c9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149356 Jul 28 20:22:10.293577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1109/2359] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:10 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:10.809116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-130315b9-fdb3-4f49-8130-f8e15aa2e109 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:10.809731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-130315b9-fdb3-4f49-8130-f8e15aa2e109 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:10.816396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-130315b9-fdb3-4f49-8130-f8e15aa2e109 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:10.816864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-130315b9-fdb3-4f49-8130-f8e15aa2e109 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:10.817616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-130315b9-fdb3-4f49-8130-f8e15aa2e109 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:10.818047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-130315b9-fdb3-4f49-8130-f8e15aa2e109 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:10.877839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-130315b9-fdb3-4f49-8130-f8e15aa2e109 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:10.885705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-130315b9-fdb3-4f49-8130-f8e15aa2e109 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080404 Jul 28 20:22:10.886258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1251/2360] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:10 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:11.107404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-47b34eae-e2c2-4a50-9ee5-cc2d0d02ea39 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:11.108018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-47b34eae-e2c2-4a50-9ee5-cc2d0d02ea39 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:11.115412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47b34eae-e2c2-4a50-9ee5-cc2d0d02ea39 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:11.115855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47b34eae-e2c2-4a50-9ee5-cc2d0d02ea39 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:11.116627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47b34eae-e2c2-4a50-9ee5-cc2d0d02ea39 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:11.117060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47b34eae-e2c2-4a50-9ee5-cc2d0d02ea39 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:11.248243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-47b34eae-e2c2-4a50-9ee5-cc2d0d02ea39 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:11.256210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-47b34eae-e2c2-4a50-9ee5-cc2d0d02ea39 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152657 Jul 28 20:22:11.256800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1110/2361] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:11 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:11.314429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bb58e1f7-1e83-459e-b0c7-c6e74124017b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:11.315062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bb58e1f7-1e83-459e-b0c7-c6e74124017b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:11.321486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb58e1f7-1e83-459e-b0c7-c6e74124017b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:11.321931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb58e1f7-1e83-459e-b0c7-c6e74124017b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:11.322667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb58e1f7-1e83-459e-b0c7-c6e74124017b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:11.323092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb58e1f7-1e83-459e-b0c7-c6e74124017b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:11.458102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bb58e1f7-1e83-459e-b0c7-c6e74124017b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:11.465961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bb58e1f7-1e83-459e-b0c7-c6e74124017b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.155797 Jul 28 20:22:11.466513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1252/2362] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:11 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:11.908908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aa5e715f-dd00-4d98-819b-d71525004a89 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:11.909528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aa5e715f-dd00-4d98-819b-d71525004a89 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:11.915582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa5e715f-dd00-4d98-819b-d71525004a89 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:11.916036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa5e715f-dd00-4d98-819b-d71525004a89 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:11.916825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa5e715f-dd00-4d98-819b-d71525004a89 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:11.917263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa5e715f-dd00-4d98-819b-d71525004a89 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:11.977794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aa5e715f-dd00-4d98-819b-d71525004a89 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:11.985891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aa5e715f-dd00-4d98-819b-d71525004a89 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081810 Jul 28 20:22:11.986449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1111/2363] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:12.278085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d3488f31-7be2-4326-9f8e-3df91f8d4a56 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:12.278688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d3488f31-7be2-4326-9f8e-3df91f8d4a56 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:12.285363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3488f31-7be2-4326-9f8e-3df91f8d4a56 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:12.285802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3488f31-7be2-4326-9f8e-3df91f8d4a56 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:12.286548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3488f31-7be2-4326-9f8e-3df91f8d4a56 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:12.286970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3488f31-7be2-4326-9f8e-3df91f8d4a56 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:12.444471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d3488f31-7be2-4326-9f8e-3df91f8d4a56 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:12.452726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d3488f31-7be2-4326-9f8e-3df91f8d4a56 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.178481 Jul 28 20:22:12.453282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1253/2364] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:12 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:12.487318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3beba6f3-057e-4009-b265-26e385a14955 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:12.487929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3beba6f3-057e-4009-b265-26e385a14955 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:12.494503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3beba6f3-057e-4009-b265-26e385a14955 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:12.494943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3beba6f3-057e-4009-b265-26e385a14955 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:12.495693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3beba6f3-057e-4009-b265-26e385a14955 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:12.496121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3beba6f3-057e-4009-b265-26e385a14955 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:12.639024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3beba6f3-057e-4009-b265-26e385a14955 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:12.647100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3beba6f3-057e-4009-b265-26e385a14955 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.163736 Jul 28 20:22:12.647650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1112/2365] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:12 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:13.007941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cf46e8e5-de21-4e75-8f84-ce5c14cdb11f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:13.008562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cf46e8e5-de21-4e75-8f84-ce5c14cdb11f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:13.014685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e5-de21-4e75-8f84-ce5c14cdb11f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:13.015153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e5-de21-4e75-8f84-ce5c14cdb11f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:13.015901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e5-de21-4e75-8f84-ce5c14cdb11f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:13.017066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cf46e8e5-de21-4e75-8f84-ce5c14cdb11f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:13.093724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cf46e8e5-de21-4e75-8f84-ce5c14cdb11f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:13.101817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cf46e8e5-de21-4e75-8f84-ce5c14cdb11f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.097719 Jul 28 20:22:13.102374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1254/2366] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:13 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:13.479974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-beaffe58-a391-4f59-970f-2a0112105f7a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:13.481381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-beaffe58-a391-4f59-970f-2a0112105f7a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:13.494959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-beaffe58-a391-4f59-970f-2a0112105f7a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:13.495897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-beaffe58-a391-4f59-970f-2a0112105f7a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:13.497512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-beaffe58-a391-4f59-970f-2a0112105f7a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:13.498431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-beaffe58-a391-4f59-970f-2a0112105f7a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:13.658927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-beaffe58-a391-4f59-970f-2a0112105f7a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:13.663420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:13.668059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-beaffe58-a391-4f59-970f-2a0112105f7a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.196082 Jul 28 20:22:13.668650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1113/2367] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:13 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:13.668964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6f049c51-d8aa-46db-bb9f-b820f8029c54 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:13.669660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6f049c51-d8aa-46db-bb9f-b820f8029c54 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:13.676234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f049c51-d8aa-46db-bb9f-b820f8029c54 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:13.676721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f049c51-d8aa-46db-bb9f-b820f8029c54 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:13.677482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f049c51-d8aa-46db-bb9f-b820f8029c54 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:13.677924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f049c51-d8aa-46db-bb9f-b820f8029c54 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:13.808772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6f049c51-d8aa-46db-bb9f-b820f8029c54 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:13.817231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6f049c51-d8aa-46db-bb9f-b820f8029c54 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152110 Jul 28 20:22:13.817801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1255/2368] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:13 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:14.123101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-621c978f-8a0b-4964-9397-517ad8188564 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:14.123774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-621c978f-8a0b-4964-9397-517ad8188564 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:14.130827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-621c978f-8a0b-4964-9397-517ad8188564 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:14.131279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-621c978f-8a0b-4964-9397-517ad8188564 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:14.132040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-621c978f-8a0b-4964-9397-517ad8188564 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:14.132478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-621c978f-8a0b-4964-9397-517ad8188564 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:14.197988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-621c978f-8a0b-4964-9397-517ad8188564 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:14.206453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-621c978f-8a0b-4964-9397-517ad8188564 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087236 Jul 28 20:22:14.207008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1114/2369] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:14.689651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3bf04c10-6c86-4d76-b7f2-1e9f7d1e7149 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:14.690261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3bf04c10-6c86-4d76-b7f2-1e9f7d1e7149 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:14.696802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3bf04c10-6c86-4d76-b7f2-1e9f7d1e7149 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:14.697254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3bf04c10-6c86-4d76-b7f2-1e9f7d1e7149 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:14.698006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3bf04c10-6c86-4d76-b7f2-1e9f7d1e7149 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:14.698442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3bf04c10-6c86-4d76-b7f2-1e9f7d1e7149 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:14.716001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:14.827872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3bf04c10-6c86-4d76-b7f2-1e9f7d1e7149 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:14.836012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3bf04c10-6c86-4d76-b7f2-1e9f7d1e7149 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150437 Jul 28 20:22:14.836593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1256/2370] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:14 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:14.839041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-79058c55-9702-4290-bfcc-acb45b8e0de9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:14.839652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-79058c55-9702-4290-bfcc-acb45b8e0de9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:14.846937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79058c55-9702-4290-bfcc-acb45b8e0de9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:14.847381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79058c55-9702-4290-bfcc-acb45b8e0de9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:14.848145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79058c55-9702-4290-bfcc-acb45b8e0de9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:14.848591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79058c55-9702-4290-bfcc-acb45b8e0de9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:14.977038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-79058c55-9702-4290-bfcc-acb45b8e0de9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:14.984852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-79058c55-9702-4290-bfcc-acb45b8e0de9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149948 Jul 28 20:22:14.985466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1115/2371] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:14 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:15.227421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-59ae773b-fea3-40d4-9586-3bf930160208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:15.227958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-59ae773b-fea3-40d4-9586-3bf930160208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:15.234089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-59ae773b-fea3-40d4-9586-3bf930160208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:15.234537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-59ae773b-fea3-40d4-9586-3bf930160208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:15.235343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-59ae773b-fea3-40d4-9586-3bf930160208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:15.235777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-59ae773b-fea3-40d4-9586-3bf930160208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:15.302251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-59ae773b-fea3-40d4-9586-3bf930160208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:15.310168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-59ae773b-fea3-40d4-9586-3bf930160208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086727 Jul 28 20:22:15.310722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1257/2372] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:15.857337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-764f297c-8c71-4a24-b85f-1d0e015a79b0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:15.857979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-764f297c-8c71-4a24-b85f-1d0e015a79b0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:15.864991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-764f297c-8c71-4a24-b85f-1d0e015a79b0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:15.865441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-764f297c-8c71-4a24-b85f-1d0e015a79b0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:15.866190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-764f297c-8c71-4a24-b85f-1d0e015a79b0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:15.866627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-764f297c-8c71-4a24-b85f-1d0e015a79b0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:16.004732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-764f297c-8c71-4a24-b85f-1d0e015a79b0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:16.006945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-389c081d-0563-4d46-b3b6-49aaea5f793c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:16.007608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-389c081d-0563-4d46-b3b6-49aaea5f793c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:16.012805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-764f297c-8c71-4a24-b85f-1d0e015a79b0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.159289 Jul 28 20:22:16.013366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1116/2373] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:15 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:16.014177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-389c081d-0563-4d46-b3b6-49aaea5f793c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:16.014625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-389c081d-0563-4d46-b3b6-49aaea5f793c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:16.015374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-389c081d-0563-4d46-b3b6-49aaea5f793c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:16.015806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-389c081d-0563-4d46-b3b6-49aaea5f793c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:16.143291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-389c081d-0563-4d46-b3b6-49aaea5f793c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:16.151127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-389c081d-0563-4d46-b3b6-49aaea5f793c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148008 Jul 28 20:22:16.151693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1258/2374] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:16 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:16.331257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e9b19591-5400-49db-b82e-0fbd1bdb526f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:16.331858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e9b19591-5400-49db-b82e-0fbd1bdb526f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:16.337873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9b19591-5400-49db-b82e-0fbd1bdb526f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:16.338313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9b19591-5400-49db-b82e-0fbd1bdb526f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:16.339051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9b19591-5400-49db-b82e-0fbd1bdb526f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:16.339476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9b19591-5400-49db-b82e-0fbd1bdb526f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:16.403392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e9b19591-5400-49db-b82e-0fbd1bdb526f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:16.412874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e9b19591-5400-49db-b82e-0fbd1bdb526f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085523 Jul 28 20:22:16.413423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1117/2375] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:16 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:17.034986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cbeb0a6c-7bff-436f-8e2c-c9774969c585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:17.035535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cbeb0a6c-7bff-436f-8e2c-c9774969c585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:17.041964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbeb0a6c-7bff-436f-8e2c-c9774969c585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:17.042403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbeb0a6c-7bff-436f-8e2c-c9774969c585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:17.043144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbeb0a6c-7bff-436f-8e2c-c9774969c585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:17.043566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cbeb0a6c-7bff-436f-8e2c-c9774969c585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:17.172273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cbeb0a6c-7bff-436f-8e2c-c9774969c585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:17.173771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f31caf5d-be63-4b5c-b58f-a33615092986 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:17.174604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f31caf5d-be63-4b5c-b58f-a33615092986 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:17.180388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cbeb0a6c-7bff-436f-8e2c-c9774969c585 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150170 Jul 28 20:22:17.181049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1259/2376] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:17 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:17.181655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f31caf5d-be63-4b5c-b58f-a33615092986 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:17.182671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f31caf5d-be63-4b5c-b58f-a33615092986 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:17.183493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f31caf5d-be63-4b5c-b58f-a33615092986 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:17.183987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f31caf5d-be63-4b5c-b58f-a33615092986 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:17.312829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f31caf5d-be63-4b5c-b58f-a33615092986 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:17.320709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f31caf5d-be63-4b5c-b58f-a33615092986 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151382 Jul 28 20:22:17.321264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1118/2377] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:17 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:17.433451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b3d2343f-ba57-4dd1-84c4-c0eb3aa045e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:17.434069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b3d2343f-ba57-4dd1-84c4-c0eb3aa045e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:17.440174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3d2343f-ba57-4dd1-84c4-c0eb3aa045e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:17.440655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3d2343f-ba57-4dd1-84c4-c0eb3aa045e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:17.441412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3d2343f-ba57-4dd1-84c4-c0eb3aa045e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:17.441843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b3d2343f-ba57-4dd1-84c4-c0eb3aa045e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:17.511923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b3d2343f-ba57-4dd1-84c4-c0eb3aa045e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:17.520614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b3d2343f-ba57-4dd1-84c4-c0eb3aa045e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.090973 Jul 28 20:22:17.521172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1260/2378] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:18.201031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1a2b3d2e-0e2d-4a92-adb7-f7ac7f9b238f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:18.201667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1a2b3d2e-0e2d-4a92-adb7-f7ac7f9b238f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:18.208668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a2b3d2e-0e2d-4a92-adb7-f7ac7f9b238f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:18.209105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a2b3d2e-0e2d-4a92-adb7-f7ac7f9b238f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:18.209848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a2b3d2e-0e2d-4a92-adb7-f7ac7f9b238f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:18.210273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a2b3d2e-0e2d-4a92-adb7-f7ac7f9b238f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:18.339982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1a2b3d2e-0e2d-4a92-adb7-f7ac7f9b238f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:18.342215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-31aa0aac-5669-4ea9-9e11-38c475d7dcdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:18.342821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-31aa0aac-5669-4ea9-9e11-38c475d7dcdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:18.348139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1a2b3d2e-0e2d-4a92-adb7-f7ac7f9b238f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150972 Jul 28 20:22:18.348728 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1119/2379] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:18 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:18.349961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31aa0aac-5669-4ea9-9e11-38c475d7dcdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:18.350411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31aa0aac-5669-4ea9-9e11-38c475d7dcdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:18.351170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31aa0aac-5669-4ea9-9e11-38c475d7dcdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:18.351601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31aa0aac-5669-4ea9-9e11-38c475d7dcdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:18.478801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-31aa0aac-5669-4ea9-9e11-38c475d7dcdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:18.486808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-31aa0aac-5669-4ea9-9e11-38c475d7dcdb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148339 Jul 28 20:22:18.487374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1261/2380] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:18 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:18.541665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c631ec82-5340-486d-981e-44f559879f91 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:18.542298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c631ec82-5340-486d-981e-44f559879f91 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:18.548614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c631ec82-5340-486d-981e-44f559879f91 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:18.549061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c631ec82-5340-486d-981e-44f559879f91 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:18.549806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c631ec82-5340-486d-981e-44f559879f91 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:18.550236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c631ec82-5340-486d-981e-44f559879f91 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:18.613763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c631ec82-5340-486d-981e-44f559879f91 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:18.621634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c631ec82-5340-486d-981e-44f559879f91 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083803 Jul 28 20:22:18.622187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1120/2381] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:19.369124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bbaae83f-04de-4781-ba38-1c44ce2de3db tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:19.369715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bbaae83f-04de-4781-ba38-1c44ce2de3db tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:19.376256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbaae83f-04de-4781-ba38-1c44ce2de3db tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:19.376731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbaae83f-04de-4781-ba38-1c44ce2de3db tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:19.377470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbaae83f-04de-4781-ba38-1c44ce2de3db tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:19.377895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbaae83f-04de-4781-ba38-1c44ce2de3db tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:19.507198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d46af01b-d5f6-41ff-a5ca-938068828690 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:19.508090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d46af01b-d5f6-41ff-a5ca-938068828690 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:19.514258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d46af01b-d5f6-41ff-a5ca-938068828690 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:19.514699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d46af01b-d5f6-41ff-a5ca-938068828690 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:19.515054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bbaae83f-04de-4781-ba38-1c44ce2de3db tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:19.515453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d46af01b-d5f6-41ff-a5ca-938068828690 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:19.515877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d46af01b-d5f6-41ff-a5ca-938068828690 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:19.523823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bbaae83f-04de-4781-ba38-1c44ce2de3db tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.158579 Jul 28 20:22:19.524387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1262/2382] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:19 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:19.643926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1338c038-75f1-461e-9930-90e0bb3773ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:19.644647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1338c038-75f1-461e-9930-90e0bb3773ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:19.644896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d46af01b-d5f6-41ff-a5ca-938068828690 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:19.650749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1338c038-75f1-461e-9930-90e0bb3773ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:19.651268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1338c038-75f1-461e-9930-90e0bb3773ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:19.652020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1338c038-75f1-461e-9930-90e0bb3773ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:19.652444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1338c038-75f1-461e-9930-90e0bb3773ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:19.652837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d46af01b-d5f6-41ff-a5ca-938068828690 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149420 Jul 28 20:22:19.653402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1121/2383] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:19 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:19.716438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1338c038-75f1-461e-9930-90e0bb3773ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:19.725535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1338c038-75f1-461e-9930-90e0bb3773ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086161 Jul 28 20:22:19.726089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1263/2384] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:20.546199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-35ec9984-69be-4b3d-b837-88520ccb5bde tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:20.546735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-35ec9984-69be-4b3d-b837-88520ccb5bde tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:20.553942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35ec9984-69be-4b3d-b837-88520ccb5bde tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:20.554393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35ec9984-69be-4b3d-b837-88520ccb5bde tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:20.555141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35ec9984-69be-4b3d-b837-88520ccb5bde tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:20.555574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35ec9984-69be-4b3d-b837-88520ccb5bde tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:20.675717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bbd8bbc8-4ddf-4ad4-b9f2-2b632086439d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:20.676471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bbd8bbc8-4ddf-4ad4-b9f2-2b632086439d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:20.683609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbd8bbc8-4ddf-4ad4-b9f2-2b632086439d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:20.684061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbd8bbc8-4ddf-4ad4-b9f2-2b632086439d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:20.684241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-35ec9984-69be-4b3d-b837-88520ccb5bde tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:20.684856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbd8bbc8-4ddf-4ad4-b9f2-2b632086439d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:20.685292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbd8bbc8-4ddf-4ad4-b9f2-2b632086439d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:20.692476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-35ec9984-69be-4b3d-b837-88520ccb5bde tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150209 Jul 28 20:22:20.693079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1122/2385] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:20 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:20.746686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9eee5085-d83b-47da-bc3c-63682660ba22 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:20.747297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9eee5085-d83b-47da-bc3c-63682660ba22 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:20.753938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9eee5085-d83b-47da-bc3c-63682660ba22 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:20.754392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9eee5085-d83b-47da-bc3c-63682660ba22 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:20.755153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9eee5085-d83b-47da-bc3c-63682660ba22 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:20.755589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9eee5085-d83b-47da-bc3c-63682660ba22 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:20.823488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9eee5085-d83b-47da-bc3c-63682660ba22 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:20.832159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9eee5085-d83b-47da-bc3c-63682660ba22 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.089295 Jul 28 20:22:20.832772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1123/2386] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:20 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:20.846298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bbd8bbc8-4ddf-4ad4-b9f2-2b632086439d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:20.854268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bbd8bbc8-4ddf-4ad4-b9f2-2b632086439d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.183247 Jul 28 20:22:20.854816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1264/2387] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:20 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:21.714162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1a6bd999-00e0-415d-b3e7-a8f91ce9b309 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:21.714775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1a6bd999-00e0-415d-b3e7-a8f91ce9b309 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:21.717082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=80 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:21.723282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a6bd999-00e0-415d-b3e7-a8f91ce9b309 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:21.723743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a6bd999-00e0-415d-b3e7-a8f91ce9b309 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:21.724504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a6bd999-00e0-415d-b3e7-a8f91ce9b309 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:21.724963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a6bd999-00e0-415d-b3e7-a8f91ce9b309 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:21.853128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-76e4d7e5-b4fa-4a2b-9c5a-a41948f39041 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:21.853742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-76e4d7e5-b4fa-4a2b-9c5a-a41948f39041 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:21.857014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1a6bd999-00e0-415d-b3e7-a8f91ce9b309 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:21.860458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76e4d7e5-b4fa-4a2b-9c5a-a41948f39041 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:21.860942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76e4d7e5-b4fa-4a2b-9c5a-a41948f39041 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:21.861711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76e4d7e5-b4fa-4a2b-9c5a-a41948f39041 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:21.862146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76e4d7e5-b4fa-4a2b-9c5a-a41948f39041 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:21.865276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1a6bd999-00e0-415d-b3e7-a8f91ce9b309 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154966 Jul 28 20:22:21.867381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1124/2388] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:21 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:21.878929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-90c99134-ff8f-40fc-87b5-c802076f2dd0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:21.879543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-90c99134-ff8f-40fc-87b5-c802076f2dd0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:21.885519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90c99134-ff8f-40fc-87b5-c802076f2dd0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:21.885970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90c99134-ff8f-40fc-87b5-c802076f2dd0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:21.886734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90c99134-ff8f-40fc-87b5-c802076f2dd0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:21.887172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90c99134-ff8f-40fc-87b5-c802076f2dd0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:21.927272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-76e4d7e5-b4fa-4a2b-9c5a-a41948f39041 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:21.935399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-76e4d7e5-b4fa-4a2b-9c5a-a41948f39041 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086079 Jul 28 20:22:21.935959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1265/2389] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:22.023891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-90c99134-ff8f-40fc-87b5-c802076f2dd0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:22.032261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-90c99134-ff8f-40fc-87b5-c802076f2dd0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157120 Jul 28 20:22:22.033118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1125/2390] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:21 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:22.886342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-29bb6d83-07e5-4f49-96d3-21e3b3e03d68 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:22.886939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-29bb6d83-07e5-4f49-96d3-21e3b3e03d68 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:22.889221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:22.894556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29bb6d83-07e5-4f49-96d3-21e3b3e03d68 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:22.894995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29bb6d83-07e5-4f49-96d3-21e3b3e03d68 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:22.895738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29bb6d83-07e5-4f49-96d3-21e3b3e03d68 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:22.896163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29bb6d83-07e5-4f49-96d3-21e3b3e03d68 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:22.956013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1692f0be-662b-4f65-bfe2-29eab0b09e74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:22.956651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1692f0be-662b-4f65-bfe2-29eab0b09e74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:22.963372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1692f0be-662b-4f65-bfe2-29eab0b09e74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:22.963819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1692f0be-662b-4f65-bfe2-29eab0b09e74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:22.964590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1692f0be-662b-4f65-bfe2-29eab0b09e74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:22.965024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1692f0be-662b-4f65-bfe2-29eab0b09e74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:23.026476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1692f0be-662b-4f65-bfe2-29eab0b09e74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:23.035572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1692f0be-662b-4f65-bfe2-29eab0b09e74 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083461 Jul 28 20:22:23.036146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1126/2391] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:22 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:23.049424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-29bb6d83-07e5-4f49-96d3-21e3b3e03d68 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:23.054076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-af87b30e-5b81-454f-a3d1-64dfbafcf263 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:23.054680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-af87b30e-5b81-454f-a3d1-64dfbafcf263 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:23.057665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-29bb6d83-07e5-4f49-96d3-21e3b3e03d68 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.174875 Jul 28 20:22:23.057940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1266/2392] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:22 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:23.060978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af87b30e-5b81-454f-a3d1-64dfbafcf263 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:23.061450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af87b30e-5b81-454f-a3d1-64dfbafcf263 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:23.062197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af87b30e-5b81-454f-a3d1-64dfbafcf263 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:23.062621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-af87b30e-5b81-454f-a3d1-64dfbafcf263 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:23.397646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-af87b30e-5b81-454f-a3d1-64dfbafcf263 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:23.406137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-af87b30e-5b81-454f-a3d1-64dfbafcf263 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.355727 Jul 28 20:22:23.407319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1127/2393] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:23 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:24.057214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8681a8bb-259e-4c43-ba7b-1fca2049bc61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:24.057825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8681a8bb-259e-4c43-ba7b-1fca2049bc61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:24.064463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8681a8bb-259e-4c43-ba7b-1fca2049bc61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:24.064954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8681a8bb-259e-4c43-ba7b-1fca2049bc61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:24.065687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8681a8bb-259e-4c43-ba7b-1fca2049bc61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:24.066116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8681a8bb-259e-4c43-ba7b-1fca2049bc61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:24.076919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-87ed9027-10a9-4c59-a8fb-c0d6f2be3aa3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:24.077614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-87ed9027-10a9-4c59-a8fb-c0d6f2be3aa3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:24.084750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87ed9027-10a9-4c59-a8fb-c0d6f2be3aa3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:24.085214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87ed9027-10a9-4c59-a8fb-c0d6f2be3aa3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:24.085994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87ed9027-10a9-4c59-a8fb-c0d6f2be3aa3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:24.086421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87ed9027-10a9-4c59-a8fb-c0d6f2be3aa3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:24.129676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8681a8bb-259e-4c43-ba7b-1fca2049bc61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:24.137812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8681a8bb-259e-4c43-ba7b-1fca2049bc61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084399 Jul 28 20:22:24.138378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1267/2394] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:24.221875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-87ed9027-10a9-4c59-a8fb-c0d6f2be3aa3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:24.229714 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-87ed9027-10a9-4c59-a8fb-c0d6f2be3aa3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.156551 Jul 28 20:22:24.230269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1128/2395] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:24 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:24.427101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-595be301-ecda-47ce-b75c-2d90e982a72a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:24.427683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-595be301-ecda-47ce-b75c-2d90e982a72a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:24.433636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-595be301-ecda-47ce-b75c-2d90e982a72a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:24.435138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-595be301-ecda-47ce-b75c-2d90e982a72a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:24.436259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-595be301-ecda-47ce-b75c-2d90e982a72a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:24.436740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-595be301-ecda-47ce-b75c-2d90e982a72a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:24.567056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-595be301-ecda-47ce-b75c-2d90e982a72a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:24.575017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-595be301-ecda-47ce-b75c-2d90e982a72a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151702 Jul 28 20:22:24.575574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1268/2396] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:25.159500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cb1355b3-a36c-4eeb-8500-f9e5bd62e3ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:25.160116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cb1355b3-a36c-4eeb-8500-f9e5bd62e3ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:25.166961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1355b3-a36c-4eeb-8500-f9e5bd62e3ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:25.167408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1355b3-a36c-4eeb-8500-f9e5bd62e3ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:25.168172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1355b3-a36c-4eeb-8500-f9e5bd62e3ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:25.168625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1355b3-a36c-4eeb-8500-f9e5bd62e3ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:25.235248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cb1355b3-a36c-4eeb-8500-f9e5bd62e3ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:25.243248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cb1355b3-a36c-4eeb-8500-f9e5bd62e3ab tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087611 Jul 28 20:22:25.243808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1129/2397] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:25.250746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-77a41d3f-3174-4b0d-8d39-c73d918d2e17 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:25.251359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-77a41d3f-3174-4b0d-8d39-c73d918d2e17 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:25.258053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77a41d3f-3174-4b0d-8d39-c73d918d2e17 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:25.258505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77a41d3f-3174-4b0d-8d39-c73d918d2e17 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:25.259265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77a41d3f-3174-4b0d-8d39-c73d918d2e17 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:25.259698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77a41d3f-3174-4b0d-8d39-c73d918d2e17 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:25.388939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-77a41d3f-3174-4b0d-8d39-c73d918d2e17 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:25.396969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-77a41d3f-3174-4b0d-8d39-c73d918d2e17 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150440 Jul 28 20:22:25.397530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1269/2398] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:25 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:25.597575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0b2e7403-bdd2-4131-b6b5-1e94903c3124 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:25.598193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0b2e7403-bdd2-4131-b6b5-1e94903c3124 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:25.604300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b2e7403-bdd2-4131-b6b5-1e94903c3124 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:25.604780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b2e7403-bdd2-4131-b6b5-1e94903c3124 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:25.605532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b2e7403-bdd2-4131-b6b5-1e94903c3124 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:25.605966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b2e7403-bdd2-4131-b6b5-1e94903c3124 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:25.624048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:25.733522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0b2e7403-bdd2-4131-b6b5-1e94903c3124 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:25.742092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0b2e7403-bdd2-4131-b6b5-1e94903c3124 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148641 Jul 28 20:22:25.742640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1130/2399] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:26.265491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bb7d0c81-0279-4970-b4ae-4694983085a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:26.267096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bb7d0c81-0279-4970-b4ae-4694983085a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:26.273647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb7d0c81-0279-4970-b4ae-4694983085a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:26.274092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb7d0c81-0279-4970-b4ae-4694983085a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:26.274842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb7d0c81-0279-4970-b4ae-4694983085a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:26.275269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb7d0c81-0279-4970-b4ae-4694983085a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:26.336441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bb7d0c81-0279-4970-b4ae-4694983085a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:26.345531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bb7d0c81-0279-4970-b4ae-4694983085a1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083864 Jul 28 20:22:26.346093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1270/2400] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:26.418567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cb1087bb-5a1d-4b71-a8bf-94e84c5ea79d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:26.419151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cb1087bb-5a1d-4b71-a8bf-94e84c5ea79d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:26.425689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1087bb-5a1d-4b71-a8bf-94e84c5ea79d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:26.426140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1087bb-5a1d-4b71-a8bf-94e84c5ea79d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:26.426892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1087bb-5a1d-4b71-a8bf-94e84c5ea79d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:26.427326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb1087bb-5a1d-4b71-a8bf-94e84c5ea79d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:26.556649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cb1087bb-5a1d-4b71-a8bf-94e84c5ea79d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:26.565205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cb1087bb-5a1d-4b71-a8bf-94e84c5ea79d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150616 Jul 28 20:22:26.565765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1131/2401] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:26 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:26.763297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2d41f04a-44a7-4fb2-a233-a6f87265004b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:26.763934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2d41f04a-44a7-4fb2-a233-a6f87265004b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:26.770709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d41f04a-44a7-4fb2-a233-a6f87265004b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:26.771152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d41f04a-44a7-4fb2-a233-a6f87265004b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:26.771895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d41f04a-44a7-4fb2-a233-a6f87265004b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:26.772328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2d41f04a-44a7-4fb2-a233-a6f87265004b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:26.903582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2d41f04a-44a7-4fb2-a233-a6f87265004b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:26.912527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2d41f04a-44a7-4fb2-a233-a6f87265004b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.153170 Jul 28 20:22:26.913174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1271/2402] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:27.366742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-30649c03-d385-4791-ab2c-b97b8903017c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:27.367346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-30649c03-d385-4791-ab2c-b97b8903017c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:27.373438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30649c03-d385-4791-ab2c-b97b8903017c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:27.373920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30649c03-d385-4791-ab2c-b97b8903017c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:27.374684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30649c03-d385-4791-ab2c-b97b8903017c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:27.375222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30649c03-d385-4791-ab2c-b97b8903017c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:27.435526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-30649c03-d385-4791-ab2c-b97b8903017c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:27.443954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-30649c03-d385-4791-ab2c-b97b8903017c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081128 Jul 28 20:22:27.444509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1132/2403] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:27 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:27.586511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-74cda935-b040-4abb-9ca1-2443f0725711 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:27.587107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-74cda935-b040-4abb-9ca1-2443f0725711 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:27.593521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74cda935-b040-4abb-9ca1-2443f0725711 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:27.594528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74cda935-b040-4abb-9ca1-2443f0725711 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:27.595334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74cda935-b040-4abb-9ca1-2443f0725711 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:27.595759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74cda935-b040-4abb-9ca1-2443f0725711 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:27.723567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-74cda935-b040-4abb-9ca1-2443f0725711 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:27.731368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-74cda935-b040-4abb-9ca1-2443f0725711 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148696 Jul 28 20:22:27.731922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1272/2404] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:27 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:27.932874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-60fd8e89-f7c2-4c10-b121-677e563b4576 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:27.933481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-60fd8e89-f7c2-4c10-b121-677e563b4576 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:27.939749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60fd8e89-f7c2-4c10-b121-677e563b4576 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:27.940189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60fd8e89-f7c2-4c10-b121-677e563b4576 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:27.940961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60fd8e89-f7c2-4c10-b121-677e563b4576 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:27.941389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-60fd8e89-f7c2-4c10-b121-677e563b4576 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:28.068633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-60fd8e89-f7c2-4c10-b121-677e563b4576 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:28.076503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-60fd8e89-f7c2-4c10-b121-677e563b4576 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147501 Jul 28 20:22:28.077076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1133/2405] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:27 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:28.465566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-083e07bd-da2d-4c35-8e46-1f7d063c2d61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:28.466184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-083e07bd-da2d-4c35-8e46-1f7d063c2d61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:28.472320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-083e07bd-da2d-4c35-8e46-1f7d063c2d61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:28.472799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-083e07bd-da2d-4c35-8e46-1f7d063c2d61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:28.473557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-083e07bd-da2d-4c35-8e46-1f7d063c2d61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:28.473991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-083e07bd-da2d-4c35-8e46-1f7d063c2d61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:28.478050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:28.534857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-083e07bd-da2d-4c35-8e46-1f7d063c2d61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:28.542657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-083e07bd-da2d-4c35-8e46-1f7d063c2d61 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081017 Jul 28 20:22:28.543208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1273/2406] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:28.751695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-539c7131-d1bb-46fc-89ee-f80991da2cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:28.752310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-539c7131-d1bb-46fc-89ee-f80991da2cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:28.758902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-539c7131-d1bb-46fc-89ee-f80991da2cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:28.759345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-539c7131-d1bb-46fc-89ee-f80991da2cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:28.760097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-539c7131-d1bb-46fc-89ee-f80991da2cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:28.760527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-539c7131-d1bb-46fc-89ee-f80991da2cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:28.891864 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-539c7131-d1bb-46fc-89ee-f80991da2cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:28.899889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-539c7131-d1bb-46fc-89ee-f80991da2cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152582 Jul 28 20:22:28.900449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1134/2407] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:28 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:29.098229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ea07c350-0e39-42b8-9484-28115d00e25c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:29.098900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ea07c350-0e39-42b8-9484-28115d00e25c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:29.105402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea07c350-0e39-42b8-9484-28115d00e25c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:29.105848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea07c350-0e39-42b8-9484-28115d00e25c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:29.106596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea07c350-0e39-42b8-9484-28115d00e25c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:29.107025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea07c350-0e39-42b8-9484-28115d00e25c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:29.235121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ea07c350-0e39-42b8-9484-28115d00e25c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:29.243362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ea07c350-0e39-42b8-9484-28115d00e25c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149629 Jul 28 20:22:29.243924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1274/2408] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:29 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:29.565109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-313e6a14-064a-45fc-89dc-a3cca22f8bca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:29.565754 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-313e6a14-064a-45fc-89dc-a3cca22f8bca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:29.571782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-313e6a14-064a-45fc-89dc-a3cca22f8bca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:29.572233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-313e6a14-064a-45fc-89dc-a3cca22f8bca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:29.573019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-313e6a14-064a-45fc-89dc-a3cca22f8bca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:29.573454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-313e6a14-064a-45fc-89dc-a3cca22f8bca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:29.634654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-313e6a14-064a-45fc-89dc-a3cca22f8bca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:29.643463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-313e6a14-064a-45fc-89dc-a3cca22f8bca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082813 Jul 28 20:22:29.644039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1135/2409] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:29.922903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-73140773-e41f-4aa7-9530-ddfbf066fa63 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:29.923784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-73140773-e41f-4aa7-9530-ddfbf066fa63 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:29.929804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73140773-e41f-4aa7-9530-ddfbf066fa63 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:29.930244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73140773-e41f-4aa7-9530-ddfbf066fa63 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:29.930984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73140773-e41f-4aa7-9530-ddfbf066fa63 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:29.931408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73140773-e41f-4aa7-9530-ddfbf066fa63 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:30.066717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-73140773-e41f-4aa7-9530-ddfbf066fa63 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:30.074555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-73140773-e41f-4aa7-9530-ddfbf066fa63 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.156904 Jul 28 20:22:30.075113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1275/2410] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:29 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:30.264791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b6dfe1f9-3393-4567-a30b-cafb735d2371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:30.265418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b6dfe1f9-3393-4567-a30b-cafb735d2371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:30.271923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6dfe1f9-3393-4567-a30b-cafb735d2371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:30.272370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6dfe1f9-3393-4567-a30b-cafb735d2371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:30.273165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6dfe1f9-3393-4567-a30b-cafb735d2371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:30.273593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6dfe1f9-3393-4567-a30b-cafb735d2371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:30.405047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b6dfe1f9-3393-4567-a30b-cafb735d2371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:30.413681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b6dfe1f9-3393-4567-a30b-cafb735d2371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152812 Jul 28 20:22:30.414235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1136/2411] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:30 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:30.664606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4e365c7b-dc6a-4de7-9ee2-05f339996b83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:30.665228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4e365c7b-dc6a-4de7-9ee2-05f339996b83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:30.671653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4e365c7b-dc6a-4de7-9ee2-05f339996b83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:30.672329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4e365c7b-dc6a-4de7-9ee2-05f339996b83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:30.673216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4e365c7b-dc6a-4de7-9ee2-05f339996b83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:30.673653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4e365c7b-dc6a-4de7-9ee2-05f339996b83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:30.737594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4e365c7b-dc6a-4de7-9ee2-05f339996b83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:30.745877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4e365c7b-dc6a-4de7-9ee2-05f339996b83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085118 Jul 28 20:22:30.746438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1276/2412] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:31.095945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2db08c32-3648-47ee-ba90-3c21908df293 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:31.096574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2db08c32-3648-47ee-ba90-3c21908df293 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:31.102621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2db08c32-3648-47ee-ba90-3c21908df293 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:31.103068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2db08c32-3648-47ee-ba90-3c21908df293 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:31.103814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2db08c32-3648-47ee-ba90-3c21908df293 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:31.104247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2db08c32-3648-47ee-ba90-3c21908df293 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:31.233810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2db08c32-3648-47ee-ba90-3c21908df293 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:31.241894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2db08c32-3648-47ee-ba90-3c21908df293 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150116 Jul 28 20:22:31.242445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1137/2413] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:31 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:31.435549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9fc586b2-b6b7-40dd-b908-ea12a9b1c264 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:31.436151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9fc586b2-b6b7-40dd-b908-ea12a9b1c264 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:31.442893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9fc586b2-b6b7-40dd-b908-ea12a9b1c264 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:31.443334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9fc586b2-b6b7-40dd-b908-ea12a9b1c264 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:31.444109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9fc586b2-b6b7-40dd-b908-ea12a9b1c264 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:31.444531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9fc586b2-b6b7-40dd-b908-ea12a9b1c264 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:31.582301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9fc586b2-b6b7-40dd-b908-ea12a9b1c264 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:31.590082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9fc586b2-b6b7-40dd-b908-ea12a9b1c264 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.158398 Jul 28 20:22:31.590632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1277/2414] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:31.767340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b28f7c84-6633-47ce-855f-4256f7b9a9d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:31.767905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b28f7c84-6633-47ce-855f-4256f7b9a9d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:31.773920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b28f7c84-6633-47ce-855f-4256f7b9a9d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:31.774371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b28f7c84-6633-47ce-855f-4256f7b9a9d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:31.775125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b28f7c84-6633-47ce-855f-4256f7b9a9d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:31.775557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b28f7c84-6633-47ce-855f-4256f7b9a9d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:31.840975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b28f7c84-6633-47ce-855f-4256f7b9a9d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:31.849694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b28f7c84-6633-47ce-855f-4256f7b9a9d9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086931 Jul 28 20:22:31.850252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1138/2415] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:32.262973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-db97c921-79c0-41b1-b9e0-ccf59066d94b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:32.263576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-db97c921-79c0-41b1-b9e0-ccf59066d94b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:32.270774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db97c921-79c0-41b1-b9e0-ccf59066d94b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:32.271214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db97c921-79c0-41b1-b9e0-ccf59066d94b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:32.271954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db97c921-79c0-41b1-b9e0-ccf59066d94b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:32.272380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-db97c921-79c0-41b1-b9e0-ccf59066d94b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:32.399601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-db97c921-79c0-41b1-b9e0-ccf59066d94b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:32.408597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-db97c921-79c0-41b1-b9e0-ccf59066d94b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149507 Jul 28 20:22:32.409172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1278/2416] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:32 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:32.611905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e28c32f1-d9ea-4e67-88ab-9087a90e8d41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:32.612548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e28c32f1-d9ea-4e67-88ab-9087a90e8d41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:32.618954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e28c32f1-d9ea-4e67-88ab-9087a90e8d41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:32.619403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e28c32f1-d9ea-4e67-88ab-9087a90e8d41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:32.620152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e28c32f1-d9ea-4e67-88ab-9087a90e8d41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:32.620606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e28c32f1-d9ea-4e67-88ab-9087a90e8d41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:32.746975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e28c32f1-d9ea-4e67-88ab-9087a90e8d41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:32.755541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e28c32f1-d9ea-4e67-88ab-9087a90e8d41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147530 Jul 28 20:22:32.756111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1139/2417] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:32.871264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d9ba8eb8-54fb-4876-a38b-2ad9f288ee36 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:32.871795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d9ba8eb8-54fb-4876-a38b-2ad9f288ee36 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:32.878397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9ba8eb8-54fb-4876-a38b-2ad9f288ee36 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:32.878845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9ba8eb8-54fb-4876-a38b-2ad9f288ee36 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:32.879591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9ba8eb8-54fb-4876-a38b-2ad9f288ee36 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:32.880024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d9ba8eb8-54fb-4876-a38b-2ad9f288ee36 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:32.949647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d9ba8eb8-54fb-4876-a38b-2ad9f288ee36 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:32.953892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d9ba8eb8-54fb-4876-a38b-2ad9f288ee36 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086059 Jul 28 20:22:32.954505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1279/2418] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:33.429610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-17de09ce-871e-4fe8-b101-01e75548a041 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:33.430190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-17de09ce-871e-4fe8-b101-01e75548a041 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:33.436286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-17de09ce-871e-4fe8-b101-01e75548a041 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:33.436822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-17de09ce-871e-4fe8-b101-01e75548a041 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:33.438064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-17de09ce-871e-4fe8-b101-01e75548a041 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:33.438686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-17de09ce-871e-4fe8-b101-01e75548a041 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:33.566835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-17de09ce-871e-4fe8-b101-01e75548a041 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:33.575094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-17de09ce-871e-4fe8-b101-01e75548a041 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149378 Jul 28 20:22:33.575655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1140/2419] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:33 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:33.777355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3b61b139-945e-4b47-be58-2f56a4e0f240 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:33.777902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3b61b139-945e-4b47-be58-2f56a4e0f240 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:33.784102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b61b139-945e-4b47-be58-2f56a4e0f240 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:33.784564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b61b139-945e-4b47-be58-2f56a4e0f240 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:33.785338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b61b139-945e-4b47-be58-2f56a4e0f240 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:33.785771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b61b139-945e-4b47-be58-2f56a4e0f240 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:33.913973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3b61b139-945e-4b47-be58-2f56a4e0f240 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:33.922756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3b61b139-945e-4b47-be58-2f56a4e0f240 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149153 Jul 28 20:22:33.923302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1280/2420] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:33.974836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dec792b0-c3b8-4358-8922-cccb7230a9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:33.975442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dec792b0-c3b8-4358-8922-cccb7230a9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:33.981876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dec792b0-c3b8-4358-8922-cccb7230a9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:33.982322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dec792b0-c3b8-4358-8922-cccb7230a9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:33.983093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dec792b0-c3b8-4358-8922-cccb7230a9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:33.983521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dec792b0-c3b8-4358-8922-cccb7230a9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:34.047871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dec792b0-c3b8-4358-8922-cccb7230a9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:34.056112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dec792b0-c3b8-4358-8922-cccb7230a9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085352 Jul 28 20:22:34.056687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1141/2421] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:34.597564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-66b5d1a0-9b9b-4f57-b81a-facacb5d1d8b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:34.598845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-66b5d1a0-9b9b-4f57-b81a-facacb5d1d8b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:34.605086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66b5d1a0-9b9b-4f57-b81a-facacb5d1d8b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:34.605529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66b5d1a0-9b9b-4f57-b81a-facacb5d1d8b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:34.606279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66b5d1a0-9b9b-4f57-b81a-facacb5d1d8b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:34.606705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66b5d1a0-9b9b-4f57-b81a-facacb5d1d8b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:34.734230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-66b5d1a0-9b9b-4f57-b81a-facacb5d1d8b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:34.742120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-66b5d1a0-9b9b-4f57-b81a-facacb5d1d8b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148643 Jul 28 20:22:34.742671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1281/2422] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:34 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:34.945112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b24629cb-6a82-417e-8485-f5908ba9ad15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:34.945686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b24629cb-6a82-417e-8485-f5908ba9ad15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:34.952286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b24629cb-6a82-417e-8485-f5908ba9ad15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:34.952778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b24629cb-6a82-417e-8485-f5908ba9ad15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:34.954307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b24629cb-6a82-417e-8485-f5908ba9ad15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:34.954752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b24629cb-6a82-417e-8485-f5908ba9ad15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:35.077676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8e7cbc46-0450-43e4-81ee-918ea2d549f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:35.078843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8e7cbc46-0450-43e4-81ee-918ea2d549f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:35.084488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b24629cb-6a82-417e-8485-f5908ba9ad15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:35.086955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7cbc46-0450-43e4-81ee-918ea2d549f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:35.086955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7cbc46-0450-43e4-81ee-918ea2d549f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:35.086955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7cbc46-0450-43e4-81ee-918ea2d549f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:35.088891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8e7cbc46-0450-43e4-81ee-918ea2d549f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:35.092600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b24629cb-6a82-417e-8485-f5908ba9ad15 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151427 Jul 28 20:22:35.093166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1142/2423] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:34 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:35.152977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8e7cbc46-0450-43e4-81ee-918ea2d549f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:35.162652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8e7cbc46-0450-43e4-81ee-918ea2d549f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.088691 Jul 28 20:22:35.163418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1282/2424] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:35.763655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f996fc94-195e-4dba-b397-3e99918cf8ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:35.764264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f996fc94-195e-4dba-b397-3e99918cf8ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:35.770437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f996fc94-195e-4dba-b397-3e99918cf8ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:35.770884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f996fc94-195e-4dba-b397-3e99918cf8ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:35.771637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f996fc94-195e-4dba-b397-3e99918cf8ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:35.772072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f996fc94-195e-4dba-b397-3e99918cf8ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:35.900249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f996fc94-195e-4dba-b397-3e99918cf8ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:35.909295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f996fc94-195e-4dba-b397-3e99918cf8ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149494 Jul 28 20:22:35.909856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1143/2425] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:35 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:36.114518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e148cbfd-04a9-4435-8be9-f06c132f765f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:36.115125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e148cbfd-04a9-4435-8be9-f06c132f765f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:36.121595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e148cbfd-04a9-4435-8be9-f06c132f765f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:36.122032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e148cbfd-04a9-4435-8be9-f06c132f765f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:36.122791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e148cbfd-04a9-4435-8be9-f06c132f765f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:36.123192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e148cbfd-04a9-4435-8be9-f06c132f765f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:36.183258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0083755c-d445-4d3f-b1bf-7914aacf4c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:36.183901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0083755c-d445-4d3f-b1bf-7914aacf4c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:36.190705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0083755c-d445-4d3f-b1bf-7914aacf4c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:36.191147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0083755c-d445-4d3f-b1bf-7914aacf4c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:36.191903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0083755c-d445-4d3f-b1bf-7914aacf4c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:36.192334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0083755c-d445-4d3f-b1bf-7914aacf4c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:36.265212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0083755c-d445-4d3f-b1bf-7914aacf4c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:36.273724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0083755c-d445-4d3f-b1bf-7914aacf4c2e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.094290 Jul 28 20:22:36.274292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1144/2426] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:36 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:36.279786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e148cbfd-04a9-4435-8be9-f06c132f765f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:36.287819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e148cbfd-04a9-4435-8be9-f06c132f765f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.177073 Jul 28 20:22:36.288380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1283/2427] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:36 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:36.930664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-57351f29-4776-4de8-82b7-9a76fa1df5ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:36.931277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-57351f29-4776-4de8-82b7-9a76fa1df5ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:36.938468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57351f29-4776-4de8-82b7-9a76fa1df5ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:36.939215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57351f29-4776-4de8-82b7-9a76fa1df5ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:36.939974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57351f29-4776-4de8-82b7-9a76fa1df5ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:36.940411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57351f29-4776-4de8-82b7-9a76fa1df5ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:37.073460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-57351f29-4776-4de8-82b7-9a76fa1df5ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:37.081385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-57351f29-4776-4de8-82b7-9a76fa1df5ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154554 Jul 28 20:22:37.081938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1145/2428] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:36 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:37.294698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c03cdbf9-bd73-4c51-8d47-3dc2ec96b414 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:37.295311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c03cdbf9-bd73-4c51-8d47-3dc2ec96b414 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:37.303064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c03cdbf9-bd73-4c51-8d47-3dc2ec96b414 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:37.303527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c03cdbf9-bd73-4c51-8d47-3dc2ec96b414 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:37.304348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c03cdbf9-bd73-4c51-8d47-3dc2ec96b414 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:37.304812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c03cdbf9-bd73-4c51-8d47-3dc2ec96b414 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:37.308973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6c7194a8-e732-4dcf-8d8d-f1c337603e5e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:37.309590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6c7194a8-e732-4dcf-8d8d-f1c337603e5e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:37.316157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c7194a8-e732-4dcf-8d8d-f1c337603e5e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:37.316638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c7194a8-e732-4dcf-8d8d-f1c337603e5e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:37.317403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c7194a8-e732-4dcf-8d8d-f1c337603e5e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:37.317833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c7194a8-e732-4dcf-8d8d-f1c337603e5e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:37.368792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c03cdbf9-bd73-4c51-8d47-3dc2ec96b414 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:37.376987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c03cdbf9-bd73-4c51-8d47-3dc2ec96b414 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086053 Jul 28 20:22:37.377562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1284/2429] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:37.463589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6c7194a8-e732-4dcf-8d8d-f1c337603e5e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:37.472400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6c7194a8-e732-4dcf-8d8d-f1c337603e5e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.167278 Jul 28 20:22:37.472992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1146/2430] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:37 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:38.103271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9ea66c3b-1e7c-4192-8dc5-77a954e5833e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:38.103878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9ea66c3b-1e7c-4192-8dc5-77a954e5833e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:38.110610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ea66c3b-1e7c-4192-8dc5-77a954e5833e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:38.111051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ea66c3b-1e7c-4192-8dc5-77a954e5833e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:38.111797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ea66c3b-1e7c-4192-8dc5-77a954e5833e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:38.112219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ea66c3b-1e7c-4192-8dc5-77a954e5833e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:38.241419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9ea66c3b-1e7c-4192-8dc5-77a954e5833e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:38.249181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9ea66c3b-1e7c-4192-8dc5-77a954e5833e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149814 Jul 28 20:22:38.249770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1285/2431] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:38 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:38.397960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bf9fa452-14ec-4fad-b806-85d742299738 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:38.398542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bf9fa452-14ec-4fad-b806-85d742299738 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:38.405342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf9fa452-14ec-4fad-b806-85d742299738 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:38.405791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf9fa452-14ec-4fad-b806-85d742299738 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:38.407283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf9fa452-14ec-4fad-b806-85d742299738 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:38.407719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf9fa452-14ec-4fad-b806-85d742299738 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:38.411612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:38.467664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bf9fa452-14ec-4fad-b806-85d742299738 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:38.476354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bf9fa452-14ec-4fad-b806-85d742299738 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082345 Jul 28 20:22:38.476933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1147/2432] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:38.493283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-22a12a3a-f39d-48bb-b920-7fdcc7e3c3d3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:38.493886 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-22a12a3a-f39d-48bb-b920-7fdcc7e3c3d3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:38.501230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-22a12a3a-f39d-48bb-b920-7fdcc7e3c3d3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:38.501664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-22a12a3a-f39d-48bb-b920-7fdcc7e3c3d3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:38.502409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-22a12a3a-f39d-48bb-b920-7fdcc7e3c3d3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:38.502834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-22a12a3a-f39d-48bb-b920-7fdcc7e3c3d3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:38.631836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-22a12a3a-f39d-48bb-b920-7fdcc7e3c3d3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:38.639648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-22a12a3a-f39d-48bb-b920-7fdcc7e3c3d3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150244 Jul 28 20:22:38.640211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1286/2433] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:39.270438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c33c2445-69f7-43fb-bf1e-64847ea7bd66 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:39.271053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c33c2445-69f7-43fb-bf1e-64847ea7bd66 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:39.277138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c33c2445-69f7-43fb-bf1e-64847ea7bd66 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:39.277670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c33c2445-69f7-43fb-bf1e-64847ea7bd66 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:39.278423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c33c2445-69f7-43fb-bf1e-64847ea7bd66 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:39.278859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c33c2445-69f7-43fb-bf1e-64847ea7bd66 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:39.406956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c33c2445-69f7-43fb-bf1e-64847ea7bd66 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:39.414909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c33c2445-69f7-43fb-bf1e-64847ea7bd66 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148366 Jul 28 20:22:39.415443 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1148/2434] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:39 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:39.496969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a95c933e-b163-4770-88f6-a2c66aa84317 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:39.497574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a95c933e-b163-4770-88f6-a2c66aa84317 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:39.504766 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a95c933e-b163-4770-88f6-a2c66aa84317 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:39.505208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a95c933e-b163-4770-88f6-a2c66aa84317 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:39.505952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a95c933e-b163-4770-88f6-a2c66aa84317 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:39.506379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a95c933e-b163-4770-88f6-a2c66aa84317 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:39.566344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a95c933e-b163-4770-88f6-a2c66aa84317 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:39.574607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a95c933e-b163-4770-88f6-a2c66aa84317 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081448 Jul 28 20:22:39.575186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1287/2435] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:39.661269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3a48f448-7ccf-4b5f-bb50-196658311597 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:39.661877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3a48f448-7ccf-4b5f-bb50-196658311597 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:39.667898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a48f448-7ccf-4b5f-bb50-196658311597 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:39.668269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a48f448-7ccf-4b5f-bb50-196658311597 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:39.669053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a48f448-7ccf-4b5f-bb50-196658311597 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:39.669485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a48f448-7ccf-4b5f-bb50-196658311597 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:39.800584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3a48f448-7ccf-4b5f-bb50-196658311597 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:39.808435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3a48f448-7ccf-4b5f-bb50-196658311597 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151016 Jul 28 20:22:39.809022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1149/2436] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:39 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:40.435300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f8b023ed-9f82-473f-b04b-ad6e538e7028 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:40.435841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f8b023ed-9f82-473f-b04b-ad6e538e7028 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:40.443396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8b023ed-9f82-473f-b04b-ad6e538e7028 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:40.443837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8b023ed-9f82-473f-b04b-ad6e538e7028 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:40.444618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8b023ed-9f82-473f-b04b-ad6e538e7028 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:40.445044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8b023ed-9f82-473f-b04b-ad6e538e7028 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:40.571230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f8b023ed-9f82-473f-b04b-ad6e538e7028 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:40.580123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f8b023ed-9f82-473f-b04b-ad6e538e7028 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148715 Jul 28 20:22:40.580692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1288/2437] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:40 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:40.597576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-821cbe9e-4e47-43e1-b55b-2e55df3030b8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:40.598187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-821cbe9e-4e47-43e1-b55b-2e55df3030b8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:40.604763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-821cbe9e-4e47-43e1-b55b-2e55df3030b8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:40.605207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-821cbe9e-4e47-43e1-b55b-2e55df3030b8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:40.606245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-821cbe9e-4e47-43e1-b55b-2e55df3030b8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:40.606768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-821cbe9e-4e47-43e1-b55b-2e55df3030b8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:40.667498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-821cbe9e-4e47-43e1-b55b-2e55df3030b8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:40.675513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-821cbe9e-4e47-43e1-b55b-2e55df3030b8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082366 Jul 28 20:22:40.676084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1150/2438] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:40.830224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c3cc53a7-9c08-4ec3-9c0b-106c07f2a0ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:40.830834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c3cc53a7-9c08-4ec3-9c0b-106c07f2a0ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:40.836850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c3cc53a7-9c08-4ec3-9c0b-106c07f2a0ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:40.837289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c3cc53a7-9c08-4ec3-9c0b-106c07f2a0ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:40.838030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c3cc53a7-9c08-4ec3-9c0b-106c07f2a0ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:40.838453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c3cc53a7-9c08-4ec3-9c0b-106c07f2a0ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:40.977446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c3cc53a7-9c08-4ec3-9c0b-106c07f2a0ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:40.981066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:40.986719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c3cc53a7-9c08-4ec3-9c0b-106c07f2a0ea tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.160648 Jul 28 20:22:40.987268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1289/2439] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:41.600758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7bf45f38-973a-4561-b9d1-3c6481394a55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:41.601361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7bf45f38-973a-4561-b9d1-3c6481394a55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:41.608110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bf45f38-973a-4561-b9d1-3c6481394a55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:41.608568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bf45f38-973a-4561-b9d1-3c6481394a55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:41.609395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bf45f38-973a-4561-b9d1-3c6481394a55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:41.609902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7bf45f38-973a-4561-b9d1-3c6481394a55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:41.696029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0aa0180e-590c-426b-b35b-7f30b58d7128 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:41.696674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0aa0180e-590c-426b-b35b-7f30b58d7128 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:41.705104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0aa0180e-590c-426b-b35b-7f30b58d7128 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:41.705552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0aa0180e-590c-426b-b35b-7f30b58d7128 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:41.706317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0aa0180e-590c-426b-b35b-7f30b58d7128 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:41.706748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0aa0180e-590c-426b-b35b-7f30b58d7128 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:41.745933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7bf45f38-973a-4561-b9d1-3c6481394a55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:41.755285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7bf45f38-973a-4561-b9d1-3c6481394a55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.158281 Jul 28 20:22:41.755962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1151/2440] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:41 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:41.779500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0aa0180e-590c-426b-b35b-7f30b58d7128 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:41.788079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0aa0180e-590c-426b-b35b-7f30b58d7128 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.095825 Jul 28 20:22:41.788652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1290/2441] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:42.007117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a887b7b6-d23b-4521-85a8-78206ebc1f59 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:42.007727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a887b7b6-d23b-4521-85a8-78206ebc1f59 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:42.015978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a887b7b6-d23b-4521-85a8-78206ebc1f59 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:42.016433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a887b7b6-d23b-4521-85a8-78206ebc1f59 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:42.017223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a887b7b6-d23b-4521-85a8-78206ebc1f59 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:42.017658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a887b7b6-d23b-4521-85a8-78206ebc1f59 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:42.145883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a887b7b6-d23b-4521-85a8-78206ebc1f59 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:42.153840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a887b7b6-d23b-4521-85a8-78206ebc1f59 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150439 Jul 28 20:22:42.154592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1152/2442] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:42 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:42.777132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d364742b-eb56-4236-ba8f-601746676d44 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:42.777725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d364742b-eb56-4236-ba8f-601746676d44 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:42.785087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d364742b-eb56-4236-ba8f-601746676d44 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:42.785533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d364742b-eb56-4236-ba8f-601746676d44 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:42.786278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d364742b-eb56-4236-ba8f-601746676d44 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:42.786706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d364742b-eb56-4236-ba8f-601746676d44 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:42.811252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-35ddb404-485b-4e4e-983e-fce69d6a7e52 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:42.812006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-35ddb404-485b-4e4e-983e-fce69d6a7e52 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:42.819079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35ddb404-485b-4e4e-983e-fce69d6a7e52 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:42.819522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35ddb404-485b-4e4e-983e-fce69d6a7e52 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:42.820280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35ddb404-485b-4e4e-983e-fce69d6a7e52 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:42.820740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35ddb404-485b-4e4e-983e-fce69d6a7e52 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:42.887810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-35ddb404-485b-4e4e-983e-fce69d6a7e52 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:42.896327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-35ddb404-485b-4e4e-983e-fce69d6a7e52 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.088979 Jul 28 20:22:42.896927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1153/2443] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:42.944515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d364742b-eb56-4236-ba8f-601746676d44 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:42.952477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d364742b-eb56-4236-ba8f-601746676d44 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.179147 Jul 28 20:22:42.953209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1291/2444] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:42 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:43.176231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bc1647ac-0d82-49a5-b07b-ca6309b45f99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:43.176878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bc1647ac-0d82-49a5-b07b-ca6309b45f99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:43.182977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bc1647ac-0d82-49a5-b07b-ca6309b45f99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:43.183422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bc1647ac-0d82-49a5-b07b-ca6309b45f99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:43.184169 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bc1647ac-0d82-49a5-b07b-ca6309b45f99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:43.184620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bc1647ac-0d82-49a5-b07b-ca6309b45f99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:43.309135 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bc1647ac-0d82-49a5-b07b-ca6309b45f99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:43.316992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bc1647ac-0d82-49a5-b07b-ca6309b45f99 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.145649 Jul 28 20:22:43.317544 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1154/2445] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:43 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:43.917848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9f867f9b-8ff8-4cb4-9b9c-0f0c590fab2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:43.918522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9f867f9b-8ff8-4cb4-9b9c-0f0c590fab2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:43.925046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f867f9b-8ff8-4cb4-9b9c-0f0c590fab2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:43.925487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f867f9b-8ff8-4cb4-9b9c-0f0c590fab2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:43.926227 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f867f9b-8ff8-4cb4-9b9c-0f0c590fab2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:43.926650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f867f9b-8ff8-4cb4-9b9c-0f0c590fab2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:43.974165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-14907c08-a772-4584-93ec-1401be8b7394 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:43.974863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-14907c08-a772-4584-93ec-1401be8b7394 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:43.981480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14907c08-a772-4584-93ec-1401be8b7394 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:43.982001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14907c08-a772-4584-93ec-1401be8b7394 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:43.983105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14907c08-a772-4584-93ec-1401be8b7394 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:43.983606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-14907c08-a772-4584-93ec-1401be8b7394 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:43.987163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9f867f9b-8ff8-4cb4-9b9c-0f0c590fab2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:43.994966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9f867f9b-8ff8-4cb4-9b9c-0f0c590fab2c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080972 Jul 28 20:22:43.995523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1292/2446] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:44.117153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-14907c08-a772-4584-93ec-1401be8b7394 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:44.126157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-14907c08-a772-4584-93ec-1401be8b7394 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.155885 Jul 28 20:22:44.126715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1155/2447] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:43 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:44.338532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0c9d85a1-8f6b-486c-83b1-2577543c06ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:44.339144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0c9d85a1-8f6b-486c-83b1-2577543c06ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:44.345377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c9d85a1-8f6b-486c-83b1-2577543c06ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:44.345820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c9d85a1-8f6b-486c-83b1-2577543c06ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:44.346567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c9d85a1-8f6b-486c-83b1-2577543c06ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:44.346994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c9d85a1-8f6b-486c-83b1-2577543c06ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:44.476890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0c9d85a1-8f6b-486c-83b1-2577543c06ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:44.484779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0c9d85a1-8f6b-486c-83b1-2577543c06ee tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150072 Jul 28 20:22:44.485333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1293/2448] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:44 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:45.017090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2a2947e4-c23f-4d60-b200-f6d34710504a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:45.017700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2a2947e4-c23f-4d60-b200-f6d34710504a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:45.024097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a2947e4-c23f-4d60-b200-f6d34710504a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:45.024559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a2947e4-c23f-4d60-b200-f6d34710504a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:45.025317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a2947e4-c23f-4d60-b200-f6d34710504a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:45.025743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a2947e4-c23f-4d60-b200-f6d34710504a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:45.087259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2a2947e4-c23f-4d60-b200-f6d34710504a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:45.096950 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2a2947e4-c23f-4d60-b200-f6d34710504a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083758 Jul 28 20:22:45.097527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1156/2449] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:45.146980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-44a65220-d37f-4be5-bee6-d69b82b25771 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:45.147593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-44a65220-d37f-4be5-bee6-d69b82b25771 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:45.154271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44a65220-d37f-4be5-bee6-d69b82b25771 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:45.154720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44a65220-d37f-4be5-bee6-d69b82b25771 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:45.156278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44a65220-d37f-4be5-bee6-d69b82b25771 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:45.156771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44a65220-d37f-4be5-bee6-d69b82b25771 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:45.288136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-44a65220-d37f-4be5-bee6-d69b82b25771 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:45.296016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-44a65220-d37f-4be5-bee6-d69b82b25771 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152817 Jul 28 20:22:45.296741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1294/2450] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:45 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:45.507884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c7e8f808-61e1-48d1-8910-6eccb1576e7e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:45.508496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c7e8f808-61e1-48d1-8910-6eccb1576e7e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:45.514691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c7e8f808-61e1-48d1-8910-6eccb1576e7e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:45.515907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c7e8f808-61e1-48d1-8910-6eccb1576e7e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:45.516692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c7e8f808-61e1-48d1-8910-6eccb1576e7e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:45.517121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c7e8f808-61e1-48d1-8910-6eccb1576e7e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:45.646457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c7e8f808-61e1-48d1-8910-6eccb1576e7e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:45.654620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c7e8f808-61e1-48d1-8910-6eccb1576e7e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150319 Jul 28 20:22:45.655176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1157/2451] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:46.118154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5051d30a-9b67-43fa-bc69-82b9bc0cd573 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:46.118758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5051d30a-9b67-43fa-bc69-82b9bc0cd573 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:46.125252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5051d30a-9b67-43fa-bc69-82b9bc0cd573 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:46.125691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5051d30a-9b67-43fa-bc69-82b9bc0cd573 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:46.126528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5051d30a-9b67-43fa-bc69-82b9bc0cd573 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:46.126953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5051d30a-9b67-43fa-bc69-82b9bc0cd573 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:46.191213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5051d30a-9b67-43fa-bc69-82b9bc0cd573 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:46.199253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5051d30a-9b67-43fa-bc69-82b9bc0cd573 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084996 Jul 28 20:22:46.199832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1295/2452] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:46.316938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-850a0c66-ea87-4847-9516-e7354658174e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:46.317559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-850a0c66-ea87-4847-9516-e7354658174e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:46.324367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-850a0c66-ea87-4847-9516-e7354658174e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:46.324838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-850a0c66-ea87-4847-9516-e7354658174e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:46.325623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-850a0c66-ea87-4847-9516-e7354658174e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:46.326058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-850a0c66-ea87-4847-9516-e7354658174e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:46.455445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-850a0c66-ea87-4847-9516-e7354658174e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:46.463337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-850a0c66-ea87-4847-9516-e7354658174e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150289 Jul 28 20:22:46.463896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1158/2453] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:46 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:46.675424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c132d358-4732-4061-ade1-ea508362a704 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:46.675981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c132d358-4732-4061-ade1-ea508362a704 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:46.682692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c132d358-4732-4061-ade1-ea508362a704 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:46.683136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c132d358-4732-4061-ade1-ea508362a704 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:46.683889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c132d358-4732-4061-ade1-ea508362a704 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:46.684320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c132d358-4732-4061-ade1-ea508362a704 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:46.814816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c132d358-4732-4061-ade1-ea508362a704 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:46.822797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c132d358-4732-4061-ade1-ea508362a704 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151284 Jul 28 20:22:46.823355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1296/2454] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:47.219306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d3eb8ca5-309a-4d6a-a95a-74e3f047b060 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:47.219924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d3eb8ca5-309a-4d6a-a95a-74e3f047b060 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:47.225977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3eb8ca5-309a-4d6a-a95a-74e3f047b060 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:47.226430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3eb8ca5-309a-4d6a-a95a-74e3f047b060 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:47.227189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3eb8ca5-309a-4d6a-a95a-74e3f047b060 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:47.227625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3eb8ca5-309a-4d6a-a95a-74e3f047b060 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:47.292704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d3eb8ca5-309a-4d6a-a95a-74e3f047b060 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:47.301415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d3eb8ca5-309a-4d6a-a95a-74e3f047b060 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086023 Jul 28 20:22:47.301988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1159/2455] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:47 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:47.486424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7d872a80-bfde-4f96-aa45-b308514ffe78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:47.486982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7d872a80-bfde-4f96-aa45-b308514ffe78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:47.493472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7d872a80-bfde-4f96-aa45-b308514ffe78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:47.493916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7d872a80-bfde-4f96-aa45-b308514ffe78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:47.494661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7d872a80-bfde-4f96-aa45-b308514ffe78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:47.495090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7d872a80-bfde-4f96-aa45-b308514ffe78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:47.625666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7d872a80-bfde-4f96-aa45-b308514ffe78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:47.633395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7d872a80-bfde-4f96-aa45-b308514ffe78 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152113 Jul 28 20:22:47.633951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1297/2456] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:47 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:47.845850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dcfe30fa-2f0f-44c5-adc3-d9baef92e371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:47.846501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dcfe30fa-2f0f-44c5-adc3-d9baef92e371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:47.853051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcfe30fa-2f0f-44c5-adc3-d9baef92e371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:47.853493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcfe30fa-2f0f-44c5-adc3-d9baef92e371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:47.854244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcfe30fa-2f0f-44c5-adc3-d9baef92e371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:47.854675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dcfe30fa-2f0f-44c5-adc3-d9baef92e371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:47.980448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dcfe30fa-2f0f-44c5-adc3-d9baef92e371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:47.988673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dcfe30fa-2f0f-44c5-adc3-d9baef92e371 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147382 Jul 28 20:22:47.989233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1160/2457] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:48.323217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f0982b9d-0e4f-4d23-b617-e6066618c5d8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:48.323829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f0982b9d-0e4f-4d23-b617-e6066618c5d8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:48.333493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0982b9d-0e4f-4d23-b617-e6066618c5d8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:48.333963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0982b9d-0e4f-4d23-b617-e6066618c5d8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:48.334718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0982b9d-0e4f-4d23-b617-e6066618c5d8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:48.335145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0982b9d-0e4f-4d23-b617-e6066618c5d8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:48.402086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f0982b9d-0e4f-4d23-b617-e6066618c5d8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:48.410775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f0982b9d-0e4f-4d23-b617-e6066618c5d8 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.091459 Jul 28 20:22:48.411313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1298/2458] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:48.655057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fe0fae86-23cc-4f9d-99d0-c29fb3a53449 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:48.656409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fe0fae86-23cc-4f9d-99d0-c29fb3a53449 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:48.662392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe0fae86-23cc-4f9d-99d0-c29fb3a53449 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:48.662834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe0fae86-23cc-4f9d-99d0-c29fb3a53449 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:48.663579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe0fae86-23cc-4f9d-99d0-c29fb3a53449 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:48.664004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe0fae86-23cc-4f9d-99d0-c29fb3a53449 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:48.792668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fe0fae86-23cc-4f9d-99d0-c29fb3a53449 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:48.800501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fe0fae86-23cc-4f9d-99d0-c29fb3a53449 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149849 Jul 28 20:22:48.801090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1161/2459] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:48 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:49.009847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8a2860ee-854c-41a4-b923-feff55d02edc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:49.010395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8a2860ee-854c-41a4-b923-feff55d02edc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:49.017942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a2860ee-854c-41a4-b923-feff55d02edc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:49.018392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a2860ee-854c-41a4-b923-feff55d02edc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:49.019138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a2860ee-854c-41a4-b923-feff55d02edc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:49.019569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8a2860ee-854c-41a4-b923-feff55d02edc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:49.145963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8a2860ee-854c-41a4-b923-feff55d02edc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:49.153816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8a2860ee-854c-41a4-b923-feff55d02edc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147923 Jul 28 20:22:49.154615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1299/2460] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:49 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:49.433286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9efe8a7f-9dfe-4d2e-8dcd-e56104e0b410 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:49.433927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9efe8a7f-9dfe-4d2e-8dcd-e56104e0b410 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:49.441175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9efe8a7f-9dfe-4d2e-8dcd-e56104e0b410 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:49.441640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9efe8a7f-9dfe-4d2e-8dcd-e56104e0b410 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:49.442376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9efe8a7f-9dfe-4d2e-8dcd-e56104e0b410 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:49.442812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9efe8a7f-9dfe-4d2e-8dcd-e56104e0b410 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:49.505638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9efe8a7f-9dfe-4d2e-8dcd-e56104e0b410 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:49.513867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9efe8a7f-9dfe-4d2e-8dcd-e56104e0b410 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085254 Jul 28 20:22:49.514427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1162/2461] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:49.821431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7f9a5add-c09c-4b96-bf92-7a2b25795948 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:49.822043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7f9a5add-c09c-4b96-bf92-7a2b25795948 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:49.828303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7f9a5add-c09c-4b96-bf92-7a2b25795948 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:49.828792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7f9a5add-c09c-4b96-bf92-7a2b25795948 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:49.829559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7f9a5add-c09c-4b96-bf92-7a2b25795948 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:49.829996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7f9a5add-c09c-4b96-bf92-7a2b25795948 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:49.958559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7f9a5add-c09c-4b96-bf92-7a2b25795948 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:49.966382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7f9a5add-c09c-4b96-bf92-7a2b25795948 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148842 Jul 28 20:22:49.966937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1300/2462] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:49 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:50.175577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-447ba9c7-e041-4ef5-8b4f-3779aa485d92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:50.176186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-447ba9c7-e041-4ef5-8b4f-3779aa485d92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:50.182181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-447ba9c7-e041-4ef5-8b4f-3779aa485d92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:50.182628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-447ba9c7-e041-4ef5-8b4f-3779aa485d92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:50.183376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-447ba9c7-e041-4ef5-8b4f-3779aa485d92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:50.183809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-447ba9c7-e041-4ef5-8b4f-3779aa485d92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:50.310233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-447ba9c7-e041-4ef5-8b4f-3779aa485d92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:50.313730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:50.319302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-447ba9c7-e041-4ef5-8b4f-3779aa485d92 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147610 Jul 28 20:22:50.319866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1163/2463] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:50 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:50.535739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f4ac7b58-3220-4c82-b660-bf812a6d1e81 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:50.536282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f4ac7b58-3220-4c82-b660-bf812a6d1e81 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:50.542731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4ac7b58-3220-4c82-b660-bf812a6d1e81 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:50.543177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4ac7b58-3220-4c82-b660-bf812a6d1e81 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:50.543930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4ac7b58-3220-4c82-b660-bf812a6d1e81 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:50.544368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4ac7b58-3220-4c82-b660-bf812a6d1e81 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:50.607941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f4ac7b58-3220-4c82-b660-bf812a6d1e81 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:50.616578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f4ac7b58-3220-4c82-b660-bf812a6d1e81 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084832 Jul 28 20:22:50.617145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1301/2464] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:50.988095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d73736e3-8993-4429-85d1-d760b30d8c4b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:50.988750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d73736e3-8993-4429-85d1-d760b30d8c4b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:50.995243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d73736e3-8993-4429-85d1-d760b30d8c4b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:50.995689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d73736e3-8993-4429-85d1-d760b30d8c4b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:50.996442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d73736e3-8993-4429-85d1-d760b30d8c4b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:50.996903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d73736e3-8993-4429-85d1-d760b30d8c4b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:51.124778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d73736e3-8993-4429-85d1-d760b30d8c4b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:51.132674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d73736e3-8993-4429-85d1-d760b30d8c4b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148891 Jul 28 20:22:51.133240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1164/2465] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:50 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:51.340639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1d3a183e-88ef-4302-b4e5-2930dcddc2fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:51.341252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1d3a183e-88ef-4302-b4e5-2930dcddc2fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:51.347820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d3a183e-88ef-4302-b4e5-2930dcddc2fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:51.348254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d3a183e-88ef-4302-b4e5-2930dcddc2fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:51.349025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d3a183e-88ef-4302-b4e5-2930dcddc2fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:51.349451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1d3a183e-88ef-4302-b4e5-2930dcddc2fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:51.475812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1d3a183e-88ef-4302-b4e5-2930dcddc2fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:51.484523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1d3a183e-88ef-4302-b4e5-2930dcddc2fa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146946 Jul 28 20:22:51.484897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1302/2466] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:51.637595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dbea80e3-e4de-4db3-9fc7-b24fbecdf871 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:51.638365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dbea80e3-e4de-4db3-9fc7-b24fbecdf871 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:51.645146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dbea80e3-e4de-4db3-9fc7-b24fbecdf871 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:51.645585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dbea80e3-e4de-4db3-9fc7-b24fbecdf871 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:51.646344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dbea80e3-e4de-4db3-9fc7-b24fbecdf871 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:51.646752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dbea80e3-e4de-4db3-9fc7-b24fbecdf871 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:51.709848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dbea80e3-e4de-4db3-9fc7-b24fbecdf871 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:51.718558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dbea80e3-e4de-4db3-9fc7-b24fbecdf871 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084146 Jul 28 20:22:51.719322 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1165/2467] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:52.154437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3d516260-5156-4237-93d4-0a27910f8d30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:52.155051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3d516260-5156-4237-93d4-0a27910f8d30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:52.162156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d516260-5156-4237-93d4-0a27910f8d30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:52.162589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d516260-5156-4237-93d4-0a27910f8d30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:52.163353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d516260-5156-4237-93d4-0a27910f8d30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:52.163792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d516260-5156-4237-93d4-0a27910f8d30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:52.291161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3d516260-5156-4237-93d4-0a27910f8d30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:52.299758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3d516260-5156-4237-93d4-0a27910f8d30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149368 Jul 28 20:22:52.300325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1303/2468] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:52 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:52.506567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5025da14-c900-43e6-a894-174ea1a6cc0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:52.507175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5025da14-c900-43e6-a894-174ea1a6cc0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:52.509489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=84 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:52.514707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5025da14-c900-43e6-a894-174ea1a6cc0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:52.515270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5025da14-c900-43e6-a894-174ea1a6cc0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:52.516029 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5025da14-c900-43e6-a894-174ea1a6cc0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:52.516461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5025da14-c900-43e6-a894-174ea1a6cc0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:52.642317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5025da14-c900-43e6-a894-174ea1a6cc0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:52.650204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5025da14-c900-43e6-a894-174ea1a6cc0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147512 Jul 28 20:22:52.650802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1166/2469] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:52 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:52.739762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d11bc04a-eae2-4702-a9fe-8069bfbb34df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:52.740366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d11bc04a-eae2-4702-a9fe-8069bfbb34df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:52.746345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d11bc04a-eae2-4702-a9fe-8069bfbb34df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:52.746781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d11bc04a-eae2-4702-a9fe-8069bfbb34df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:52.747519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d11bc04a-eae2-4702-a9fe-8069bfbb34df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:52.747957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d11bc04a-eae2-4702-a9fe-8069bfbb34df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:52.810653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d11bc04a-eae2-4702-a9fe-8069bfbb34df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:52.818556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d11bc04a-eae2-4702-a9fe-8069bfbb34df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082595 Jul 28 20:22:52.819108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1304/2470] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:53.321190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e6342941-1a8c-4775-95e3-910d1fc081c4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:53.321799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e6342941-1a8c-4775-95e3-910d1fc081c4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:53.328867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6342941-1a8c-4775-95e3-910d1fc081c4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:53.329318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6342941-1a8c-4775-95e3-910d1fc081c4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:53.330070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6342941-1a8c-4775-95e3-910d1fc081c4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:53.330535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e6342941-1a8c-4775-95e3-910d1fc081c4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:53.462844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e6342941-1a8c-4775-95e3-910d1fc081c4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:53.471999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e6342941-1a8c-4775-95e3-910d1fc081c4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154612 Jul 28 20:22:53.472580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1167/2471] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:53 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:53.672115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9910df86-0544-47af-bc1b-f68388e97fcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:53.672781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9910df86-0544-47af-bc1b-f68388e97fcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:53.675129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:53.680466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9910df86-0544-47af-bc1b-f68388e97fcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:53.680941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9910df86-0544-47af-bc1b-f68388e97fcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:53.681697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9910df86-0544-47af-bc1b-f68388e97fcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:53.682132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9910df86-0544-47af-bc1b-f68388e97fcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:53.810315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9910df86-0544-47af-bc1b-f68388e97fcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:53.818573 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9910df86-0544-47af-bc1b-f68388e97fcf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150403 Jul 28 20:22:53.819133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1305/2472] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:53.839093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5af4858b-39c0-4a7d-8931-738a593e0023 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:53.839700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5af4858b-39c0-4a7d-8931-738a593e0023 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:53.847086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5af4858b-39c0-4a7d-8931-738a593e0023 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:53.847530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5af4858b-39c0-4a7d-8931-738a593e0023 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:53.848298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5af4858b-39c0-4a7d-8931-738a593e0023 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:53.848779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5af4858b-39c0-4a7d-8931-738a593e0023 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:53.912910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5af4858b-39c0-4a7d-8931-738a593e0023 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:53.920867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5af4858b-39c0-4a7d-8931-738a593e0023 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085556 Jul 28 20:22:53.921680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1168/2473] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:54.493879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d5372466-425d-443c-8003-6ee3727a4e30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:54.494485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d5372466-425d-443c-8003-6ee3727a4e30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:54.500999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5372466-425d-443c-8003-6ee3727a4e30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:54.501449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5372466-425d-443c-8003-6ee3727a4e30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:54.502179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5372466-425d-443c-8003-6ee3727a4e30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:54.502602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d5372466-425d-443c-8003-6ee3727a4e30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:54.520893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:22:54.631623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d5372466-425d-443c-8003-6ee3727a4e30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:54.639486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d5372466-425d-443c-8003-6ee3727a4e30 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149498 Jul 28 20:22:54.640033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1306/2474] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:54 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:54.839207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0b9e8d99-d3af-4d31-b77e-8a1e84be5dcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:54.839825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0b9e8d99-d3af-4d31-b77e-8a1e84be5dcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:54.846256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b9e8d99-d3af-4d31-b77e-8a1e84be5dcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:54.846700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b9e8d99-d3af-4d31-b77e-8a1e84be5dcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:54.847457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b9e8d99-d3af-4d31-b77e-8a1e84be5dcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:54.847887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0b9e8d99-d3af-4d31-b77e-8a1e84be5dcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:54.942950 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b10cd870-7c93-4539-81f0-bfd6f9e613c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:54.943590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b10cd870-7c93-4539-81f0-bfd6f9e613c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:54.950098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b10cd870-7c93-4539-81f0-bfd6f9e613c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:54.950543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b10cd870-7c93-4539-81f0-bfd6f9e613c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:54.951308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b10cd870-7c93-4539-81f0-bfd6f9e613c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:54.951743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b10cd870-7c93-4539-81f0-bfd6f9e613c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:54.979403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0b9e8d99-d3af-4d31-b77e-8a1e84be5dcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:54.988502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0b9e8d99-d3af-4d31-b77e-8a1e84be5dcb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.153118 Jul 28 20:22:54.989114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1169/2475] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:55.018483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b10cd870-7c93-4539-81f0-bfd6f9e613c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:55.026382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b10cd870-7c93-4539-81f0-bfd6f9e613c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087429 Jul 28 20:22:55.026941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1307/2476] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:55.663285 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-67c36182-d7ac-4bba-a697-d22f5bd5bfcb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:55.663935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-67c36182-d7ac-4bba-a697-d22f5bd5bfcb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:55.669991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c36182-d7ac-4bba-a697-d22f5bd5bfcb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:55.670439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c36182-d7ac-4bba-a697-d22f5bd5bfcb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:55.671189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c36182-d7ac-4bba-a697-d22f5bd5bfcb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:55.671618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c36182-d7ac-4bba-a697-d22f5bd5bfcb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:55.807229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-67c36182-d7ac-4bba-a697-d22f5bd5bfcb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:55.816221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-67c36182-d7ac-4bba-a697-d22f5bd5bfcb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.156823 Jul 28 20:22:55.816820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1170/2477] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:55 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:56.010316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7668c606-7835-4c39-8c48-31c2ce1e053f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:56.010916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7668c606-7835-4c39-8c48-31c2ce1e053f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:56.017595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7668c606-7835-4c39-8c48-31c2ce1e053f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:56.018033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7668c606-7835-4c39-8c48-31c2ce1e053f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:56.018785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7668c606-7835-4c39-8c48-31c2ce1e053f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:56.019209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7668c606-7835-4c39-8c48-31c2ce1e053f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:56.048052 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0017e9ee-58c7-4dce-8450-5436c513c771 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:56.048837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0017e9ee-58c7-4dce-8450-5436c513c771 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:56.055355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0017e9ee-58c7-4dce-8450-5436c513c771 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:56.055736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0017e9ee-58c7-4dce-8450-5436c513c771 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:56.056494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0017e9ee-58c7-4dce-8450-5436c513c771 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:56.056954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0017e9ee-58c7-4dce-8450-5436c513c771 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:56.132053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0017e9ee-58c7-4dce-8450-5436c513c771 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:56.139819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0017e9ee-58c7-4dce-8450-5436c513c771 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.096244 Jul 28 20:22:56.140382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1171/2478] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:56 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:56.173378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7668c606-7835-4c39-8c48-31c2ce1e053f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:56.181296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7668c606-7835-4c39-8c48-31c2ce1e053f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.174856 Jul 28 20:22:56.181847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1308/2479] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:56.837319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-79d2c928-380c-4837-a4a7-d811988342d8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:56.838250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-79d2c928-380c-4837-a4a7-d811988342d8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:56.845026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79d2c928-380c-4837-a4a7-d811988342d8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:56.845404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79d2c928-380c-4837-a4a7-d811988342d8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:56.846159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79d2c928-380c-4837-a4a7-d811988342d8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:56.846598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79d2c928-380c-4837-a4a7-d811988342d8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:56.974790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-79d2c928-380c-4837-a4a7-d811988342d8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:56.984988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-79d2c928-380c-4837-a4a7-d811988342d8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151363 Jul 28 20:22:56.985617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1172/2480] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:56 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:57.161089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f3ffed0e-3505-4552-b2ba-e57af6960dc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:57.161692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f3ffed0e-3505-4552-b2ba-e57af6960dc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:57.168768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3ffed0e-3505-4552-b2ba-e57af6960dc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:57.169214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3ffed0e-3505-4552-b2ba-e57af6960dc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:57.169965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3ffed0e-3505-4552-b2ba-e57af6960dc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:57.170390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3ffed0e-3505-4552-b2ba-e57af6960dc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:57.203089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-71b4c7f0-69f0-45da-958a-9066044171d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:57.203917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-71b4c7f0-69f0-45da-958a-9066044171d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:57.210424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71b4c7f0-69f0-45da-958a-9066044171d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:57.210874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71b4c7f0-69f0-45da-958a-9066044171d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:57.211635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71b4c7f0-69f0-45da-958a-9066044171d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:57.212069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-71b4c7f0-69f0-45da-958a-9066044171d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:57.231407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f3ffed0e-3505-4552-b2ba-e57af6960dc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:57.239900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f3ffed0e-3505-4552-b2ba-e57af6960dc2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082603 Jul 28 20:22:57.240462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1309/2481] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:57.342594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-71b4c7f0-69f0-45da-958a-9066044171d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:57.351542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-71b4c7f0-69f0-45da-958a-9066044171d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152279 Jul 28 20:22:57.352096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1173/2482] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:57 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:22:58.006297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-62013505-58e7-4d8a-a8e2-ba4edc1a9492 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:58.006906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-62013505-58e7-4d8a-a8e2-ba4edc1a9492 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:58.013158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-62013505-58e7-4d8a-a8e2-ba4edc1a9492 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:58.013604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-62013505-58e7-4d8a-a8e2-ba4edc1a9492 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:58.014347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-62013505-58e7-4d8a-a8e2-ba4edc1a9492 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:58.014780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-62013505-58e7-4d8a-a8e2-ba4edc1a9492 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:58.142710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-62013505-58e7-4d8a-a8e2-ba4edc1a9492 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:58.150527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-62013505-58e7-4d8a-a8e2-ba4edc1a9492 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148082 Jul 28 20:22:58.151091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1310/2483] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:58 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:58.260833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-344371c0-84c8-4f87-bba4-1c920d62012c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:58.261358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-344371c0-84c8-4f87-bba4-1c920d62012c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:58.267877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-344371c0-84c8-4f87-bba4-1c920d62012c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:58.268326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-344371c0-84c8-4f87-bba4-1c920d62012c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:58.269112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-344371c0-84c8-4f87-bba4-1c920d62012c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:58.269546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-344371c0-84c8-4f87-bba4-1c920d62012c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:58.331286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-344371c0-84c8-4f87-bba4-1c920d62012c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:58.339307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-344371c0-84c8-4f87-bba4-1c920d62012c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082448 Jul 28 20:22:58.339932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1174/2484] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:58.373816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cce1028b-c6cc-4dfe-9db8-adc40f58c43b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:58.374430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cce1028b-c6cc-4dfe-9db8-adc40f58c43b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:58.380915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cce1028b-c6cc-4dfe-9db8-adc40f58c43b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:58.381366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cce1028b-c6cc-4dfe-9db8-adc40f58c43b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:58.382121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cce1028b-c6cc-4dfe-9db8-adc40f58c43b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:58.382555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cce1028b-c6cc-4dfe-9db8-adc40f58c43b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:58.513590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cce1028b-c6cc-4dfe-9db8-adc40f58c43b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:58.522242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cce1028b-c6cc-4dfe-9db8-adc40f58c43b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152346 Jul 28 20:22:58.522803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1311/2485] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:59.173034 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e24fe707-5645-4705-8b72-8e09eb33251f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:59.173660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e24fe707-5645-4705-8b72-8e09eb33251f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:59.179660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e24fe707-5645-4705-8b72-8e09eb33251f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:59.180109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e24fe707-5645-4705-8b72-8e09eb33251f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:59.180891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e24fe707-5645-4705-8b72-8e09eb33251f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:59.181328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e24fe707-5645-4705-8b72-8e09eb33251f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:59.308783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e24fe707-5645-4705-8b72-8e09eb33251f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:59.317077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e24fe707-5645-4705-8b72-8e09eb33251f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148491 Jul 28 20:22:59.317625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1175/2486] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:59 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:59.361195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-182be7cb-ed02-499e-b206-2b3e460fb0ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:59.361797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-182be7cb-ed02-499e-b206-2b3e460fb0ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:59.367720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-182be7cb-ed02-499e-b206-2b3e460fb0ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:59.368156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-182be7cb-ed02-499e-b206-2b3e460fb0ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:59.368936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-182be7cb-ed02-499e-b206-2b3e460fb0ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:59.369362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-182be7cb-ed02-499e-b206-2b3e460fb0ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:59.430934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-182be7cb-ed02-499e-b206-2b3e460fb0ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:59.440813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-182be7cb-ed02-499e-b206-2b3e460fb0ae tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083479 Jul 28 20:22:59.441385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1312/2487] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:22:59.544682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a050043a-029f-4d2a-b6ba-21a78c9d9c18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:22:59.545296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a050043a-029f-4d2a-b6ba-21a78c9d9c18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:22:59.552077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a050043a-029f-4d2a-b6ba-21a78c9d9c18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:59.552529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a050043a-029f-4d2a-b6ba-21a78c9d9c18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:59.553316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a050043a-029f-4d2a-b6ba-21a78c9d9c18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:22:59.553752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a050043a-029f-4d2a-b6ba-21a78c9d9c18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:22:59.686313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a050043a-029f-4d2a-b6ba-21a78c9d9c18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:22:59.694774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a050043a-029f-4d2a-b6ba-21a78c9d9c18 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.154008 Jul 28 20:22:59.695339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1176/2488] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:22:59 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:00.338203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-06bb5e33-5fde-4be8-b9a5-9db9dcaa9681 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:00.338809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-06bb5e33-5fde-4be8-b9a5-9db9dcaa9681 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:00.345040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06bb5e33-5fde-4be8-b9a5-9db9dcaa9681 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:00.345482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06bb5e33-5fde-4be8-b9a5-9db9dcaa9681 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:00.346233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06bb5e33-5fde-4be8-b9a5-9db9dcaa9681 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:00.346656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06bb5e33-5fde-4be8-b9a5-9db9dcaa9681 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:00.462018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-84d5d417-4d0f-4811-97cb-cd9256591edf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:00.462634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-84d5d417-4d0f-4811-97cb-cd9256591edf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:00.469552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-84d5d417-4d0f-4811-97cb-cd9256591edf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:00.470070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-84d5d417-4d0f-4811-97cb-cd9256591edf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:00.470780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-84d5d417-4d0f-4811-97cb-cd9256591edf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:00.471217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-84d5d417-4d0f-4811-97cb-cd9256591edf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:00.475417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-06bb5e33-5fde-4be8-b9a5-9db9dcaa9681 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:00.483494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-06bb5e33-5fde-4be8-b9a5-9db9dcaa9681 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149123 Jul 28 20:23:00.484060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1313/2489] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:00 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:00.533332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-84d5d417-4d0f-4811-97cb-cd9256591edf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:00.541253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-84d5d417-4d0f-4811-97cb-cd9256591edf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083112 Jul 28 20:23:00.541811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1177/2490] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:00.716586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4a03b62d-03aa-4ab7-98e0-7995d5866520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:00.717121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4a03b62d-03aa-4ab7-98e0-7995d5866520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:00.723142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a03b62d-03aa-4ab7-98e0-7995d5866520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:00.723581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a03b62d-03aa-4ab7-98e0-7995d5866520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:00.724321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a03b62d-03aa-4ab7-98e0-7995d5866520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:00.724767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4a03b62d-03aa-4ab7-98e0-7995d5866520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:00.856688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4a03b62d-03aa-4ab7-98e0-7995d5866520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:00.865317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4a03b62d-03aa-4ab7-98e0-7995d5866520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152615 Jul 28 20:23:00.865875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1314/2491] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:01.505424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-403c8b0f-ce7c-48bd-aeea-82acc76e4511 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:01.505957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-403c8b0f-ce7c-48bd-aeea-82acc76e4511 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:01.512191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-403c8b0f-ce7c-48bd-aeea-82acc76e4511 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:01.512690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-403c8b0f-ce7c-48bd-aeea-82acc76e4511 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:01.513447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-403c8b0f-ce7c-48bd-aeea-82acc76e4511 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:01.513880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-403c8b0f-ce7c-48bd-aeea-82acc76e4511 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:01.561977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bd9c5a61-fa61-426f-ab4a-673f2102d07f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:01.562775 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bd9c5a61-fa61-426f-ab4a-673f2102d07f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:01.569485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd9c5a61-fa61-426f-ab4a-673f2102d07f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:01.570006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd9c5a61-fa61-426f-ab4a-673f2102d07f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:01.570829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd9c5a61-fa61-426f-ab4a-673f2102d07f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:01.571327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd9c5a61-fa61-426f-ab4a-673f2102d07f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:01.648744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bd9c5a61-fa61-426f-ab4a-673f2102d07f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:01.657738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bd9c5a61-fa61-426f-ab4a-673f2102d07f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.099610 Jul 28 20:23:01.658291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1315/2492] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:01.671460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-403c8b0f-ce7c-48bd-aeea-82acc76e4511 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:01.680775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-403c8b0f-ce7c-48bd-aeea-82acc76e4511 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.178978 Jul 28 20:23:01.681352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1178/2493] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:01 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:01.887192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9662e50e-326d-4bc3-a552-9f7cfca3938c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:01.887802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9662e50e-326d-4bc3-a552-9f7cfca3938c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:01.894269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9662e50e-326d-4bc3-a552-9f7cfca3938c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:01.894713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9662e50e-326d-4bc3-a552-9f7cfca3938c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:01.895463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9662e50e-326d-4bc3-a552-9f7cfca3938c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:01.895891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9662e50e-326d-4bc3-a552-9f7cfca3938c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:02.037019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9662e50e-326d-4bc3-a552-9f7cfca3938c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:02.044970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9662e50e-326d-4bc3-a552-9f7cfca3938c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.161592 Jul 28 20:23:02.045532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1316/2494] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:02.678746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c63b8473-329c-4fa2-a6c9-f8f692f3b18f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:02.679349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c63b8473-329c-4fa2-a6c9-f8f692f3b18f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:02.685777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c63b8473-329c-4fa2-a6c9-f8f692f3b18f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:02.686227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c63b8473-329c-4fa2-a6c9-f8f692f3b18f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:02.686999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c63b8473-329c-4fa2-a6c9-f8f692f3b18f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:02.687946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c63b8473-329c-4fa2-a6c9-f8f692f3b18f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:02.703832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-da248c13-ec55-46bf-a6e5-000d59b6509f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:02.704627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-da248c13-ec55-46bf-a6e5-000d59b6509f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:02.711126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da248c13-ec55-46bf-a6e5-000d59b6509f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:02.711575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da248c13-ec55-46bf-a6e5-000d59b6509f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:02.712331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da248c13-ec55-46bf-a6e5-000d59b6509f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:02.712789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da248c13-ec55-46bf-a6e5-000d59b6509f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:02.751746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c63b8473-329c-4fa2-a6c9-f8f692f3b18f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:02.759752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c63b8473-329c-4fa2-a6c9-f8f692f3b18f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084778 Jul 28 20:23:02.760313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1179/2495] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:02 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:02.850952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-da248c13-ec55-46bf-a6e5-000d59b6509f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:02.858750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-da248c13-ec55-46bf-a6e5-000d59b6509f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.159325 Jul 28 20:23:02.859302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1317/2496] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:02 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:03.066786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b9126cd-cb9a-45a2-a9a1-1c2d1d7ce735 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:03.067293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b9126cd-cb9a-45a2-a9a1-1c2d1d7ce735 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:03.073250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b9126cd-cb9a-45a2-a9a1-1c2d1d7ce735 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:03.073692 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b9126cd-cb9a-45a2-a9a1-1c2d1d7ce735 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:03.074436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b9126cd-cb9a-45a2-a9a1-1c2d1d7ce735 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:03.074862 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b9126cd-cb9a-45a2-a9a1-1c2d1d7ce735 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:03.092817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:03.205416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b9126cd-cb9a-45a2-a9a1-1c2d1d7ce735 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:03.213307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b9126cd-cb9a-45a2-a9a1-1c2d1d7ce735 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150596 Jul 28 20:23:03.213861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1180/2497] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:03 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:03.781462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b188c717-484a-4a59-9725-d74664ec3d99 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:03.782075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b188c717-484a-4a59-9725-d74664ec3d99 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:03.789286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b188c717-484a-4a59-9725-d74664ec3d99 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:03.789756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b188c717-484a-4a59-9725-d74664ec3d99 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:03.790487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b188c717-484a-4a59-9725-d74664ec3d99 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:03.790916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b188c717-484a-4a59-9725-d74664ec3d99 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:03.850414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b188c717-484a-4a59-9725-d74664ec3d99 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:03.858267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b188c717-484a-4a59-9725-d74664ec3d99 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081009 Jul 28 20:23:03.858832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1318/2498] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:03 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:03.998759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e9ca2011-f747-43f8-b70c-aae5d4539db6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:03.999378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e9ca2011-f747-43f8-b70c-aae5d4539db6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:04.008056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9ca2011-f747-43f8-b70c-aae5d4539db6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:04.008884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9ca2011-f747-43f8-b70c-aae5d4539db6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:04.010245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9ca2011-f747-43f8-b70c-aae5d4539db6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:04.011010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9ca2011-f747-43f8-b70c-aae5d4539db6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:04.144011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e9ca2011-f747-43f8-b70c-aae5d4539db6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:04.151963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e9ca2011-f747-43f8-b70c-aae5d4539db6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.276702 Jul 28 20:23:04.152517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1181/2499] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:03 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:04.360981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8babf296-fa06-41cc-82e9-afcba9919b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:04.361781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8babf296-fa06-41cc-82e9-afcba9919b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:04.367705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8babf296-fa06-41cc-82e9-afcba9919b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:04.368139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8babf296-fa06-41cc-82e9-afcba9919b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:04.368903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8babf296-fa06-41cc-82e9-afcba9919b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:04.369332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8babf296-fa06-41cc-82e9-afcba9919b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:04.494813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8babf296-fa06-41cc-82e9-afcba9919b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:04.503857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8babf296-fa06-41cc-82e9-afcba9919b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.273099 Jul 28 20:23:04.504417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1319/2500] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:04 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:04.879432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4d342e54-b886-42ef-a46a-2e6fcffdbcb4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:04.880035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4d342e54-b886-42ef-a46a-2e6fcffdbcb4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:04.886723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4d342e54-b886-42ef-a46a-2e6fcffdbcb4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:04.887162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4d342e54-b886-42ef-a46a-2e6fcffdbcb4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:04.887904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4d342e54-b886-42ef-a46a-2e6fcffdbcb4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:04.888332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4d342e54-b886-42ef-a46a-2e6fcffdbcb4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:04.947931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4d342e54-b886-42ef-a46a-2e6fcffdbcb4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:04.955791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4d342e54-b886-42ef-a46a-2e6fcffdbcb4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080536 Jul 28 20:23:04.956339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1182/2501] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:05.174189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c25ed67c-5a77-4493-acd0-1cfa5d801ff0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:05.174820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c25ed67c-5a77-4493-acd0-1cfa5d801ff0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:05.181308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c25ed67c-5a77-4493-acd0-1cfa5d801ff0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:05.181748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c25ed67c-5a77-4493-acd0-1cfa5d801ff0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:05.182483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c25ed67c-5a77-4493-acd0-1cfa5d801ff0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:05.182904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c25ed67c-5a77-4493-acd0-1cfa5d801ff0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:05.519995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c25ed67c-5a77-4493-acd0-1cfa5d801ff0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:05.525384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b8e7d9a4-bf39-457b-9ab5-5ff13a03299d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:05.526009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b8e7d9a4-bf39-457b-9ab5-5ff13a03299d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:05.528037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c25ed67c-5a77-4493-acd0-1cfa5d801ff0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.357888 Jul 28 20:23:05.529069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1320/2502] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:05 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:05.532307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8e7d9a4-bf39-457b-9ab5-5ff13a03299d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:05.532788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8e7d9a4-bf39-457b-9ab5-5ff13a03299d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:05.533560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8e7d9a4-bf39-457b-9ab5-5ff13a03299d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:05.534826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b8e7d9a4-bf39-457b-9ab5-5ff13a03299d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:05.664447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b8e7d9a4-bf39-457b-9ab5-5ff13a03299d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:05.672810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b8e7d9a4-bf39-457b-9ab5-5ff13a03299d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151060 Jul 28 20:23:05.673307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1183/2503] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:05 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:05.820689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:23:05.820926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:23:05.976487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-29d3dbac-2d5a-4c89-9668-876667b64d6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:05.977089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-29d3dbac-2d5a-4c89-9668-876667b64d6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:05.983066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29d3dbac-2d5a-4c89-9668-876667b64d6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:05.983515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29d3dbac-2d5a-4c89-9668-876667b64d6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:05.984255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29d3dbac-2d5a-4c89-9668-876667b64d6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:05.984718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-29d3dbac-2d5a-4c89-9668-876667b64d6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:06.044991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-29d3dbac-2d5a-4c89-9668-876667b64d6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:06.053504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-29d3dbac-2d5a-4c89-9668-876667b64d6e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080931 Jul 28 20:23:06.054068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1321/2504] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:05 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:06.550031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-20655789-943b-4d15-8809-b0e6585e255f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:06.550642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-20655789-943b-4d15-8809-b0e6585e255f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:06.557440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20655789-943b-4d15-8809-b0e6585e255f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:06.557920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20655789-943b-4d15-8809-b0e6585e255f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:06.558681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20655789-943b-4d15-8809-b0e6585e255f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:06.559114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20655789-943b-4d15-8809-b0e6585e255f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:06.686546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-20655789-943b-4d15-8809-b0e6585e255f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:06.695349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a413ee25-b6b1-41d1-99f7-e5bc55fcf4f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:06.695925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-20655789-943b-4d15-8809-b0e6585e255f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149888 Jul 28 20:23:06.696054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a413ee25-b6b1-41d1-99f7-e5bc55fcf4f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:06.696370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1184/2505] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:06 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:06.702450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a413ee25-b6b1-41d1-99f7-e5bc55fcf4f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:06.702884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a413ee25-b6b1-41d1-99f7-e5bc55fcf4f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:06.703622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a413ee25-b6b1-41d1-99f7-e5bc55fcf4f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:06.704044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a413ee25-b6b1-41d1-99f7-e5bc55fcf4f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:06.830890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a413ee25-b6b1-41d1-99f7-e5bc55fcf4f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:06.838776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a413ee25-b6b1-41d1-99f7-e5bc55fcf4f6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147356 Jul 28 20:23:06.839344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1322/2506] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:06 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:07.076935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f280f41d-878e-404e-ade6-4d82ce70ff8c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:07.077664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f280f41d-878e-404e-ade6-4d82ce70ff8c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:07.084027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f280f41d-878e-404e-ade6-4d82ce70ff8c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:07.084479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f280f41d-878e-404e-ade6-4d82ce70ff8c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:07.085275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f280f41d-878e-404e-ade6-4d82ce70ff8c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:07.085710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f280f41d-878e-404e-ade6-4d82ce70ff8c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:07.153453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f280f41d-878e-404e-ade6-4d82ce70ff8c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:07.162546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f280f41d-878e-404e-ade6-4d82ce70ff8c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.090626 Jul 28 20:23:07.163124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1185/2507] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:07.716527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f2df4e75-c51b-4936-854f-59a9b50bd1e1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:07.717149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f2df4e75-c51b-4936-854f-59a9b50bd1e1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:07.723832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2df4e75-c51b-4936-854f-59a9b50bd1e1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:07.724261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2df4e75-c51b-4936-854f-59a9b50bd1e1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:07.725032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2df4e75-c51b-4936-854f-59a9b50bd1e1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:07.725458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2df4e75-c51b-4936-854f-59a9b50bd1e1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:07.729254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:07.857614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f2df4e75-c51b-4936-854f-59a9b50bd1e1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:07.859985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-da355cdb-ed16-4f8b-bb52-32838db58d7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:07.860619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-da355cdb-ed16-4f8b-bb52-32838db58d7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:07.866111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f2df4e75-c51b-4936-854f-59a9b50bd1e1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153341 Jul 28 20:23:07.866689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1323/2508] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:07 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:07.867279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da355cdb-ed16-4f8b-bb52-32838db58d7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:07.867733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da355cdb-ed16-4f8b-bb52-32838db58d7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:07.868486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da355cdb-ed16-4f8b-bb52-32838db58d7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:07.868937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da355cdb-ed16-4f8b-bb52-32838db58d7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:07.997217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-da355cdb-ed16-4f8b-bb52-32838db58d7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:08.006153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-da355cdb-ed16-4f8b-bb52-32838db58d7c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150071 Jul 28 20:23:08.008906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1186/2509] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:07 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:08.186837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c69e98d5-6b9b-4d6f-8a27-ce9ee3c89ba5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:08.187436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c69e98d5-6b9b-4d6f-8a27-ce9ee3c89ba5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:08.194369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c69e98d5-6b9b-4d6f-8a27-ce9ee3c89ba5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:08.194810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c69e98d5-6b9b-4d6f-8a27-ce9ee3c89ba5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:08.195549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c69e98d5-6b9b-4d6f-8a27-ce9ee3c89ba5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:08.195973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c69e98d5-6b9b-4d6f-8a27-ce9ee3c89ba5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:08.258706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c69e98d5-6b9b-4d6f-8a27-ce9ee3c89ba5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:08.266617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c69e98d5-6b9b-4d6f-8a27-ce9ee3c89ba5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083577 Jul 28 20:23:08.267167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1324/2510] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:08.889046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-32483362-a751-4e49-874a-32c3c491314a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:08.889642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-32483362-a751-4e49-874a-32c3c491314a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:08.897202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32483362-a751-4e49-874a-32c3c491314a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:08.897650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32483362-a751-4e49-874a-32c3c491314a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:08.898405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32483362-a751-4e49-874a-32c3c491314a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:08.898839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-32483362-a751-4e49-874a-32c3c491314a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:09.025611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-32483362-a751-4e49-874a-32c3c491314a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:09.029551 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d6b6d6b4-b54f-42c5-9bf2-9afd708280ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:09.030162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d6b6d6b4-b54f-42c5-9bf2-9afd708280ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:09.034525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-32483362-a751-4e49-874a-32c3c491314a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149311 Jul 28 20:23:09.035410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1187/2511] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:08 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:09.037342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b6d6b4-b54f-42c5-9bf2-9afd708280ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:09.037788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b6d6b4-b54f-42c5-9bf2-9afd708280ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:09.038542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b6d6b4-b54f-42c5-9bf2-9afd708280ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:09.038970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6b6d6b4-b54f-42c5-9bf2-9afd708280ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:09.165432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d6b6d6b4-b54f-42c5-9bf2-9afd708280ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:09.173352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d6b6d6b4-b54f-42c5-9bf2-9afd708280ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.147774 Jul 28 20:23:09.173908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1325/2512] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:09 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:09.288474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6bc88946-a2ef-48d7-99df-53559726a58e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:09.289114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6bc88946-a2ef-48d7-99df-53559726a58e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:09.295111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bc88946-a2ef-48d7-99df-53559726a58e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:09.295558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bc88946-a2ef-48d7-99df-53559726a58e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:09.296304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bc88946-a2ef-48d7-99df-53559726a58e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:09.296783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6bc88946-a2ef-48d7-99df-53559726a58e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:09.360162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6bc88946-a2ef-48d7-99df-53559726a58e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:09.369237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6bc88946-a2ef-48d7-99df-53559726a58e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085478 Jul 28 20:23:09.369792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1188/2513] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:09 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:10.055696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0997dd43-bd56-4837-81e7-5ef01b527fea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:10.056288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0997dd43-bd56-4837-81e7-5ef01b527fea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:10.062700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0997dd43-bd56-4837-81e7-5ef01b527fea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:10.063141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0997dd43-bd56-4837-81e7-5ef01b527fea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:10.063881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0997dd43-bd56-4837-81e7-5ef01b527fea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:10.064305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0997dd43-bd56-4837-81e7-5ef01b527fea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:10.193765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0997dd43-bd56-4837-81e7-5ef01b527fea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:10.197575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-905b66bf-40ca-4a9e-be91-a5ab33dc7b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:10.198270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-905b66bf-40ca-4a9e-be91-a5ab33dc7b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:10.201810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0997dd43-bd56-4837-81e7-5ef01b527fea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149912 Jul 28 20:23:10.202355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1326/2514] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:10 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:10.205019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-905b66bf-40ca-4a9e-be91-a5ab33dc7b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:10.206748 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-905b66bf-40ca-4a9e-be91-a5ab33dc7b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:10.207526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-905b66bf-40ca-4a9e-be91-a5ab33dc7b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:10.207962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-905b66bf-40ca-4a9e-be91-a5ab33dc7b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:10.334892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-905b66bf-40ca-4a9e-be91-a5ab33dc7b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:10.342777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-905b66bf-40ca-4a9e-be91-a5ab33dc7b3c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150441 Jul 28 20:23:10.343329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1189/2515] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:10 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:10.390831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bc4260d0-6fa8-4157-a240-6453edaef0f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:10.391434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bc4260d0-6fa8-4157-a240-6453edaef0f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:10.397482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc4260d0-6fa8-4157-a240-6453edaef0f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:10.397920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc4260d0-6fa8-4157-a240-6453edaef0f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:10.398664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc4260d0-6fa8-4157-a240-6453edaef0f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:10.399083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc4260d0-6fa8-4157-a240-6453edaef0f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:10.462383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bc4260d0-6fa8-4157-a240-6453edaef0f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:10.470257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bc4260d0-6fa8-4157-a240-6453edaef0f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083223 Jul 28 20:23:10.470834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1327/2516] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:10 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:11.223832 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cf070b73-1db0-4937-94fe-47a12a8363fc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:11.224444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cf070b73-1db0-4937-94fe-47a12a8363fc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:11.230927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf070b73-1db0-4937-94fe-47a12a8363fc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:11.231370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf070b73-1db0-4937-94fe-47a12a8363fc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:11.232121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf070b73-1db0-4937-94fe-47a12a8363fc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:11.232566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cf070b73-1db0-4937-94fe-47a12a8363fc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:11.359008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cf070b73-1db0-4937-94fe-47a12a8363fc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:11.364289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c7a8c6c7-63c7-4f6f-82f0-62a8ebd15a5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:11.364935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c7a8c6c7-63c7-4f6f-82f0-62a8ebd15a5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:11.371481 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7a8c6c7-63c7-4f6f-82f0-62a8ebd15a5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:11.371681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cf070b73-1db0-4937-94fe-47a12a8363fc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152013 Jul 28 20:23:11.371930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7a8c6c7-63c7-4f6f-82f0-62a8ebd15a5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:11.372741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7a8c6c7-63c7-4f6f-82f0-62a8ebd15a5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:11.373249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7a8c6c7-63c7-4f6f-82f0-62a8ebd15a5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:11.384760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1190/2517] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:11 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:11.491482 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-43c0f1fe-fb5c-45cb-a082-7918e80ced83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:11.492089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-43c0f1fe-fb5c-45cb-a082-7918e80ced83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:11.498023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43c0f1fe-fb5c-45cb-a082-7918e80ced83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:11.498461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43c0f1fe-fb5c-45cb-a082-7918e80ced83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:11.499357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43c0f1fe-fb5c-45cb-a082-7918e80ced83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:11.499660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-43c0f1fe-fb5c-45cb-a082-7918e80ced83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:11.507398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c7a8c6c7-63c7-4f6f-82f0-62a8ebd15a5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:11.515429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c7a8c6c7-63c7-4f6f-82f0-62a8ebd15a5b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.154943 Jul 28 20:23:11.515988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1328/2518] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:11 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:11.564055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-43c0f1fe-fb5c-45cb-a082-7918e80ced83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:11.572445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-43c0f1fe-fb5c-45cb-a082-7918e80ced83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084886 Jul 28 20:23:11.573027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1191/2519] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:12.399909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9beaa78f-454d-4bdb-831d-8e2c31407a4e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:12.400675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9beaa78f-454d-4bdb-831d-8e2c31407a4e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:12.407423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9beaa78f-454d-4bdb-831d-8e2c31407a4e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:12.407873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9beaa78f-454d-4bdb-831d-8e2c31407a4e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:12.408780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9beaa78f-454d-4bdb-831d-8e2c31407a4e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:12.409295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9beaa78f-454d-4bdb-831d-8e2c31407a4e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:12.535856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9beaa78f-454d-4bdb-831d-8e2c31407a4e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:12.538795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ad85f933-8971-40eb-8240-1d4782aaa6d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:12.539562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ad85f933-8971-40eb-8240-1d4782aaa6d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:12.543874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9beaa78f-454d-4bdb-831d-8e2c31407a4e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147737 Jul 28 20:23:12.544634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1329/2520] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:12 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:12.546055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ad85f933-8971-40eb-8240-1d4782aaa6d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:12.546499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ad85f933-8971-40eb-8240-1d4782aaa6d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:12.547246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ad85f933-8971-40eb-8240-1d4782aaa6d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:12.547674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ad85f933-8971-40eb-8240-1d4782aaa6d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:12.594360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-309e7739-833c-4601-82b2-f00a7a3c038c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:12.594970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-309e7739-833c-4601-82b2-f00a7a3c038c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:12.601540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-309e7739-833c-4601-82b2-f00a7a3c038c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:12.601985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-309e7739-833c-4601-82b2-f00a7a3c038c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:12.602737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-309e7739-833c-4601-82b2-f00a7a3c038c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:12.603166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-309e7739-833c-4601-82b2-f00a7a3c038c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:12.680093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-309e7739-833c-4601-82b2-f00a7a3c038c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:12.687909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-309e7739-833c-4601-82b2-f00a7a3c038c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.097395 Jul 28 20:23:12.688652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1330/2521] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:12.702983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ad85f933-8971-40eb-8240-1d4782aaa6d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:12.711403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ad85f933-8971-40eb-8240-1d4782aaa6d0 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.176401 Jul 28 20:23:12.711966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1192/2522] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:12 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:13.565297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bfbd4e4c-704e-44e3-bfd5-cc5a76790eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:13.565935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bfbd4e4c-704e-44e3-bfd5-cc5a76790eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:13.572356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfbd4e4c-704e-44e3-bfd5-cc5a76790eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:13.572826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfbd4e4c-704e-44e3-bfd5-cc5a76790eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:13.573567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfbd4e4c-704e-44e3-bfd5-cc5a76790eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:13.573989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfbd4e4c-704e-44e3-bfd5-cc5a76790eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:13.701717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bfbd4e4c-704e-44e3-bfd5-cc5a76790eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:13.709906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a9bbfec2-d536-407d-8a1f-257755b1a7df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:13.710515 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a9bbfec2-d536-407d-8a1f-257755b1a7df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:13.711048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bfbd4e4c-704e-44e3-bfd5-cc5a76790eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149567 Jul 28 20:23:13.711616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1331/2523] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:13 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:13.717004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a9bbfec2-d536-407d-8a1f-257755b1a7df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:13.717441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a9bbfec2-d536-407d-8a1f-257755b1a7df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:13.718189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a9bbfec2-d536-407d-8a1f-257755b1a7df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:13.718616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a9bbfec2-d536-407d-8a1f-257755b1a7df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:13.732631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4114a397-18b3-433c-b016-e32c396a407d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:13.733330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4114a397-18b3-433c-b016-e32c396a407d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:13.739907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4114a397-18b3-433c-b016-e32c396a407d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:13.740423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4114a397-18b3-433c-b016-e32c396a407d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:13.741210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4114a397-18b3-433c-b016-e32c396a407d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:13.741650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4114a397-18b3-433c-b016-e32c396a407d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:13.785304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a9bbfec2-d536-407d-8a1f-257755b1a7df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:13.792990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a9bbfec2-d536-407d-8a1f-257755b1a7df tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087708 Jul 28 20:23:13.793545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1193/2524] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:13 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:13.880291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4114a397-18b3-433c-b016-e32c396a407d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:13.888176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4114a397-18b3-433c-b016-e32c396a407d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.159297 Jul 28 20:23:13.888772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1332/2525] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:13 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:14.731874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bf2624bf-a9cc-4264-96e8-efaf34b27839 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:14.732512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bf2624bf-a9cc-4264-96e8-efaf34b27839 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:14.739919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf2624bf-a9cc-4264-96e8-efaf34b27839 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:14.740362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf2624bf-a9cc-4264-96e8-efaf34b27839 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:14.741162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf2624bf-a9cc-4264-96e8-efaf34b27839 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:14.741587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf2624bf-a9cc-4264-96e8-efaf34b27839 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:14.813713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c9814472-fa35-481b-8601-c5727a62a213 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:14.814371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c9814472-fa35-481b-8601-c5727a62a213 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:14.821736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9814472-fa35-481b-8601-c5727a62a213 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:14.822113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9814472-fa35-481b-8601-c5727a62a213 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:14.822875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9814472-fa35-481b-8601-c5727a62a213 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:14.823308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9814472-fa35-481b-8601-c5727a62a213 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:14.892630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c9814472-fa35-481b-8601-c5727a62a213 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:14.896273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bf2624bf-a9cc-4264-96e8-efaf34b27839 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:14.900954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c9814472-fa35-481b-8601-c5727a62a213 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.091128 Jul 28 20:23:14.901690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1333/2526] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:14.904886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bf2624bf-a9cc-4264-96e8-efaf34b27839 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.176762 Jul 28 20:23:14.905644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1194/2527] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:14 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:14.908871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1f722735-0fd1-49c1-9c69-b4742f4ce1c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:14.909785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1f722735-0fd1-49c1-9c69-b4742f4ce1c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:14.915863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1f722735-0fd1-49c1-9c69-b4742f4ce1c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:14.916305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1f722735-0fd1-49c1-9c69-b4742f4ce1c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:14.917085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1f722735-0fd1-49c1-9c69-b4742f4ce1c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:14.917511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1f722735-0fd1-49c1-9c69-b4742f4ce1c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:15.046594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1f722735-0fd1-49c1-9c69-b4742f4ce1c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:15.055299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1f722735-0fd1-49c1-9c69-b4742f4ce1c1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149926 Jul 28 20:23:15.055858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1334/2528] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:14 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:15.922479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d6c79161-b294-4f26-948b-368a0f0563cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:15.923091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d6c79161-b294-4f26-948b-368a0f0563cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:15.925778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cebe24fa-1011-4398-bf4b-268eecbff515 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:15.926388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cebe24fa-1011-4398-bf4b-268eecbff515 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:15.929634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6c79161-b294-4f26-948b-368a0f0563cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:15.930085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6c79161-b294-4f26-948b-368a0f0563cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:15.930839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6c79161-b294-4f26-948b-368a0f0563cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:15.931268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d6c79161-b294-4f26-948b-368a0f0563cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:15.932940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebe24fa-1011-4398-bf4b-268eecbff515 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:15.933334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebe24fa-1011-4398-bf4b-268eecbff515 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:15.934078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebe24fa-1011-4398-bf4b-268eecbff515 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:15.934500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cebe24fa-1011-4398-bf4b-268eecbff515 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:15.999895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d6c79161-b294-4f26-948b-368a0f0563cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:16.009036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d6c79161-b294-4f26-948b-368a0f0563cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.090634 Jul 28 20:23:16.009635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1195/2529] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:16.077475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-380eec18-084e-4258-a9e4-3962792afa68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:16.078109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-380eec18-084e-4258-a9e4-3962792afa68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:16.082165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cebe24fa-1011-4398-bf4b-268eecbff515 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:16.084870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-380eec18-084e-4258-a9e4-3962792afa68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:16.085319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-380eec18-084e-4258-a9e4-3962792afa68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:16.086070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-380eec18-084e-4258-a9e4-3962792afa68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:16.086497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-380eec18-084e-4258-a9e4-3962792afa68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:16.090142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cebe24fa-1011-4398-bf4b-268eecbff515 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.168235 Jul 28 20:23:16.090709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1335/2530] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:15 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:16.223342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-380eec18-084e-4258-a9e4-3962792afa68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:16.231186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-380eec18-084e-4258-a9e4-3962792afa68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157516 Jul 28 20:23:16.231746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1196/2531] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:16 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:17.030903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-df8dbcbe-2f8d-4f22-8ded-fc18fd503d0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:17.031449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-df8dbcbe-2f8d-4f22-8ded-fc18fd503d0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:17.038042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df8dbcbe-2f8d-4f22-8ded-fc18fd503d0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:17.038480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df8dbcbe-2f8d-4f22-8ded-fc18fd503d0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:17.039217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df8dbcbe-2f8d-4f22-8ded-fc18fd503d0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:17.039639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df8dbcbe-2f8d-4f22-8ded-fc18fd503d0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:17.100827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-df8dbcbe-2f8d-4f22-8ded-fc18fd503d0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:17.108994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-df8dbcbe-2f8d-4f22-8ded-fc18fd503d0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082221 Jul 28 20:23:17.109546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1336/2532] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:17.110731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2f66944f-4910-44bb-86e5-673047ec7e57 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:17.111350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2f66944f-4910-44bb-86e5-673047ec7e57 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:17.118353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f66944f-4910-44bb-86e5-673047ec7e57 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:17.118803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f66944f-4910-44bb-86e5-673047ec7e57 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:17.119565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f66944f-4910-44bb-86e5-673047ec7e57 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:17.120012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2f66944f-4910-44bb-86e5-673047ec7e57 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:17.124010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:17.248080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2f66944f-4910-44bb-86e5-673047ec7e57 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:17.252624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-77b2d4f8-757c-465c-932c-f02ae740bafb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:17.254016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-77b2d4f8-757c-465c-932c-f02ae740bafb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:17.257053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2f66944f-4910-44bb-86e5-673047ec7e57 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150008 Jul 28 20:23:17.257632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1197/2533] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:17 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:17.260232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77b2d4f8-757c-465c-932c-f02ae740bafb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:17.260708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77b2d4f8-757c-465c-932c-f02ae740bafb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:17.261461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77b2d4f8-757c-465c-932c-f02ae740bafb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:17.261890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77b2d4f8-757c-465c-932c-f02ae740bafb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:17.395112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-77b2d4f8-757c-465c-932c-f02ae740bafb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:17.402961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-77b2d4f8-757c-465c-932c-f02ae740bafb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.154260 Jul 28 20:23:17.403524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1337/2534] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:17 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:18.130880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5f9953a3-e580-4b4f-a1d6-ef5e54b177f1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:18.131474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5f9953a3-e580-4b4f-a1d6-ef5e54b177f1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:18.137930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5f9953a3-e580-4b4f-a1d6-ef5e54b177f1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:18.138371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5f9953a3-e580-4b4f-a1d6-ef5e54b177f1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:18.139115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5f9953a3-e580-4b4f-a1d6-ef5e54b177f1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:18.139545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5f9953a3-e580-4b4f-a1d6-ef5e54b177f1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:18.200735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5f9953a3-e580-4b4f-a1d6-ef5e54b177f1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:18.209437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5f9953a3-e580-4b4f-a1d6-ef5e54b177f1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083144 Jul 28 20:23:18.210007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1198/2535] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:18.278123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9d68f4fb-9e1a-4cb3-88be-06d3bb73e59a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:18.278987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9d68f4fb-9e1a-4cb3-88be-06d3bb73e59a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:18.286077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9d68f4fb-9e1a-4cb3-88be-06d3bb73e59a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:18.286518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9d68f4fb-9e1a-4cb3-88be-06d3bb73e59a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:18.287265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9d68f4fb-9e1a-4cb3-88be-06d3bb73e59a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:18.287693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9d68f4fb-9e1a-4cb3-88be-06d3bb73e59a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:18.417816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9d68f4fb-9e1a-4cb3-88be-06d3bb73e59a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:18.424254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-646935a4-eeb3-4672-b530-4fe9f2814d0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:18.425573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-646935a4-eeb3-4672-b530-4fe9f2814d0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:18.426969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9d68f4fb-9e1a-4cb3-88be-06d3bb73e59a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152738 Jul 28 20:23:18.427538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1338/2536] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:18 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:18.431625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-646935a4-eeb3-4672-b530-4fe9f2814d0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:18.432070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-646935a4-eeb3-4672-b530-4fe9f2814d0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:18.432860 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-646935a4-eeb3-4672-b530-4fe9f2814d0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:18.433284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-646935a4-eeb3-4672-b530-4fe9f2814d0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:18.558777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-646935a4-eeb3-4672-b530-4fe9f2814d0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:18.566747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-646935a4-eeb3-4672-b530-4fe9f2814d0d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146261 Jul 28 20:23:18.567308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1199/2537] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:18 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:19.230737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ddad7688-683a-4699-a25f-065b95d81dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:19.231343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ddad7688-683a-4699-a25f-065b95d81dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:19.237952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddad7688-683a-4699-a25f-065b95d81dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:19.238417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddad7688-683a-4699-a25f-065b95d81dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:19.239154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddad7688-683a-4699-a25f-065b95d81dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:19.239604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ddad7688-683a-4699-a25f-065b95d81dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:19.298908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ddad7688-683a-4699-a25f-065b95d81dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:19.302908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:19.308060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ddad7688-683a-4699-a25f-065b95d81dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081220 Jul 28 20:23:19.308633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1339/2538] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:19.449005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d16d6f4a-885b-4d9c-a806-156ab644e77b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:19.449577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d16d6f4a-885b-4d9c-a806-156ab644e77b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:19.455958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d16d6f4a-885b-4d9c-a806-156ab644e77b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:19.456531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d16d6f4a-885b-4d9c-a806-156ab644e77b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:19.457277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d16d6f4a-885b-4d9c-a806-156ab644e77b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:19.457705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d16d6f4a-885b-4d9c-a806-156ab644e77b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:19.587930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bbfa9ea6-5d74-4314-a9f5-3c3116a6fab5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:19.588557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bbfa9ea6-5d74-4314-a9f5-3c3116a6fab5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:19.588733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d16d6f4a-885b-4d9c-a806-156ab644e77b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:19.595246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbfa9ea6-5d74-4314-a9f5-3c3116a6fab5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:19.595694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbfa9ea6-5d74-4314-a9f5-3c3116a6fab5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:19.596453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbfa9ea6-5d74-4314-a9f5-3c3116a6fab5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:19.596801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d16d6f4a-885b-4d9c-a806-156ab644e77b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151792 Jul 28 20:23:19.596923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bbfa9ea6-5d74-4314-a9f5-3c3116a6fab5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:19.597430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1200/2539] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:19 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:19.734517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bbfa9ea6-5d74-4314-a9f5-3c3116a6fab5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:19.743411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bbfa9ea6-5d74-4314-a9f5-3c3116a6fab5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.159629 Jul 28 20:23:19.743971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1340/2540] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:19 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:20.329668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2e9aa285-8c80-416d-8950-75502971cd59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:20.330308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2e9aa285-8c80-416d-8950-75502971cd59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:20.336933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2e9aa285-8c80-416d-8950-75502971cd59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:20.337375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2e9aa285-8c80-416d-8950-75502971cd59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:20.338127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2e9aa285-8c80-416d-8950-75502971cd59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:20.338553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2e9aa285-8c80-416d-8950-75502971cd59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:20.399789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2e9aa285-8c80-416d-8950-75502971cd59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:20.407921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2e9aa285-8c80-416d-8950-75502971cd59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082071 Jul 28 20:23:20.408479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1201/2541] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:20 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:20.618521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a46475bb-c581-49cf-834c-40e74b3b68e5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:20.619129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a46475bb-c581-49cf-834c-40e74b3b68e5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:20.625727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a46475bb-c581-49cf-834c-40e74b3b68e5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:20.626173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a46475bb-c581-49cf-834c-40e74b3b68e5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:20.626917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a46475bb-c581-49cf-834c-40e74b3b68e5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:20.627350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a46475bb-c581-49cf-834c-40e74b3b68e5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:20.759585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a46475bb-c581-49cf-834c-40e74b3b68e5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:20.764592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fe9098da-381f-4971-b6ca-5dd618f7391b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:20.765207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fe9098da-381f-4971-b6ca-5dd618f7391b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:20.767702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a46475bb-c581-49cf-834c-40e74b3b68e5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152973 Jul 28 20:23:20.768816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1341/2542] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:20 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:20.772402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe9098da-381f-4971-b6ca-5dd618f7391b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:20.772879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe9098da-381f-4971-b6ca-5dd618f7391b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:20.773633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe9098da-381f-4971-b6ca-5dd618f7391b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:20.774059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe9098da-381f-4971-b6ca-5dd618f7391b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:20.902001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fe9098da-381f-4971-b6ca-5dd618f7391b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:20.910863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fe9098da-381f-4971-b6ca-5dd618f7391b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150079 Jul 28 20:23:20.911432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1202/2543] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:20 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:21.431326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ab7385a8-0514-4bf3-88e5-32d1d313f9ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:21.432081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ab7385a8-0514-4bf3-88e5-32d1d313f9ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:21.438162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab7385a8-0514-4bf3-88e5-32d1d313f9ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:21.438608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab7385a8-0514-4bf3-88e5-32d1d313f9ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:21.439356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab7385a8-0514-4bf3-88e5-32d1d313f9ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:21.439786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab7385a8-0514-4bf3-88e5-32d1d313f9ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:21.499432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ab7385a8-0514-4bf3-88e5-32d1d313f9ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:21.507749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ab7385a8-0514-4bf3-88e5-32d1d313f9ce tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080541 Jul 28 20:23:21.508312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1342/2544] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:21.790435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6f2337ee-ccf5-42d9-9d2b-49c28d385970 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:21.790435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6f2337ee-ccf5-42d9-9d2b-49c28d385970 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:21.796662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f2337ee-ccf5-42d9-9d2b-49c28d385970 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:21.797103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f2337ee-ccf5-42d9-9d2b-49c28d385970 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:21.797848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f2337ee-ccf5-42d9-9d2b-49c28d385970 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:21.798270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f2337ee-ccf5-42d9-9d2b-49c28d385970 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:21.928443 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6f2337ee-ccf5-42d9-9d2b-49c28d385970 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:21.933057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-733e1fae-67fa-41f6-8aac-0e191f075fb4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:21.933680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-733e1fae-67fa-41f6-8aac-0e191f075fb4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:21.936438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6f2337ee-ccf5-42d9-9d2b-49c28d385970 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150655 Jul 28 20:23:21.937054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1203/2545] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:21 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:21.940014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-733e1fae-67fa-41f6-8aac-0e191f075fb4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:21.941077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-733e1fae-67fa-41f6-8aac-0e191f075fb4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:21.941844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-733e1fae-67fa-41f6-8aac-0e191f075fb4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:21.942276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-733e1fae-67fa-41f6-8aac-0e191f075fb4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:22.071116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-733e1fae-67fa-41f6-8aac-0e191f075fb4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:22.078994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-733e1fae-67fa-41f6-8aac-0e191f075fb4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149678 Jul 28 20:23:22.079564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1343/2546] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:21 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:22.529062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4cd520e5-89dc-4b04-b03b-a64c9af0cc53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:22.529665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4cd520e5-89dc-4b04-b03b-a64c9af0cc53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:22.531453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=76 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:22.537461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4cd520e5-89dc-4b04-b03b-a64c9af0cc53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:22.537903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4cd520e5-89dc-4b04-b03b-a64c9af0cc53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:22.538648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4cd520e5-89dc-4b04-b03b-a64c9af0cc53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:22.539074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4cd520e5-89dc-4b04-b03b-a64c9af0cc53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:22.598455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4cd520e5-89dc-4b04-b03b-a64c9af0cc53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:22.606247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4cd520e5-89dc-4b04-b03b-a64c9af0cc53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081316 Jul 28 20:23:22.606781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1204/2547] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:22 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:22.957616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3e5d938a-f89d-4696-b0ce-24905314de0e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:22.958152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3e5d938a-f89d-4696-b0ce-24905314de0e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:22.964655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e5d938a-f89d-4696-b0ce-24905314de0e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:22.965100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e5d938a-f89d-4696-b0ce-24905314de0e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:22.965847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e5d938a-f89d-4696-b0ce-24905314de0e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:22.966278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3e5d938a-f89d-4696-b0ce-24905314de0e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:23.097898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3e5d938a-f89d-4696-b0ce-24905314de0e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:23.100279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3e54c115-1766-4373-8733-458f3547ca09 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:23.100924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3e54c115-1766-4373-8733-458f3547ca09 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:23.106963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3e5d938a-f89d-4696-b0ce-24905314de0e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153383 Jul 28 20:23:23.107533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1344/2548] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:22 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:23.107807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e54c115-1766-4373-8733-458f3547ca09 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:23.108246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e54c115-1766-4373-8733-458f3547ca09 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:23.109033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e54c115-1766-4373-8733-458f3547ca09 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:23.109460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3e54c115-1766-4373-8733-458f3547ca09 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:23.238480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3e54c115-1766-4373-8733-458f3547ca09 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:23.246376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3e54c115-1766-4373-8733-458f3547ca09 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150012 Jul 28 20:23:23.246931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1205/2549] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:23 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:23.626885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-92779eb4-7018-47ef-a27a-61bd66904323 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:23.627489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-92779eb4-7018-47ef-a27a-61bd66904323 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:23.634112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92779eb4-7018-47ef-a27a-61bd66904323 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:23.634547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92779eb4-7018-47ef-a27a-61bd66904323 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:23.635282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92779eb4-7018-47ef-a27a-61bd66904323 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:23.635703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92779eb4-7018-47ef-a27a-61bd66904323 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:23.699621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-92779eb4-7018-47ef-a27a-61bd66904323 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:23.708219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-92779eb4-7018-47ef-a27a-61bd66904323 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085190 Jul 28 20:23:23.708800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1345/2550] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:24.128592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a3f0ebb8-249a-4e70-b5fc-f3082c80d416 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:24.129208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a3f0ebb8-249a-4e70-b5fc-f3082c80d416 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:24.135639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a3f0ebb8-249a-4e70-b5fc-f3082c80d416 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:24.136089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a3f0ebb8-249a-4e70-b5fc-f3082c80d416 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:24.136878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a3f0ebb8-249a-4e70-b5fc-f3082c80d416 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:24.137314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a3f0ebb8-249a-4e70-b5fc-f3082c80d416 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:24.267450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-04e52ada-6bd2-4f45-98b5-87cd63288513 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:24.268117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-04e52ada-6bd2-4f45-98b5-87cd63288513 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:24.270437 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a3f0ebb8-249a-4e70-b5fc-f3082c80d416 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:24.271738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=82 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:24.277870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04e52ada-6bd2-4f45-98b5-87cd63288513 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:24.278349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04e52ada-6bd2-4f45-98b5-87cd63288513 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:24.279399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04e52ada-6bd2-4f45-98b5-87cd63288513 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:24.279540 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a3f0ebb8-249a-4e70-b5fc-f3082c80d416 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154828 Jul 28 20:23:24.279830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-04e52ada-6bd2-4f45-98b5-87cd63288513 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:24.280051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1206/2551] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:24 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:24.409725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-04e52ada-6bd2-4f45-98b5-87cd63288513 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:24.417707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-04e52ada-6bd2-4f45-98b5-87cd63288513 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.154296 Jul 28 20:23:24.418264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1346/2552] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:24 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:24.729042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8bfbc2c9-d3a8-4d5d-a468-bc4c48ea1f1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:24.729632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8bfbc2c9-d3a8-4d5d-a468-bc4c48ea1f1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:24.735624 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8bfbc2c9-d3a8-4d5d-a468-bc4c48ea1f1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:24.736070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8bfbc2c9-d3a8-4d5d-a468-bc4c48ea1f1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:24.736855 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8bfbc2c9-d3a8-4d5d-a468-bc4c48ea1f1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:24.737319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8bfbc2c9-d3a8-4d5d-a468-bc4c48ea1f1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:24.801965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8bfbc2c9-d3a8-4d5d-a468-bc4c48ea1f1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:24.809951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8bfbc2c9-d3a8-4d5d-a468-bc4c48ea1f1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084872 Jul 28 20:23:24.810500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1207/2553] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:25.301190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4d3d7e11-af3a-450f-8bef-9e2c41176ad7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:25.301797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4d3d7e11-af3a-450f-8bef-9e2c41176ad7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:25.308282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d3d7e11-af3a-450f-8bef-9e2c41176ad7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:25.308773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d3d7e11-af3a-450f-8bef-9e2c41176ad7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:25.309525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d3d7e11-af3a-450f-8bef-9e2c41176ad7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:25.309953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d3d7e11-af3a-450f-8bef-9e2c41176ad7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:25.439063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4d3d7e11-af3a-450f-8bef-9e2c41176ad7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:25.439334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-310cbd67-e34e-4133-b36d-33e05e0a0256 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:25.439944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-310cbd67-e34e-4133-b36d-33e05e0a0256 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:25.447445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-310cbd67-e34e-4133-b36d-33e05e0a0256 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:25.447897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-310cbd67-e34e-4133-b36d-33e05e0a0256 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:25.448484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4d3d7e11-af3a-450f-8bef-9e2c41176ad7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151624 Jul 28 20:23:25.448739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-310cbd67-e34e-4133-b36d-33e05e0a0256 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:25.449142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1347/2554] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:25 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:25.449276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-310cbd67-e34e-4133-b36d-33e05e0a0256 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:25.579431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-310cbd67-e34e-4133-b36d-33e05e0a0256 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:25.587316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-310cbd67-e34e-4133-b36d-33e05e0a0256 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151810 Jul 28 20:23:25.587869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1208/2555] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:25 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:25.830936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-477cbc96-e9f6-440b-ab83-2da22453f5c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:25.831695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-477cbc96-e9f6-440b-ab83-2da22453f5c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:25.837680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-477cbc96-e9f6-440b-ab83-2da22453f5c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:25.838120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-477cbc96-e9f6-440b-ab83-2da22453f5c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:25.838859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-477cbc96-e9f6-440b-ab83-2da22453f5c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:25.839284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-477cbc96-e9f6-440b-ab83-2da22453f5c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:25.902748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-477cbc96-e9f6-440b-ab83-2da22453f5c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:25.911369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-477cbc96-e9f6-440b-ab83-2da22453f5c7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084276 Jul 28 20:23:25.911924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1348/2556] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:26.468887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c5b913e5-8fe9-4f16-a598-c883e10a0ca4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:26.469428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c5b913e5-8fe9-4f16-a598-c883e10a0ca4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:26.476046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5b913e5-8fe9-4f16-a598-c883e10a0ca4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:26.476492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5b913e5-8fe9-4f16-a598-c883e10a0ca4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:26.477270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5b913e5-8fe9-4f16-a598-c883e10a0ca4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:26.477699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5b913e5-8fe9-4f16-a598-c883e10a0ca4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:26.608524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4dfc2b9a-e890-48f2-98fa-60facd286cd4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:26.609037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c5b913e5-8fe9-4f16-a598-c883e10a0ca4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:26.609167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4dfc2b9a-e890-48f2-98fa-60facd286cd4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:26.615773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4dfc2b9a-e890-48f2-98fa-60facd286cd4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:26.616221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4dfc2b9a-e890-48f2-98fa-60facd286cd4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:26.617003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4dfc2b9a-e890-48f2-98fa-60facd286cd4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:26.617434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4dfc2b9a-e890-48f2-98fa-60facd286cd4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:26.617635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c5b913e5-8fe9-4f16-a598-c883e10a0ca4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152666 Jul 28 20:23:26.618210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1209/2557] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:26 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:26.743333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4dfc2b9a-e890-48f2-98fa-60facd286cd4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:26.751461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4dfc2b9a-e890-48f2-98fa-60facd286cd4 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.146753 Jul 28 20:23:26.752033 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1349/2558] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:26 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:26.931878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f59b48d7-1405-4efe-b410-4f25f087cbc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:26.932480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f59b48d7-1405-4efe-b410-4f25f087cbc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:26.938521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f59b48d7-1405-4efe-b410-4f25f087cbc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:26.938967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f59b48d7-1405-4efe-b410-4f25f087cbc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:26.939700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f59b48d7-1405-4efe-b410-4f25f087cbc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:26.940122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f59b48d7-1405-4efe-b410-4f25f087cbc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:27.005365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f59b48d7-1405-4efe-b410-4f25f087cbc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:27.015780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f59b48d7-1405-4efe-b410-4f25f087cbc1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087566 Jul 28 20:23:27.020701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1210/2559] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:27.639466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2278def9-8f2c-4dfd-bd7f-d1de09edbcf2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:27.640079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2278def9-8f2c-4dfd-bd7f-d1de09edbcf2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:27.647570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2278def9-8f2c-4dfd-bd7f-d1de09edbcf2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:27.648019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2278def9-8f2c-4dfd-bd7f-d1de09edbcf2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:27.648810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2278def9-8f2c-4dfd-bd7f-d1de09edbcf2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:27.649241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2278def9-8f2c-4dfd-bd7f-d1de09edbcf2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:27.774625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0d929a86-86f8-4ce8-b035-6e35b171031a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:27.775247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0d929a86-86f8-4ce8-b035-6e35b171031a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:27.779105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2278def9-8f2c-4dfd-bd7f-d1de09edbcf2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:27.782382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d929a86-86f8-4ce8-b035-6e35b171031a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:27.782832 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d929a86-86f8-4ce8-b035-6e35b171031a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:27.783596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d929a86-86f8-4ce8-b035-6e35b171031a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:27.784123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d929a86-86f8-4ce8-b035-6e35b171031a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:27.787464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2278def9-8f2c-4dfd-bd7f-d1de09edbcf2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151826 Jul 28 20:23:27.788291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1350/2560] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:27 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:27.912220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0d929a86-86f8-4ce8-b035-6e35b171031a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:27.920124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0d929a86-86f8-4ce8-b035-6e35b171031a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149372 Jul 28 20:23:27.920713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1211/2561] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:27 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:28.040833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3f0dfecc-01c7-49d6-b0ab-9504651e99e1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:28.041446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3f0dfecc-01c7-49d6-b0ab-9504651e99e1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:28.047404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f0dfecc-01c7-49d6-b0ab-9504651e99e1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:28.047849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f0dfecc-01c7-49d6-b0ab-9504651e99e1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:28.048620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f0dfecc-01c7-49d6-b0ab-9504651e99e1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:28.049051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f0dfecc-01c7-49d6-b0ab-9504651e99e1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:28.112982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f0dfecc-01c7-49d6-b0ab-9504651e99e1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:28.121241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3f0dfecc-01c7-49d6-b0ab-9504651e99e1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084301 Jul 28 20:23:28.121798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1351/2562] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:28.808034 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d60740e8-a426-4f7f-a37a-fb0cb1609e52 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:28.808686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d60740e8-a426-4f7f-a37a-fb0cb1609e52 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:28.815184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d60740e8-a426-4f7f-a37a-fb0cb1609e52 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:28.815637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d60740e8-a426-4f7f-a37a-fb0cb1609e52 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:28.816388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d60740e8-a426-4f7f-a37a-fb0cb1609e52 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:28.816850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d60740e8-a426-4f7f-a37a-fb0cb1609e52 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:28.942513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-12b0bbbe-8e78-4588-bf8d-687e1ccdd51f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:28.943135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-12b0bbbe-8e78-4588-bf8d-687e1ccdd51f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:28.943861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d60740e8-a426-4f7f-a37a-fb0cb1609e52 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:28.949917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12b0bbbe-8e78-4588-bf8d-687e1ccdd51f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:28.950368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12b0bbbe-8e78-4588-bf8d-687e1ccdd51f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:28.951169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12b0bbbe-8e78-4588-bf8d-687e1ccdd51f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:28.951606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12b0bbbe-8e78-4588-bf8d-687e1ccdd51f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:28.952086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d60740e8-a426-4f7f-a37a-fb0cb1609e52 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147909 Jul 28 20:23:28.952672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1212/2563] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:28 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:29.078403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-12b0bbbe-8e78-4588-bf8d-687e1ccdd51f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:29.086738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-12b0bbbe-8e78-4588-bf8d-687e1ccdd51f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148654 Jul 28 20:23:29.087303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1352/2564] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:28 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:29.142508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fda9ff8f-6e4c-4b6e-9420-a565c11b5012 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:29.143114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fda9ff8f-6e4c-4b6e-9420-a565c11b5012 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:29.149169 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fda9ff8f-6e4c-4b6e-9420-a565c11b5012 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:29.149605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fda9ff8f-6e4c-4b6e-9420-a565c11b5012 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:29.150348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fda9ff8f-6e4c-4b6e-9420-a565c11b5012 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:29.150774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fda9ff8f-6e4c-4b6e-9420-a565c11b5012 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:29.215293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fda9ff8f-6e4c-4b6e-9420-a565c11b5012 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:29.218635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:29.225115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fda9ff8f-6e4c-4b6e-9420-a565c11b5012 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086456 Jul 28 20:23:29.225674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1213/2565] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:29.973719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e46f4544-4057-4dd6-90c5-43051c4d46bb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:29.974336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e46f4544-4057-4dd6-90c5-43051c4d46bb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:29.980899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e46f4544-4057-4dd6-90c5-43051c4d46bb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:29.981346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e46f4544-4057-4dd6-90c5-43051c4d46bb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:29.982101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e46f4544-4057-4dd6-90c5-43051c4d46bb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:29.982533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e46f4544-4057-4dd6-90c5-43051c4d46bb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:30.108358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e9b02d2d-2d89-4e42-9e2a-09384c3b6d40 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:30.109103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e9b02d2d-2d89-4e42-9e2a-09384c3b6d40 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:30.112928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e46f4544-4057-4dd6-90c5-43051c4d46bb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:30.116877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9b02d2d-2d89-4e42-9e2a-09384c3b6d40 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:30.117328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9b02d2d-2d89-4e42-9e2a-09384c3b6d40 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:30.118089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9b02d2d-2d89-4e42-9e2a-09384c3b6d40 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:30.118521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9b02d2d-2d89-4e42-9e2a-09384c3b6d40 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:30.121034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e46f4544-4057-4dd6-90c5-43051c4d46bb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151845 Jul 28 20:23:30.121590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1353/2566] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:29 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:30.245875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-32500bff-d0a2-4ad7-855c-6267574f17a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:30.246381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-32500bff-d0a2-4ad7-855c-6267574f17a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:30.252013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e9b02d2d-2d89-4e42-9e2a-09384c3b6d40 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:30.252290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32500bff-d0a2-4ad7-855c-6267574f17a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:30.253078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32500bff-d0a2-4ad7-855c-6267574f17a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:30.253845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32500bff-d0a2-4ad7-855c-6267574f17a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:30.254281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-32500bff-d0a2-4ad7-855c-6267574f17a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:30.261604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e9b02d2d-2d89-4e42-9e2a-09384c3b6d40 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.157159 Jul 28 20:23:30.262174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1214/2567] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:30 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:30.465099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-32500bff-d0a2-4ad7-855c-6267574f17a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:30.473243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-32500bff-d0a2-4ad7-855c-6267574f17a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.231297 Jul 28 20:23:30.473798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1354/2568] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:31.141873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cc8c1790-1660-4ca4-ae85-3a0eaee20be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:31.142512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cc8c1790-1660-4ca4-ae85-3a0eaee20be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:31.149120 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc8c1790-1660-4ca4-ae85-3a0eaee20be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:31.149564 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc8c1790-1660-4ca4-ae85-3a0eaee20be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:31.150315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc8c1790-1660-4ca4-ae85-3a0eaee20be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:31.150744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc8c1790-1660-4ca4-ae85-3a0eaee20be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:31.283740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fcd8a567-2274-464f-aa3e-7a76553ea232 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:31.285280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fcd8a567-2274-464f-aa3e-7a76553ea232 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:31.291624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fcd8a567-2274-464f-aa3e-7a76553ea232 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:31.292068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fcd8a567-2274-464f-aa3e-7a76553ea232 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:31.293141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fcd8a567-2274-464f-aa3e-7a76553ea232 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:31.293312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fcd8a567-2274-464f-aa3e-7a76553ea232 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:31.295164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cc8c1790-1660-4ca4-ae85-3a0eaee20be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:31.303329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cc8c1790-1660-4ca4-ae85-3a0eaee20be3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.165484 Jul 28 20:23:31.303890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1215/2569] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:31 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:31.422942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fcd8a567-2274-464f-aa3e-7a76553ea232 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:31.430810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fcd8a567-2274-464f-aa3e-7a76553ea232 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150942 Jul 28 20:23:31.431364 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1355/2570] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:31 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:31.494025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-16cff2f2-036b-4eef-9e12-c12c96120360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:31.494660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-16cff2f2-036b-4eef-9e12-c12c96120360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:31.500681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16cff2f2-036b-4eef-9e12-c12c96120360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:31.501122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16cff2f2-036b-4eef-9e12-c12c96120360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:31.501870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16cff2f2-036b-4eef-9e12-c12c96120360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:31.502298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-16cff2f2-036b-4eef-9e12-c12c96120360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:31.575401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-16cff2f2-036b-4eef-9e12-c12c96120360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:31.583958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-16cff2f2-036b-4eef-9e12-c12c96120360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.093771 Jul 28 20:23:31.587079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1216/2571] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:32.324410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5cd8b669-ae36-4ed0-8a36-9a96ef6dce8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:32.325041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5cd8b669-ae36-4ed0-8a36-9a96ef6dce8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:32.331556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cd8b669-ae36-4ed0-8a36-9a96ef6dce8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:32.331991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cd8b669-ae36-4ed0-8a36-9a96ef6dce8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:32.332769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cd8b669-ae36-4ed0-8a36-9a96ef6dce8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:32.333194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5cd8b669-ae36-4ed0-8a36-9a96ef6dce8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:32.351603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:32.452976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-24d21a4a-2041-4fb7-b922-2ce8db7a2438 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:32.453568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-24d21a4a-2041-4fb7-b922-2ce8db7a2438 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:32.460243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-24d21a4a-2041-4fb7-b922-2ce8db7a2438 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:32.460812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-24d21a4a-2041-4fb7-b922-2ce8db7a2438 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:32.461586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-24d21a4a-2041-4fb7-b922-2ce8db7a2438 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:32.462033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-24d21a4a-2041-4fb7-b922-2ce8db7a2438 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:32.464381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5cd8b669-ae36-4ed0-8a36-9a96ef6dce8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:32.473107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5cd8b669-ae36-4ed0-8a36-9a96ef6dce8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152449 Jul 28 20:23:32.473681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1356/2572] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:32 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:32.591177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-24d21a4a-2041-4fb7-b922-2ce8db7a2438 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:32.599990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-24d21a4a-2041-4fb7-b922-2ce8db7a2438 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151206 Jul 28 20:23:32.600569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1217/2573] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:32 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:32.610501 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e6ddd641-1dcf-4000-a779-96bf0d7c7ce2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:32.611114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e6ddd641-1dcf-4000-a779-96bf0d7c7ce2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:32.617614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6ddd641-1dcf-4000-a779-96bf0d7c7ce2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:32.618061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6ddd641-1dcf-4000-a779-96bf0d7c7ce2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:32.618807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6ddd641-1dcf-4000-a779-96bf0d7c7ce2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:32.619238 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e6ddd641-1dcf-4000-a779-96bf0d7c7ce2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:32.682803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e6ddd641-1dcf-4000-a779-96bf0d7c7ce2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:32.690603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e6ddd641-1dcf-4000-a779-96bf0d7c7ce2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084042 Jul 28 20:23:32.691156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1357/2574] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:33.494698 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5e632d05-01b2-4efd-8c63-8b35bd3cafa1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:33.495231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5e632d05-01b2-4efd-8c63-8b35bd3cafa1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:33.501631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e632d05-01b2-4efd-8c63-8b35bd3cafa1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:33.502071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e632d05-01b2-4efd-8c63-8b35bd3cafa1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:33.502809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e632d05-01b2-4efd-8c63-8b35bd3cafa1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:33.503231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5e632d05-01b2-4efd-8c63-8b35bd3cafa1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:33.622020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8eb80dd2-8196-4a7b-bb48-528d08930fc8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:33.622607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8eb80dd2-8196-4a7b-bb48-528d08930fc8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:33.629259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8eb80dd2-8196-4a7b-bb48-528d08930fc8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:33.629789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8eb80dd2-8196-4a7b-bb48-528d08930fc8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:33.629998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5e632d05-01b2-4efd-8c63-8b35bd3cafa1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:33.630546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8eb80dd2-8196-4a7b-bb48-528d08930fc8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:33.630974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8eb80dd2-8196-4a7b-bb48-528d08930fc8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:33.638001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5e632d05-01b2-4efd-8c63-8b35bd3cafa1 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147250 Jul 28 20:23:33.638554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1218/2575] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:33 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:33.711805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-24ed7ba5-b046-461a-9675-84499b64485e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:33.712410 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-24ed7ba5-b046-461a-9675-84499b64485e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:33.718438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-24ed7ba5-b046-461a-9675-84499b64485e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:33.718882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-24ed7ba5-b046-461a-9675-84499b64485e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:33.719626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-24ed7ba5-b046-461a-9675-84499b64485e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:33.720053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-24ed7ba5-b046-461a-9675-84499b64485e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:33.772524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8eb80dd2-8196-4a7b-bb48-528d08930fc8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:33.781134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8eb80dd2-8196-4a7b-bb48-528d08930fc8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.162893 Jul 28 20:23:33.781722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1358/2576] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:33 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:33.793012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-24ed7ba5-b046-461a-9675-84499b64485e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:33.801594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-24ed7ba5-b046-461a-9675-84499b64485e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.093728 Jul 28 20:23:33.802144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1219/2577] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:34.659421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-88a3d8b4-1653-48c3-8d99-285e9b2d98d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:34.660059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-88a3d8b4-1653-48c3-8d99-285e9b2d98d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:34.667140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a3d8b4-1653-48c3-8d99-285e9b2d98d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:34.667580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a3d8b4-1653-48c3-8d99-285e9b2d98d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:34.668318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a3d8b4-1653-48c3-8d99-285e9b2d98d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:34.668773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a3d8b4-1653-48c3-8d99-285e9b2d98d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:34.795471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-88a3d8b4-1653-48c3-8d99-285e9b2d98d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:34.803187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-10ba8e84-2a49-4a9e-b347-b928d68355df tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:34.803843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-10ba8e84-2a49-4a9e-b347-b928d68355df tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:34.804827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-88a3d8b4-1653-48c3-8d99-285e9b2d98d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149073 Jul 28 20:23:34.805579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1359/2578] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:34 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:34.810827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10ba8e84-2a49-4a9e-b347-b928d68355df tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:34.811291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10ba8e84-2a49-4a9e-b347-b928d68355df tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:34.812046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10ba8e84-2a49-4a9e-b347-b928d68355df tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:34.812478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10ba8e84-2a49-4a9e-b347-b928d68355df tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:34.822254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c312f79-9072-4031-9a61-c43c9d6a6bff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:34.822866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3c312f79-9072-4031-9a61-c43c9d6a6bff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:34.828930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c312f79-9072-4031-9a61-c43c9d6a6bff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:34.829381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c312f79-9072-4031-9a61-c43c9d6a6bff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:34.830135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c312f79-9072-4031-9a61-c43c9d6a6bff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:34.830565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c312f79-9072-4031-9a61-c43c9d6a6bff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:34.908796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3c312f79-9072-4031-9a61-c43c9d6a6bff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:34.917856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3c312f79-9072-4031-9a61-c43c9d6a6bff tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.099295 Jul 28 20:23:34.918429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1360/2579] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:34.970538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-10ba8e84-2a49-4a9e-b347-b928d68355df tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:34.978989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-10ba8e84-2a49-4a9e-b347-b928d68355df tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.180315 Jul 28 20:23:34.979547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1220/2580] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:34 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:35.825681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-62d0f209-5d30-4ff6-ad68-1d1b9db2280e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:35.826277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-62d0f209-5d30-4ff6-ad68-1d1b9db2280e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:35.832836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-62d0f209-5d30-4ff6-ad68-1d1b9db2280e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:35.833281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-62d0f209-5d30-4ff6-ad68-1d1b9db2280e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:35.834035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-62d0f209-5d30-4ff6-ad68-1d1b9db2280e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:35.834471 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-62d0f209-5d30-4ff6-ad68-1d1b9db2280e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:35.939091 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c43992e3-ebb5-4867-a6e6-41fcc3be5dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:35.939701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c43992e3-ebb5-4867-a6e6-41fcc3be5dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:35.946902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c43992e3-ebb5-4867-a6e6-41fcc3be5dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:35.947416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c43992e3-ebb5-4867-a6e6-41fcc3be5dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:35.948186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c43992e3-ebb5-4867-a6e6-41fcc3be5dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:35.948644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c43992e3-ebb5-4867-a6e6-41fcc3be5dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:35.964909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-62d0f209-5d30-4ff6-ad68-1d1b9db2280e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:35.972798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-62d0f209-5d30-4ff6-ad68-1d1b9db2280e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150948 Jul 28 20:23:35.974057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1361/2581] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:35 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:36.000287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-28d7e466-9621-4cdc-b4d6-b99693170e9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:36.000946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-28d7e466-9621-4cdc-b4d6-b99693170e9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:36.007051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28d7e466-9621-4cdc-b4d6-b99693170e9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:36.007487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28d7e466-9621-4cdc-b4d6-b99693170e9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:36.008241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28d7e466-9621-4cdc-b4d6-b99693170e9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:36.008693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28d7e466-9621-4cdc-b4d6-b99693170e9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:36.010715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c43992e3-ebb5-4867-a6e6-41fcc3be5dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:36.018775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c43992e3-ebb5-4867-a6e6-41fcc3be5dd6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083479 Jul 28 20:23:36.019342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1221/2582] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:36.139758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-28d7e466-9621-4cdc-b4d6-b99693170e9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:36.148281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-28d7e466-9621-4cdc-b4d6-b99693170e9a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151864 Jul 28 20:23:36.148867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1362/2583] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:35 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:36.995041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4fc5ccfb-97a6-4129-95ac-ec8168e24cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:36.995652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4fc5ccfb-97a6-4129-95ac-ec8168e24cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:37.002134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fc5ccfb-97a6-4129-95ac-ec8168e24cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:37.002580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fc5ccfb-97a6-4129-95ac-ec8168e24cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:37.003332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fc5ccfb-97a6-4129-95ac-ec8168e24cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:37.003765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fc5ccfb-97a6-4129-95ac-ec8168e24cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:37.041499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-af72f9be-75c5-4010-aa1f-f70ba45058e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:37.042025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-af72f9be-75c5-4010-aa1f-f70ba45058e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:37.048408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-af72f9be-75c5-4010-aa1f-f70ba45058e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:37.048892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-af72f9be-75c5-4010-aa1f-f70ba45058e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:37.049644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-af72f9be-75c5-4010-aa1f-f70ba45058e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:37.050075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-af72f9be-75c5-4010-aa1f-f70ba45058e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:37.122267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-af72f9be-75c5-4010-aa1f-f70ba45058e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:37.130225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-af72f9be-75c5-4010-aa1f-f70ba45058e5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.092515 Jul 28 20:23:37.130782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1363/2584] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:37.150900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4fc5ccfb-97a6-4129-95ac-ec8168e24cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:37.158999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4fc5ccfb-97a6-4129-95ac-ec8168e24cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.167863 Jul 28 20:23:37.159551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1222/2585] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:36 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:37.170709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-10fd0ae6-a95e-4a4d-b30b-233e678a4524 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:37.171396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-10fd0ae6-a95e-4a4d-b30b-233e678a4524 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:37.178347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10fd0ae6-a95e-4a4d-b30b-233e678a4524 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:37.178786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10fd0ae6-a95e-4a4d-b30b-233e678a4524 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:37.179530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10fd0ae6-a95e-4a4d-b30b-233e678a4524 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:37.179955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10fd0ae6-a95e-4a4d-b30b-233e678a4524 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:37.308970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-10fd0ae6-a95e-4a4d-b30b-233e678a4524 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:37.316907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-10fd0ae6-a95e-4a4d-b30b-233e678a4524 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.150716 Jul 28 20:23:37.317462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1364/2586] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:37 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:38.151286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-50ce0881-d7a3-4a06-a1b2-d5662300c726 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:38.151874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-50ce0881-d7a3-4a06-a1b2-d5662300c726 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:38.158578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50ce0881-d7a3-4a06-a1b2-d5662300c726 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:38.159024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50ce0881-d7a3-4a06-a1b2-d5662300c726 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:38.159774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50ce0881-d7a3-4a06-a1b2-d5662300c726 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:38.160212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50ce0881-d7a3-4a06-a1b2-d5662300c726 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:38.181220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e0af371b-09f1-42e6-ae1b-908baa3d8783 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:38.181950 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e0af371b-09f1-42e6-ae1b-908baa3d8783 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:38.188469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0af371b-09f1-42e6-ae1b-908baa3d8783 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:38.188943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0af371b-09f1-42e6-ae1b-908baa3d8783 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:38.189693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0af371b-09f1-42e6-ae1b-908baa3d8783 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:38.190122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0af371b-09f1-42e6-ae1b-908baa3d8783 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:38.224327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-50ce0881-d7a3-4a06-a1b2-d5662300c726 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:38.232290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-50ce0881-d7a3-4a06-a1b2-d5662300c726 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084824 Jul 28 20:23:38.232882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1223/2587] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:38.320075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e0af371b-09f1-42e6-ae1b-908baa3d8783 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:38.327994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e0af371b-09f1-42e6-ae1b-908baa3d8783 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150553 Jul 28 20:23:38.328593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1365/2588] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:38 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:38.337415 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-655a344b-f867-4dea-bac4-9f6e901df520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:38.338030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-655a344b-f867-4dea-bac4-9f6e901df520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:38.344242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-655a344b-f867-4dea-bac4-9f6e901df520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:38.344742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-655a344b-f867-4dea-bac4-9f6e901df520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:38.345499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-655a344b-f867-4dea-bac4-9f6e901df520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:38.345927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-655a344b-f867-4dea-bac4-9f6e901df520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:38.475218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-655a344b-f867-4dea-bac4-9f6e901df520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:38.483024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-655a344b-f867-4dea-bac4-9f6e901df520 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.149525 Jul 28 20:23:38.483586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1224/2589] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:38 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:38.597435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:23:38.598226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:23:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:23:39.253699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7e230cba-2f7d-4dab-8d49-91e57727fd53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:39.254923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7e230cba-2f7d-4dab-8d49-91e57727fd53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:39.261561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e230cba-2f7d-4dab-8d49-91e57727fd53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:39.262008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e230cba-2f7d-4dab-8d49-91e57727fd53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:39.262757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e230cba-2f7d-4dab-8d49-91e57727fd53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:39.263186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e230cba-2f7d-4dab-8d49-91e57727fd53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:39.324301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7e230cba-2f7d-4dab-8d49-91e57727fd53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:39.332378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7e230cba-2f7d-4dab-8d49-91e57727fd53 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082565 Jul 28 20:23:39.332994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1366/2590] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:39.349375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dc54c746-15a1-4422-bb51-81c5a5647672 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:39.349980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dc54c746-15a1-4422-bb51-81c5a5647672 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:39.356339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc54c746-15a1-4422-bb51-81c5a5647672 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:39.356900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc54c746-15a1-4422-bb51-81c5a5647672 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:39.357641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc54c746-15a1-4422-bb51-81c5a5647672 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:39.358069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc54c746-15a1-4422-bb51-81c5a5647672 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:39.485867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dc54c746-15a1-4422-bb51-81c5a5647672 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:39.494261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dc54c746-15a1-4422-bb51-81c5a5647672 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149486 Jul 28 20:23:39.494814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1225/2591] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:39 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:39.504649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-05d3db58-eb22-462b-8bb3-c99a46dc4255 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:39.505262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-05d3db58-eb22-462b-8bb3-c99a46dc4255 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:39.511170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05d3db58-eb22-462b-8bb3-c99a46dc4255 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:39.511609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05d3db58-eb22-462b-8bb3-c99a46dc4255 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:39.512349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05d3db58-eb22-462b-8bb3-c99a46dc4255 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:39.512928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-05d3db58-eb22-462b-8bb3-c99a46dc4255 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:39.662641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-05d3db58-eb22-462b-8bb3-c99a46dc4255 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:39.670668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-05d3db58-eb22-462b-8bb3-c99a46dc4255 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.169760 Jul 28 20:23:39.671192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1367/2592] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:39 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:40.353953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-721e19a5-df53-4fe8-8803-60255761fec3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:40.354590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-721e19a5-df53-4fe8-8803-60255761fec3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:40.361547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-721e19a5-df53-4fe8-8803-60255761fec3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:40.361983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-721e19a5-df53-4fe8-8803-60255761fec3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:40.362720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-721e19a5-df53-4fe8-8803-60255761fec3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:40.363142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-721e19a5-df53-4fe8-8803-60255761fec3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:40.424679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-721e19a5-df53-4fe8-8803-60255761fec3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:40.433110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-721e19a5-df53-4fe8-8803-60255761fec3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082951 Jul 28 20:23:40.433667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1226/2593] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:40.515657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5e7b5085-7494-4f88-90e2-cbd0bcf16ba0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:40.516257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5e7b5085-7494-4f88-90e2-cbd0bcf16ba0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:40.523253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e7b5085-7494-4f88-90e2-cbd0bcf16ba0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:40.523695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e7b5085-7494-4f88-90e2-cbd0bcf16ba0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:40.524432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e7b5085-7494-4f88-90e2-cbd0bcf16ba0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:40.524891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e7b5085-7494-4f88-90e2-cbd0bcf16ba0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:40.659869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5e7b5085-7494-4f88-90e2-cbd0bcf16ba0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:40.668384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5e7b5085-7494-4f88-90e2-cbd0bcf16ba0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.156546 Jul 28 20:23:40.668981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1368/2594] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:40 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:40.693657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-856edbb0-908c-4994-8b01-72c4327c32ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:40.694307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-856edbb0-908c-4994-8b01-72c4327c32ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:40.700214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-856edbb0-908c-4994-8b01-72c4327c32ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:40.700696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-856edbb0-908c-4994-8b01-72c4327c32ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:40.701448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-856edbb0-908c-4994-8b01-72c4327c32ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:40.701880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-856edbb0-908c-4994-8b01-72c4327c32ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:40.829269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-856edbb0-908c-4994-8b01-72c4327c32ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:40.837667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-856edbb0-908c-4994-8b01-72c4327c32ac tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148860 Jul 28 20:23:40.838240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1227/2595] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:40 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:41.453082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-efd133e6-1488-48b4-b7de-6f7cb1d4f45f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:41.453606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-efd133e6-1488-48b4-b7de-6f7cb1d4f45f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:41.459944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efd133e6-1488-48b4-b7de-6f7cb1d4f45f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:41.460386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efd133e6-1488-48b4-b7de-6f7cb1d4f45f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:41.461174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efd133e6-1488-48b4-b7de-6f7cb1d4f45f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:41.461601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efd133e6-1488-48b4-b7de-6f7cb1d4f45f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:41.522351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-efd133e6-1488-48b4-b7de-6f7cb1d4f45f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:41.530426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-efd133e6-1488-48b4-b7de-6f7cb1d4f45f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081270 Jul 28 20:23:41.530977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1369/2596] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:41.689207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7de70438-6ce1-4ea1-be5a-8f47c0b38a76 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:41.689820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7de70438-6ce1-4ea1-be5a-8f47c0b38a76 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:41.696154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7de70438-6ce1-4ea1-be5a-8f47c0b38a76 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:41.696623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7de70438-6ce1-4ea1-be5a-8f47c0b38a76 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:41.697373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7de70438-6ce1-4ea1-be5a-8f47c0b38a76 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:41.697801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7de70438-6ce1-4ea1-be5a-8f47c0b38a76 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:41.827015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7de70438-6ce1-4ea1-be5a-8f47c0b38a76 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:41.835583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7de70438-6ce1-4ea1-be5a-8f47c0b38a76 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150172 Jul 28 20:23:41.836141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1228/2597] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:41 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:41.859068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dc035dcd-ece1-4658-ba72-d656c2b1c70e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:41.859663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dc035dcd-ece1-4658-ba72-d656c2b1c70e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:41.865804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc035dcd-ece1-4658-ba72-d656c2b1c70e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:41.866363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc035dcd-ece1-4658-ba72-d656c2b1c70e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:41.867202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc035dcd-ece1-4658-ba72-d656c2b1c70e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:41.867626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc035dcd-ece1-4658-ba72-d656c2b1c70e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:42.000433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dc035dcd-ece1-4658-ba72-d656c2b1c70e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:42.008314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dc035dcd-ece1-4658-ba72-d656c2b1c70e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.153054 Jul 28 20:23:42.008898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1370/2598] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:41 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:42.552129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9d68c761-6190-4b9d-841b-28751b7a3925 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:42.552669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9d68c761-6190-4b9d-841b-28751b7a3925 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:42.558938 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d68c761-6190-4b9d-841b-28751b7a3925 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:42.559381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d68c761-6190-4b9d-841b-28751b7a3925 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:42.560120 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d68c761-6190-4b9d-841b-28751b7a3925 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:42.560567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d68c761-6190-4b9d-841b-28751b7a3925 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:42.619856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9d68c761-6190-4b9d-841b-28751b7a3925 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:42.627631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9d68c761-6190-4b9d-841b-28751b7a3925 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.079897 Jul 28 20:23:42.628184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1229/2599] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:42.857172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c426a4e4-c922-4944-9ae3-194d4b4b272f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:42.857787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c426a4e4-c922-4944-9ae3-194d4b4b272f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:42.865411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c426a4e4-c922-4944-9ae3-194d4b4b272f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:42.865857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c426a4e4-c922-4944-9ae3-194d4b4b272f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:42.866605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c426a4e4-c922-4944-9ae3-194d4b4b272f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:42.867035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c426a4e4-c922-4944-9ae3-194d4b4b272f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:42.996163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c426a4e4-c922-4944-9ae3-194d4b4b272f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:43.004745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c426a4e4-c922-4944-9ae3-194d4b4b272f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151280 Jul 28 20:23:43.005311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1371/2600] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:42 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:43.030158 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-345e041d-b434-4152-b598-f4b401786bf6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:43.030764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-345e041d-b434-4152-b598-f4b401786bf6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:43.037926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-345e041d-b434-4152-b598-f4b401786bf6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:43.038364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-345e041d-b434-4152-b598-f4b401786bf6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:43.039113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-345e041d-b434-4152-b598-f4b401786bf6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:43.039538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-345e041d-b434-4152-b598-f4b401786bf6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:43.058261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:43.168316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-345e041d-b434-4152-b598-f4b401786bf6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:43.177299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-345e041d-b434-4152-b598-f4b401786bf6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.151171 Jul 28 20:23:43.178157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1230/2601] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:43 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:43.649629 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-28e68f59-3d04-498c-827d-dcd9b7d16a02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:43.650239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-28e68f59-3d04-498c-827d-dcd9b7d16a02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:43.656486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28e68f59-3d04-498c-827d-dcd9b7d16a02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:43.656951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28e68f59-3d04-498c-827d-dcd9b7d16a02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:43.657693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28e68f59-3d04-498c-827d-dcd9b7d16a02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:43.658119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28e68f59-3d04-498c-827d-dcd9b7d16a02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:43.718412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-28e68f59-3d04-498c-827d-dcd9b7d16a02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:43.726454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-28e68f59-3d04-498c-827d-dcd9b7d16a02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080564 Jul 28 20:23:43.727006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1372/2602] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:44.026292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1c3c1a02-8730-4bf8-a5d0-362bc05a2818 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:44.026826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1c3c1a02-8730-4bf8-a5d0-362bc05a2818 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:44.033225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c3c1a02-8730-4bf8-a5d0-362bc05a2818 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:44.033836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c3c1a02-8730-4bf8-a5d0-362bc05a2818 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:44.034413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c3c1a02-8730-4bf8-a5d0-362bc05a2818 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:44.035478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c3c1a02-8730-4bf8-a5d0-362bc05a2818 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:44.167214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1c3c1a02-8730-4bf8-a5d0-362bc05a2818 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:44.175176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1c3c1a02-8730-4bf8-a5d0-362bc05a2818 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152848 Jul 28 20:23:44.175810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1231/2603] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:44 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:44.198356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-27f72510-33f8-4b72-97bf-aaa729fd8f4f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:44.198959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-27f72510-33f8-4b72-97bf-aaa729fd8f4f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:44.205375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27f72510-33f8-4b72-97bf-aaa729fd8f4f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:44.205820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27f72510-33f8-4b72-97bf-aaa729fd8f4f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:44.206558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27f72510-33f8-4b72-97bf-aaa729fd8f4f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:44.207511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-27f72510-33f8-4b72-97bf-aaa729fd8f4f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:44.211405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:44.334490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-27f72510-33f8-4b72-97bf-aaa729fd8f4f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:44.342596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-27f72510-33f8-4b72-97bf-aaa729fd8f4f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.148051 Jul 28 20:23:44.343154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1373/2604] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:44 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:44.746658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-30718d76-32f2-4093-8e57-e908e8d8205b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:44.747276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-30718d76-32f2-4093-8e57-e908e8d8205b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:44.753290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30718d76-32f2-4093-8e57-e908e8d8205b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:44.753789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30718d76-32f2-4093-8e57-e908e8d8205b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:44.754607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30718d76-32f2-4093-8e57-e908e8d8205b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:44.755047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-30718d76-32f2-4093-8e57-e908e8d8205b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:44.815066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-30718d76-32f2-4093-8e57-e908e8d8205b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:44.823070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-30718d76-32f2-4093-8e57-e908e8d8205b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080686 Jul 28 20:23:44.823632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1232/2605] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:45.195807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3d7c9e41-fe81-4037-8c08-bdd05faf6d7b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:45.196414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3d7c9e41-fe81-4037-8c08-bdd05faf6d7b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:45.202910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d7c9e41-fe81-4037-8c08-bdd05faf6d7b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:45.203493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d7c9e41-fe81-4037-8c08-bdd05faf6d7b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:45.204093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d7c9e41-fe81-4037-8c08-bdd05faf6d7b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:45.204520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d7c9e41-fe81-4037-8c08-bdd05faf6d7b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:45.334919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3d7c9e41-fe81-4037-8c08-bdd05faf6d7b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:45.342935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3d7c9e41-fe81-4037-8c08-bdd05faf6d7b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150979 Jul 28 20:23:45.343495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1374/2606] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:45 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:45.364753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7a346c25-2ca7-4dd4-8078-8e1b7af0b8dd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:45.365397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7a346c25-2ca7-4dd4-8078-8e1b7af0b8dd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:45.371787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a346c25-2ca7-4dd4-8078-8e1b7af0b8dd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:45.372232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a346c25-2ca7-4dd4-8078-8e1b7af0b8dd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:45.373118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a346c25-2ca7-4dd4-8078-8e1b7af0b8dd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:45.373547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a346c25-2ca7-4dd4-8078-8e1b7af0b8dd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:45.505003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7a346c25-2ca7-4dd4-8078-8e1b7af0b8dd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:45.513048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7a346c25-2ca7-4dd4-8078-8e1b7af0b8dd tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152678 Jul 28 20:23:45.513607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1233/2607] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:45 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:45.844664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f8c03ea8-cf36-415d-a8c2-f326f103eab0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:45.845374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f8c03ea8-cf36-415d-a8c2-f326f103eab0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:45.851399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8c03ea8-cf36-415d-a8c2-f326f103eab0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:45.851850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8c03ea8-cf36-415d-a8c2-f326f103eab0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:45.852623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8c03ea8-cf36-415d-a8c2-f326f103eab0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:45.853058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f8c03ea8-cf36-415d-a8c2-f326f103eab0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:45.916251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f8c03ea8-cf36-415d-a8c2-f326f103eab0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:45.924125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f8c03ea8-cf36-415d-a8c2-f326f103eab0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083460 Jul 28 20:23:45.924705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1375/2608] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:46.365259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-df67db38-6c64-41bf-bf02-30bcdaac4381 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:46.365901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-df67db38-6c64-41bf-bf02-30bcdaac4381 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:46.372498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df67db38-6c64-41bf-bf02-30bcdaac4381 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:46.372984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df67db38-6c64-41bf-bf02-30bcdaac4381 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:46.373741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df67db38-6c64-41bf-bf02-30bcdaac4381 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:46.374181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df67db38-6c64-41bf-bf02-30bcdaac4381 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:46.502821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-df67db38-6c64-41bf-bf02-30bcdaac4381 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:46.510898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-df67db38-6c64-41bf-bf02-30bcdaac4381 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150065 Jul 28 20:23:46.511467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1234/2609] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:46 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:46.536024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ad1bd3de-c026-47e2-a9ab-32a4a6106a8d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:46.536751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ad1bd3de-c026-47e2-a9ab-32a4a6106a8d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:46.543373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad1bd3de-c026-47e2-a9ab-32a4a6106a8d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:46.543885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad1bd3de-c026-47e2-a9ab-32a4a6106a8d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:46.544752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad1bd3de-c026-47e2-a9ab-32a4a6106a8d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:46.545262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad1bd3de-c026-47e2-a9ab-32a4a6106a8d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:46.675374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ad1bd3de-c026-47e2-a9ab-32a4a6106a8d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:46.683871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ad1bd3de-c026-47e2-a9ab-32a4a6106a8d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.152358 Jul 28 20:23:46.684522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1376/2610] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:46 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:46.945291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-20786fa6-6983-426c-b816-a2032c9abe39 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:46.945812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-20786fa6-6983-426c-b816-a2032c9abe39 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:46.952053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20786fa6-6983-426c-b816-a2032c9abe39 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:46.952499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20786fa6-6983-426c-b816-a2032c9abe39 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:46.953301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20786fa6-6983-426c-b816-a2032c9abe39 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:46.953729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20786fa6-6983-426c-b816-a2032c9abe39 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:47.019514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-20786fa6-6983-426c-b816-a2032c9abe39 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:47.027656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-20786fa6-6983-426c-b816-a2032c9abe39 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086500 Jul 28 20:23:47.028792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1235/2611] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:47.533583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6f436290-f37c-4c5a-ac28-f18ee3399c4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:47.534192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6f436290-f37c-4c5a-ac28-f18ee3399c4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:47.545308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f436290-f37c-4c5a-ac28-f18ee3399c4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:47.545927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f436290-f37c-4c5a-ac28-f18ee3399c4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:47.546552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f436290-f37c-4c5a-ac28-f18ee3399c4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:47.547592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f436290-f37c-4c5a-ac28-f18ee3399c4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:47.705933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-77af216b-0ed3-45b8-a614-4d5d8d0700ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:47.707336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-77af216b-0ed3-45b8-a614-4d5d8d0700ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:47.713776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77af216b-0ed3-45b8-a614-4d5d8d0700ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:47.714228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77af216b-0ed3-45b8-a614-4d5d8d0700ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:47.714999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77af216b-0ed3-45b8-a614-4d5d8d0700ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:47.715436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77af216b-0ed3-45b8-a614-4d5d8d0700ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:47.955568 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6f436290-f37c-4c5a-ac28-f18ee3399c4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:47.961433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:23:47.961639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:23:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a (ip 10.222.0.67) !!! Jul 28 20:23:47.964720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6f436290-f37c-4c5a-ac28-f18ee3399c4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.435052 Jul 28 20:23:47.966581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-77af216b-0ed3-45b8-a614-4d5d8d0700ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:47.966925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1377/2612] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:47 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:47.974814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-77af216b-0ed3-45b8-a614-4d5d8d0700ca tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.272796 Jul 28 20:23:47.975666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1236/2613] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:47 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:48.048741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-794b46aa-ed64-4a7e-86a3-c5104b344c58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:48.049431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-794b46aa-ed64-4a7e-86a3-c5104b344c58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:48.055986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-794b46aa-ed64-4a7e-86a3-c5104b344c58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:48.056437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-794b46aa-ed64-4a7e-86a3-c5104b344c58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:48.057219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-794b46aa-ed64-4a7e-86a3-c5104b344c58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:48.057654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-794b46aa-ed64-4a7e-86a3-c5104b344c58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:48.118615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-794b46aa-ed64-4a7e-86a3-c5104b344c58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:48.126448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-794b46aa-ed64-4a7e-86a3-c5104b344c58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081646 Jul 28 20:23:48.127004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1378/2614] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:48.990576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1aa942c7-f065-4c38-b03e-ce0656729138 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:48.991185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1aa942c7-f065-4c38-b03e-ce0656729138 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:48.997795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1aa942c7-f065-4c38-b03e-ce0656729138 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:48.998246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1aa942c7-f065-4c38-b03e-ce0656729138 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:48.998685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b9b5e047-d26c-4ee5-af63-955001ce2e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:48.999121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1aa942c7-f065-4c38-b03e-ce0656729138 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:48.999293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b9b5e047-d26c-4ee5-af63-955001ce2e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:48.999428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1aa942c7-f065-4c38-b03e-ce0656729138 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:49.005915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9b5e047-d26c-4ee5-af63-955001ce2e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:49.006358 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9b5e047-d26c-4ee5-af63-955001ce2e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:49.007111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9b5e047-d26c-4ee5-af63-955001ce2e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:49.007537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9b5e047-d26c-4ee5-af63-955001ce2e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:49.190220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1aa942c7-f065-4c38-b03e-ce0656729138 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:49.194163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b9b5e047-d26c-4ee5-af63-955001ce2e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:49.198737 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1aa942c7-f065-4c38-b03e-ce0656729138 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.213143 Jul 28 20:23:49.199302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1237/2615] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:48 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:49.202164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b9b5e047-d26c-4ee5-af63-955001ce2e68 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.207194 Jul 28 20:23:49.202877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1379/2616] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:48 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:49.203706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-084f7f4e-770a-401f-96d6-6fb66fa5a84d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:49.204304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-084f7f4e-770a-401f-96d6-6fb66fa5a84d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:49.210586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-084f7f4e-770a-401f-96d6-6fb66fa5a84d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:49.211025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-084f7f4e-770a-401f-96d6-6fb66fa5a84d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:49.211769 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-084f7f4e-770a-401f-96d6-6fb66fa5a84d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:49.212192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-084f7f4e-770a-401f-96d6-6fb66fa5a84d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:49.271826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-084f7f4e-770a-401f-96d6-6fb66fa5a84d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:49.279889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-084f7f4e-770a-401f-96d6-6fb66fa5a84d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.079621 Jul 28 20:23:49.280436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1238/2617] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:50.220943 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-78a694e7-725e-4e65-8829-d48e4cdc7c92 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:50.221565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-78a694e7-725e-4e65-8829-d48e4cdc7c92 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:50.223649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d3d4c78d-d015-449d-8cb9-41438e74a993 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:50.224264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d3d4c78d-d015-449d-8cb9-41438e74a993 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:50.228358 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78a694e7-725e-4e65-8829-d48e4cdc7c92 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:50.228833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78a694e7-725e-4e65-8829-d48e4cdc7c92 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:50.229585 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78a694e7-725e-4e65-8829-d48e4cdc7c92 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:50.230009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78a694e7-725e-4e65-8829-d48e4cdc7c92 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:50.230632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3d4c78d-d015-449d-8cb9-41438e74a993 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:50.231081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3d4c78d-d015-449d-8cb9-41438e74a993 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:50.231834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3d4c78d-d015-449d-8cb9-41438e74a993 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:50.232266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d3d4c78d-d015-449d-8cb9-41438e74a993 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:50.244981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:23:50.250284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:23:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 (ip 10.222.0.67) !!! Jul 28 20:23:50.425808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-78a694e7-725e-4e65-8829-d48e4cdc7c92 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:50.430012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d3d4c78d-d015-449d-8cb9-41438e74a993 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:50.433867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-78a694e7-725e-4e65-8829-d48e4cdc7c92 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.216763 Jul 28 20:23:50.434452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1380/2618] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:50 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:50.438346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d3d4c78d-d015-449d-8cb9-41438e74a993 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.218988 Jul 28 20:23:50.439045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1239/2619] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:50 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:50.440049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7ae24b8c-ee5e-4e4a-a3a2-fc14756b3a8b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:50.440678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7ae24b8c-ee5e-4e4a-a3a2-fc14756b3a8b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:50.447248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ae24b8c-ee5e-4e4a-a3a2-fc14756b3a8b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:50.447690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ae24b8c-ee5e-4e4a-a3a2-fc14756b3a8b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:50.448440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ae24b8c-ee5e-4e4a-a3a2-fc14756b3a8b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:50.448886 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7ae24b8c-ee5e-4e4a-a3a2-fc14756b3a8b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:50.522885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7ae24b8c-ee5e-4e4a-a3a2-fc14756b3a8b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:50.532099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7ae24b8c-ee5e-4e4a-a3a2-fc14756b3a8b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.096000 Jul 28 20:23:50.532682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1381/2620] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:51.456881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-402e2355-3201-41a0-a644-7760ec2b7ee4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:51.457913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-402e2355-3201-41a0-a644-7760ec2b7ee4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:51.460134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bc022c6c-36b3-4a80-bc48-f3e348dfe9d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:51.460808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bc022c6c-36b3-4a80-bc48-f3e348dfe9d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:51.464511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-402e2355-3201-41a0-a644-7760ec2b7ee4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:51.464998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-402e2355-3201-41a0-a644-7760ec2b7ee4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:51.465759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-402e2355-3201-41a0-a644-7760ec2b7ee4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:51.466205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-402e2355-3201-41a0-a644-7760ec2b7ee4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:51.467177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc022c6c-36b3-4a80-bc48-f3e348dfe9d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:51.467620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc022c6c-36b3-4a80-bc48-f3e348dfe9d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:51.468376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc022c6c-36b3-4a80-bc48-f3e348dfe9d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:51.468830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bc022c6c-36b3-4a80-bc48-f3e348dfe9d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:51.662312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-402e2355-3201-41a0-a644-7760ec2b7ee4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:51.666084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bc022c6c-36b3-4a80-bc48-f3e348dfe9d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:51.670287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-402e2355-3201-41a0-a644-7760ec2b7ee4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.218051 Jul 28 20:23:51.670849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1240/2621] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:51 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:51.674077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bc022c6c-36b3-4a80-bc48-f3e348dfe9d2 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.218533 Jul 28 20:23:51.676607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1382/2622] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:51 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:51.676760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-59cee81c-16bd-4d2a-b305-0399fea9a430 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:51.676760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-59cee81c-16bd-4d2a-b305-0399fea9a430 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:51.682174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59cee81c-16bd-4d2a-b305-0399fea9a430 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:51.682622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59cee81c-16bd-4d2a-b305-0399fea9a430 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:51.683365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59cee81c-16bd-4d2a-b305-0399fea9a430 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:51.683791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-59cee81c-16bd-4d2a-b305-0399fea9a430 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:51.743416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-59cee81c-16bd-4d2a-b305-0399fea9a430 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:51.751448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-59cee81c-16bd-4d2a-b305-0399fea9a430 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.079635 Jul 28 20:23:51.752198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1241/2623] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:52.692180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-07ae104a-3fc9-4487-8abf-cd99c5dcaff3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:52.692847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-07ae104a-3fc9-4487-8abf-cd99c5dcaff3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:52.695607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8d1d52b3-3c15-4b35-aaa5-9c9be2b1014b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:52.696218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8d1d52b3-3c15-4b35-aaa5-9c9be2b1014b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:52.698704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=76 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:52.699343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-07ae104a-3fc9-4487-8abf-cd99c5dcaff3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:52.699789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-07ae104a-3fc9-4487-8abf-cd99c5dcaff3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:52.700599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-07ae104a-3fc9-4487-8abf-cd99c5dcaff3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:52.701050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-07ae104a-3fc9-4487-8abf-cd99c5dcaff3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:52.704072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d1d52b3-3c15-4b35-aaa5-9c9be2b1014b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:52.704517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d1d52b3-3c15-4b35-aaa5-9c9be2b1014b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:52.705297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d1d52b3-3c15-4b35-aaa5-9c9be2b1014b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:52.705732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d1d52b3-3c15-4b35-aaa5-9c9be2b1014b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:52.895473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-07ae104a-3fc9-4487-8abf-cd99c5dcaff3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:52.899136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8d1d52b3-3c15-4b35-aaa5-9c9be2b1014b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:52.904032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-07ae104a-3fc9-4487-8abf-cd99c5dcaff3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.216063 Jul 28 20:23:52.904626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1383/2624] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:52 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:52.909128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f215150c-bde2-4836-948f-c9bf1feef7fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:52.910286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f215150c-bde2-4836-948f-c9bf1feef7fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:52.914771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8d1d52b3-3c15-4b35-aaa5-9c9be2b1014b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.222714 Jul 28 20:23:52.915243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1242/2625] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:52 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:52.918554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f215150c-bde2-4836-948f-c9bf1feef7fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:52.919006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f215150c-bde2-4836-948f-c9bf1feef7fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:52.919777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f215150c-bde2-4836-948f-c9bf1feef7fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:52.920217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f215150c-bde2-4836-948f-c9bf1feef7fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:52.986307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f215150c-bde2-4836-948f-c9bf1feef7fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:52.994272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f215150c-bde2-4836-948f-c9bf1feef7fd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.088696 Jul 28 20:23:52.994834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1384/2626] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:53.925789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0a66298b-2989-47a2-80e4-c64c84b0ffc4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:53.926404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0a66298b-2989-47a2-80e4-c64c84b0ffc4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:53.932997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a66298b-2989-47a2-80e4-c64c84b0ffc4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:53.933445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a66298b-2989-47a2-80e4-c64c84b0ffc4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:53.934199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a66298b-2989-47a2-80e4-c64c84b0ffc4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:53.934632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0a66298b-2989-47a2-80e4-c64c84b0ffc4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:53.935796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-220e95e1-58fd-40b3-920f-5ea8061c10a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:53.936426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-220e95e1-58fd-40b3-920f-5ea8061c10a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:53.943762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-220e95e1-58fd-40b3-920f-5ea8061c10a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:53.944233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-220e95e1-58fd-40b3-920f-5ea8061c10a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:53.945037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-220e95e1-58fd-40b3-920f-5ea8061c10a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:53.945461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-220e95e1-58fd-40b3-920f-5ea8061c10a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:54.123312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0a66298b-2989-47a2-80e4-c64c84b0ffc4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:54.127182 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-220e95e1-58fd-40b3-920f-5ea8061c10a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:54.131667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0a66298b-2989-47a2-80e4-c64c84b0ffc4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.210247 Jul 28 20:23:54.132239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1243/2627] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:53 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:54.135435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-220e95e1-58fd-40b3-920f-5ea8061c10a6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.203352 Jul 28 20:23:54.136160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1385/2628] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:53 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:54.136709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e47797b1-3502-499b-8e45-aa8f1b806eef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:54.137316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e47797b1-3502-499b-8e45-aa8f1b806eef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:54.143035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e47797b1-3502-499b-8e45-aa8f1b806eef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:54.143485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e47797b1-3502-499b-8e45-aa8f1b806eef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:54.144289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e47797b1-3502-499b-8e45-aa8f1b806eef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:54.144833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e47797b1-3502-499b-8e45-aa8f1b806eef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:54.208816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e47797b1-3502-499b-8e45-aa8f1b806eef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:54.216587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e47797b1-3502-499b-8e45-aa8f1b806eef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083347 Jul 28 20:23:54.217150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1244/2629] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:55.152634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-058b7561-5e01-4df8-b334-d659a997edd9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:55.153517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-058b7561-5e01-4df8-b334-d659a997edd9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:55.155783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=80 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:55.155944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-89b5f2e3-dc4e-46be-935e-51dc2e2fb014 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:55.156800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-89b5f2e3-dc4e-46be-935e-51dc2e2fb014 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:55.161999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-058b7561-5e01-4df8-b334-d659a997edd9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:55.162453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-058b7561-5e01-4df8-b334-d659a997edd9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:55.163255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-058b7561-5e01-4df8-b334-d659a997edd9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:55.163695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-058b7561-5e01-4df8-b334-d659a997edd9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:55.167037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-89b5f2e3-dc4e-46be-935e-51dc2e2fb014 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:55.167484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-89b5f2e3-dc4e-46be-935e-51dc2e2fb014 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:55.168242 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-89b5f2e3-dc4e-46be-935e-51dc2e2fb014 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:55.168725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-89b5f2e3-dc4e-46be-935e-51dc2e2fb014 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:55.356470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-058b7561-5e01-4df8-b334-d659a997edd9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:55.360331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-89b5f2e3-dc4e-46be-935e-51dc2e2fb014 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:55.365123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-058b7561-5e01-4df8-b334-d659a997edd9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.216296 Jul 28 20:23:55.365689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1386/2630] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:55 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:55.368986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-89b5f2e3-dc4e-46be-935e-51dc2e2fb014 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.217166 Jul 28 20:23:55.369686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1245/2631] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:55 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:55.370301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-da56df83-e33e-4402-8c4d-36529fb6b463 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:55.370898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-da56df83-e33e-4402-8c4d-36529fb6b463 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:55.376670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da56df83-e33e-4402-8c4d-36529fb6b463 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:55.377113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da56df83-e33e-4402-8c4d-36529fb6b463 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:55.377858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da56df83-e33e-4402-8c4d-36529fb6b463 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:55.378336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da56df83-e33e-4402-8c4d-36529fb6b463 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:55.440007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-da56df83-e33e-4402-8c4d-36529fb6b463 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:55.448605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-da56df83-e33e-4402-8c4d-36529fb6b463 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081954 Jul 28 20:23:55.449162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1387/2632] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:56.386431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-35b175d0-cfbf-4b28-8ac8-54d3c189e708 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:56.387045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-35b175d0-cfbf-4b28-8ac8-54d3c189e708 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:56.390473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-58527955-993e-4fdb-8d22-72efd0b805a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:56.391105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-58527955-993e-4fdb-8d22-72efd0b805a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:56.393739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35b175d0-cfbf-4b28-8ac8-54d3c189e708 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:56.394894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35b175d0-cfbf-4b28-8ac8-54d3c189e708 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:56.395673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35b175d0-cfbf-4b28-8ac8-54d3c189e708 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:56.396107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35b175d0-cfbf-4b28-8ac8-54d3c189e708 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:56.398562 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58527955-993e-4fdb-8d22-72efd0b805a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:56.399003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58527955-993e-4fdb-8d22-72efd0b805a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:56.399746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58527955-993e-4fdb-8d22-72efd0b805a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:56.400172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58527955-993e-4fdb-8d22-72efd0b805a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:56.593221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-35b175d0-cfbf-4b28-8ac8-54d3c189e708 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:56.596448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-58527955-993e-4fdb-8d22-72efd0b805a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:56.601535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-35b175d0-cfbf-4b28-8ac8-54d3c189e708 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.219058 Jul 28 20:23:56.602224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1246/2633] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:56 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:56.604696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-58527955-993e-4fdb-8d22-72efd0b805a3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.218079 Jul 28 20:23:56.605243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1388/2634] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:56 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:56.607074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4e6b8962-3dd3-4cc0-a3f0-33b9df6b3509 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:56.607869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4e6b8962-3dd3-4cc0-a3f0-33b9df6b3509 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:56.613945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4e6b8962-3dd3-4cc0-a3f0-33b9df6b3509 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:56.614416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4e6b8962-3dd3-4cc0-a3f0-33b9df6b3509 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:56.615156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4e6b8962-3dd3-4cc0-a3f0-33b9df6b3509 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:56.615594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4e6b8962-3dd3-4cc0-a3f0-33b9df6b3509 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:56.619606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:56.677719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4e6b8962-3dd3-4cc0-a3f0-33b9df6b3509 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:56.685616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4e6b8962-3dd3-4cc0-a3f0-33b9df6b3509 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082372 Jul 28 20:23:56.686208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1247/2635] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:56 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:57.631268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bfe082ac-16a3-43d0-8cee-3b667f6255d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:57.631825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8f0e5681-89c1-429b-b5ec-151a2eb0a044 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:57.632193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bfe082ac-16a3-43d0-8cee-3b667f6255d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:57.632409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8f0e5681-89c1-429b-b5ec-151a2eb0a044 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:57.638137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfe082ac-16a3-43d0-8cee-3b667f6255d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:57.638587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfe082ac-16a3-43d0-8cee-3b667f6255d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:57.639144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f0e5681-89c1-429b-b5ec-151a2eb0a044 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:57.639341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfe082ac-16a3-43d0-8cee-3b667f6255d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:57.639589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f0e5681-89c1-429b-b5ec-151a2eb0a044 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:57.639773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bfe082ac-16a3-43d0-8cee-3b667f6255d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:57.640340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f0e5681-89c1-429b-b5ec-151a2eb0a044 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:57.640797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8f0e5681-89c1-429b-b5ec-151a2eb0a044 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:57.844513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8f0e5681-89c1-429b-b5ec-151a2eb0a044 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:57.848062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bfe082ac-16a3-43d0-8cee-3b667f6255d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:57.851457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:23:57.853061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8f0e5681-89c1-429b-b5ec-151a2eb0a044 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.225468 Jul 28 20:23:57.853725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1248/2636] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:57 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:57.857297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bfe082ac-16a3-43d0-8cee-3b667f6255d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.230026 Jul 28 20:23:57.857846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1389/2637] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:57 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:57.858320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e3183c31-e0a2-4ef5-bbc7-7893be60a3cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:57.859009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e3183c31-e0a2-4ef5-bbc7-7893be60a3cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:57.865426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3183c31-e0a2-4ef5-bbc7-7893be60a3cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:57.865937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3183c31-e0a2-4ef5-bbc7-7893be60a3cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:57.866751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3183c31-e0a2-4ef5-bbc7-7893be60a3cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:57.867248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e3183c31-e0a2-4ef5-bbc7-7893be60a3cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:57.948361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e3183c31-e0a2-4ef5-bbc7-7893be60a3cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:57.957008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e3183c31-e0a2-4ef5-bbc7-7893be60a3cf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.102003 Jul 28 20:23:57.957888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1249/2638] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:58.874272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4db191a2-ce3d-459a-a3dc-0ccb34923a4a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:58.874892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4db191a2-ce3d-459a-a3dc-0ccb34923a4a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:58.879236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-79963f85-4980-4bdb-96e5-096350b300d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:58.879857 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-79963f85-4980-4bdb-96e5-096350b300d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:58.881480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4db191a2-ce3d-459a-a3dc-0ccb34923a4a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:58.881923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4db191a2-ce3d-459a-a3dc-0ccb34923a4a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:58.882674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4db191a2-ce3d-459a-a3dc-0ccb34923a4a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:58.883101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4db191a2-ce3d-459a-a3dc-0ccb34923a4a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:58.886954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79963f85-4980-4bdb-96e5-096350b300d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:58.887401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79963f85-4980-4bdb-96e5-096350b300d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:58.888160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79963f85-4980-4bdb-96e5-096350b300d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:58.888614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-79963f85-4980-4bdb-96e5-096350b300d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:59.078142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4db191a2-ce3d-459a-a3dc-0ccb34923a4a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:59.082014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-79963f85-4980-4bdb-96e5-096350b300d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:59.086729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4db191a2-ce3d-459a-a3dc-0ccb34923a4a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.216285 Jul 28 20:23:59.087611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1390/2639] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:58 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:23:59.091938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d93a4415-d985-437a-bacd-1b32d2e7550b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:23:59.092583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d93a4415-d985-437a-bacd-1b32d2e7550b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:23:59.092841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-79963f85-4980-4bdb-96e5-096350b300d7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.217894 Jul 28 20:23:59.093665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1250/2640] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:58 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:23:59.099050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d93a4415-d985-437a-bacd-1b32d2e7550b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:59.099494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d93a4415-d985-437a-bacd-1b32d2e7550b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:59.100242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d93a4415-d985-437a-bacd-1b32d2e7550b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:23:59.100770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d93a4415-d985-437a-bacd-1b32d2e7550b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:23:59.162300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d93a4415-d985-437a-bacd-1b32d2e7550b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:23:59.170245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d93a4415-d985-437a-bacd-1b32d2e7550b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081755 Jul 28 20:23:59.170802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1391/2641] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:23:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:00.109009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6dc7b8b5-d26f-426b-83de-8a3118336c96 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:00.109620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6dc7b8b5-d26f-426b-83de-8a3118336c96 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:00.115027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fdadc79e-9c2d-430f-baf6-b04323960afd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:00.115645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fdadc79e-9c2d-430f-baf6-b04323960afd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:00.116975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6dc7b8b5-d26f-426b-83de-8a3118336c96 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:00.117606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6dc7b8b5-d26f-426b-83de-8a3118336c96 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:00.118366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6dc7b8b5-d26f-426b-83de-8a3118336c96 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:00.118795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6dc7b8b5-d26f-426b-83de-8a3118336c96 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:00.121925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdadc79e-9c2d-430f-baf6-b04323960afd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:00.122368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdadc79e-9c2d-430f-baf6-b04323960afd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:00.123114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdadc79e-9c2d-430f-baf6-b04323960afd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:00.123538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdadc79e-9c2d-430f-baf6-b04323960afd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:00.314827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fdadc79e-9c2d-430f-baf6-b04323960afd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:00.317669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6dc7b8b5-d26f-426b-83de-8a3118336c96 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:00.322974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fdadc79e-9c2d-430f-baf6-b04323960afd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.212386 Jul 28 20:24:00.323545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1392/2642] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:00 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:00.325616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6dc7b8b5-d26f-426b-83de-8a3118336c96 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.220412 Jul 28 20:24:00.335177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1251/2643] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:00 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:00.335366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a8e057fb-88f4-4b4f-97e3-b05c4d821de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:00.335366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a8e057fb-88f4-4b4f-97e3-b05c4d821de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:00.335366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8e057fb-88f4-4b4f-97e3-b05c4d821de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:00.335366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8e057fb-88f4-4b4f-97e3-b05c4d821de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:00.335773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8e057fb-88f4-4b4f-97e3-b05c4d821de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:00.336147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a8e057fb-88f4-4b4f-97e3-b05c4d821de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:00.399212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a8e057fb-88f4-4b4f-97e3-b05c4d821de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:00.407294 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a8e057fb-88f4-4b4f-97e3-b05c4d821de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082791 Jul 28 20:24:00.407842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1393/2644] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:01.343812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-37e09aa4-c926-40d7-92b4-a486115eb378 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:01.344420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-37e09aa4-c926-40d7-92b4-a486115eb378 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:01.346993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6624fa10-f58a-403e-9c39-c4ce27b081b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:01.347735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6624fa10-f58a-403e-9c39-c4ce27b081b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:01.351300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37e09aa4-c926-40d7-92b4-a486115eb378 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:01.351744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37e09aa4-c926-40d7-92b4-a486115eb378 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:01.352498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37e09aa4-c926-40d7-92b4-a486115eb378 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:01.352952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37e09aa4-c926-40d7-92b4-a486115eb378 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:01.355437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6624fa10-f58a-403e-9c39-c4ce27b081b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:01.355884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6624fa10-f58a-403e-9c39-c4ce27b081b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:01.356659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6624fa10-f58a-403e-9c39-c4ce27b081b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:01.357090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6624fa10-f58a-403e-9c39-c4ce27b081b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:01.543148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-37e09aa4-c926-40d7-92b4-a486115eb378 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:01.549791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6624fa10-f58a-403e-9c39-c4ce27b081b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:01.551248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-37e09aa4-c926-40d7-92b4-a486115eb378 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.211205 Jul 28 20:24:01.551824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1252/2645] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:01 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:01.556335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-849a5025-ac57-42cb-b39e-4549efb9d676 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:01.556909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-849a5025-ac57-42cb-b39e-4549efb9d676 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:01.558685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6624fa10-f58a-403e-9c39-c4ce27b081b6 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.215545 Jul 28 20:24:01.569658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1394/2646] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:01 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:01.569836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-849a5025-ac57-42cb-b39e-4549efb9d676 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:01.569836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-849a5025-ac57-42cb-b39e-4549efb9d676 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:01.569836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-849a5025-ac57-42cb-b39e-4549efb9d676 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:01.569836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-849a5025-ac57-42cb-b39e-4549efb9d676 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:01.724742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-849a5025-ac57-42cb-b39e-4549efb9d676 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:01.732667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-849a5025-ac57-42cb-b39e-4549efb9d676 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.179869 Jul 28 20:24:01.733290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1253/2647] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:02.573343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-acf574b7-1c93-43a6-a346-9e46d04b302b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:02.573957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-acf574b7-1c93-43a6-a346-9e46d04b302b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:02.579438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6578a0dc-e5b3-471e-8dd2-7bcf3952ffaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:02.580044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6578a0dc-e5b3-471e-8dd2-7bcf3952ffaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:02.580168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-acf574b7-1c93-43a6-a346-9e46d04b302b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:02.580565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-acf574b7-1c93-43a6-a346-9e46d04b302b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:02.581322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-acf574b7-1c93-43a6-a346-9e46d04b302b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:02.581750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-acf574b7-1c93-43a6-a346-9e46d04b302b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:02.587271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6578a0dc-e5b3-471e-8dd2-7bcf3952ffaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:02.587715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6578a0dc-e5b3-471e-8dd2-7bcf3952ffaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:02.588463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6578a0dc-e5b3-471e-8dd2-7bcf3952ffaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:02.588998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6578a0dc-e5b3-471e-8dd2-7bcf3952ffaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:02.762372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6578a0dc-e5b3-471e-8dd2-7bcf3952ffaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:02.770722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6578a0dc-e5b3-471e-8dd2-7bcf3952ffaa tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.195060 Jul 28 20:24:02.771290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1254/2648] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:02 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:02.776025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6834113d-b6b8-40f1-8545-8953c328c6ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:02.777010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6834113d-b6b8-40f1-8545-8953c328c6ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:02.782681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6834113d-b6b8-40f1-8545-8953c328c6ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:02.783119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6834113d-b6b8-40f1-8545-8953c328c6ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:02.783995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6834113d-b6b8-40f1-8545-8953c328c6ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:02.784435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6834113d-b6b8-40f1-8545-8953c328c6ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:02.807274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-acf574b7-1c93-43a6-a346-9e46d04b302b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:02.815554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-acf574b7-1c93-43a6-a346-9e46d04b302b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.246403 Jul 28 20:24:02.816119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1395/2649] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:02 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:02.846530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6834113d-b6b8-40f1-8545-8953c328c6ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:02.854735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6834113d-b6b8-40f1-8545-8953c328c6ed tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082481 Jul 28 20:24:02.855266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1255/2650] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:02 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:03.792819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6209082a-bce7-43e1-8001-b9b3187ce004 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:03.793427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6209082a-bce7-43e1-8001-b9b3187ce004 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:03.799900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6209082a-bce7-43e1-8001-b9b3187ce004 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:03.800340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6209082a-bce7-43e1-8001-b9b3187ce004 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:03.801105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6209082a-bce7-43e1-8001-b9b3187ce004 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:03.802026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6209082a-bce7-43e1-8001-b9b3187ce004 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:03.836042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-56d84d62-333e-4dae-9aad-15f525d4e16c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:03.836916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-56d84d62-333e-4dae-9aad-15f525d4e16c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:03.843586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-56d84d62-333e-4dae-9aad-15f525d4e16c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:03.844033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-56d84d62-333e-4dae-9aad-15f525d4e16c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:03.844825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-56d84d62-333e-4dae-9aad-15f525d4e16c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:03.845263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-56d84d62-333e-4dae-9aad-15f525d4e16c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:04.000276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6209082a-bce7-43e1-8001-b9b3187ce004 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:04.008436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6209082a-bce7-43e1-8001-b9b3187ce004 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 200 len: 1728 microversion: 2.1 time: 0.219511 Jul 28 20:24:04.009031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1396/2651] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:03 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:04.013397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ec0cf053-6f31-4cb3-a064-fda34a974059 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:04.014006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ec0cf053-6f31-4cb3-a064-fda34a974059 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:04.019650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ec0cf053-6f31-4cb3-a064-fda34a974059 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:04.020093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ec0cf053-6f31-4cb3-a064-fda34a974059 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:04.020911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ec0cf053-6f31-4cb3-a064-fda34a974059 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:04.021342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ec0cf053-6f31-4cb3-a064-fda34a974059 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:04.030449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-56d84d62-333e-4dae-9aad-15f525d4e16c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:04.039159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-56d84d62-333e-4dae-9aad-15f525d4e16c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.206986 Jul 28 20:24:04.039731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1256/2652] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:03 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:04.044200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-591f1ce9-ea3b-48db-b7f5-a52511ffd537 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '.version_select at 0x7f5036614e50>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:04.072107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-591f1ce9-ea3b-48db-b7f5-a52511ffd537 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544778110" status: 202 len: 0 microversion: 2.1 time: 0.031018 Jul 28 20:24:04.072720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1257/2653] 10.222.0.67 () {58 vars in 1221 bytes} [Thu Jul 28 20:24:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544778110 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:24:04.084572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ec0cf053-6f31-4cb3-a064-fda34a974059 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:04.092698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ec0cf053-6f31-4cb3-a064-fda34a974059 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082550 Jul 28 20:24:04.093135 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1397/2654] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:05.061523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0d1e8115-d40b-4d5e-94ee-a4f200e444e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:05.062244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0d1e8115-d40b-4d5e-94ee-a4f200e444e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:05.069152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d1e8115-d40b-4d5e-94ee-a4f200e444e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:05.069602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d1e8115-d40b-4d5e-94ee-a4f200e444e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:05.070367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d1e8115-d40b-4d5e-94ee-a4f200e444e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:05.070831 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d1e8115-d40b-4d5e-94ee-a4f200e444e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:05.113584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-43400af0-2c55-473a-824b-28e998fe682d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:05.115822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-43400af0-2c55-473a-824b-28e998fe682d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:05.122431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43400af0-2c55-473a-824b-28e998fe682d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:05.122879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43400af0-2c55-473a-824b-28e998fe682d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:05.123654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43400af0-2c55-473a-824b-28e998fe682d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:05.124086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-43400af0-2c55-473a-824b-28e998fe682d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:05.217453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-43400af0-2c55-473a-824b-28e998fe682d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:05.230852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-43400af0-2c55-473a-824b-28e998fe682d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.120812 Jul 28 20:24:05.231690 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0d1e8115-d40b-4d5e-94ee-a4f200e444e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:05.232297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1398/2655] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:05 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:05.247667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-f217a9d6-2a8e-4641-b22a-080e1b90d1c1 req-9fc0c593-25ca-490a-8edb-c62e2cc75217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1cb56a8-6993-4767-9e30-5786f3b94743", "tag": "3420a2fe-6251-47ba-bc14-fdf7b2db8f58"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:24:05.253486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0d1e8115-d40b-4d5e-94ee-a4f200e444e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.195717 Jul 28 20:24:05.255549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1258/2656] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:05 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:05.265575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-f217a9d6-2a8e-4641-b22a-080e1b90d1c1 req-9fc0c593-25ca-490a-8edb-c62e2cc75217 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:05.274760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-f217a9d6-2a8e-4641-b22a-080e1b90d1c1 req-9fc0c593-25ca-490a-8edb-c62e2cc75217 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:05.289316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-f217a9d6-2a8e-4641-b22a-080e1b90d1c1 req-9fc0c593-25ca-490a-8edb-c62e2cc75217 service nova] Creating event network-changed:3420a2fe-6251-47ba-bc14-fdf7b2db8f58 for instance c1cb56a8-6993-4767-9e30-5786f3b94743 on hv-cinder-85144 Jul 28 20:24:05.299323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-f217a9d6-2a8e-4641-b22a-080e1b90d1c1 req-9fc0c593-25ca-490a-8edb-c62e2cc75217 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054834 Jul 28 20:24:05.300572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1399/2657] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:24:05.390496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e596b9e8-a54d-47ae-ba49-795c1ec3648f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: .version_select at 0x7f503702a0d0>, body: {"keypair": {"name": "tempest-keypair-1020770305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzrwiLmjs+OlczQdCSUBrOZaCnzPGIILJeUhQHeYn4Z4I1x3uMCAWk4UWVppI8PE1vCCodsbaCsvxAqVaFlv0YPzTj5KFFddtg6YxIANbEf8Ef638s7r/G7h+sajqu1jg=="}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:24:05.413579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-e596b9e8-a54d-47ae-ba49-795c1ec3648f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for project d6612a467ab54632a74cf113b4666eb1. Resources: {'key_pairs'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:24:05.417832 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-e596b9e8-a54d-47ae-ba49-795c1ec3648f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for user bd0b2bfa3d014222afd4e050ca8498f9 and project d6612a467ab54632a74cf113b4666eb1. Resources: {'key_pairs'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:24:05.459550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e596b9e8-a54d-47ae-ba49-795c1ec3648f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073110 Jul 28 20:24:05.460461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1259/2658] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:24:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:24:06.253400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a461afa5-b391-4714-a8eb-b3c8adc76e7d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:06.254936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a461afa5-b391-4714-a8eb-b3c8adc76e7d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:06.262098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a461afa5-b391-4714-a8eb-b3c8adc76e7d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:06.262555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a461afa5-b391-4714-a8eb-b3c8adc76e7d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:06.263501 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a461afa5-b391-4714-a8eb-b3c8adc76e7d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:06.263959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a461afa5-b391-4714-a8eb-b3c8adc76e7d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:06.284492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5bbbcb04-5431-4b55-a4ec-a5d16d7cf9ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:06.285288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5bbbcb04-5431-4b55-a4ec-a5d16d7cf9ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:06.294030 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bbbcb04-5431-4b55-a4ec-a5d16d7cf9ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:06.294905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bbbcb04-5431-4b55-a4ec-a5d16d7cf9ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:06.296385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bbbcb04-5431-4b55-a4ec-a5d16d7cf9ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:06.297044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bbbcb04-5431-4b55-a4ec-a5d16d7cf9ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:06.336452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a461afa5-b391-4714-a8eb-b3c8adc76e7d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:06.344412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a461afa5-b391-4714-a8eb-b3c8adc76e7d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.095283 Jul 28 20:24:06.345014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1400/2659] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:06.438808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5bbbcb04-5431-4b55-a4ec-a5d16d7cf9ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:06.447201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5bbbcb04-5431-4b55-a4ec-a5d16d7cf9ae tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.168957 Jul 28 20:24:06.447763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1260/2660] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:06 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:06.916206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1105886979", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5173547b-0aef-47cd-835f-b2a192d02fb4"}], "security_groups": [{"name": "tempest-securitygroup--597177728"}], "key_name": "tempest-keypair-1020770305", "user_data": "}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:24:07.021919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] validate_networks() for [('5173547b-0aef-47cd-835f-b2a192d02fb4', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:24:07.367193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7e26d240-a4e6-492d-a9d4-9edc5b8882f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:07.367789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7e26d240-a4e6-492d-a9d4-9edc5b8882f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:07.374473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e26d240-a4e6-492d-a9d4-9edc5b8882f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:07.375182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e26d240-a4e6-492d-a9d4-9edc5b8882f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:07.376182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e26d240-a4e6-492d-a9d4-9edc5b8882f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:07.376358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e26d240-a4e6-492d-a9d4-9edc5b8882f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:07.479960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7e26d240-a4e6-492d-a9d4-9edc5b8882f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:07.490255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7e26d240-a4e6-492d-a9d4-9edc5b8882f2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.127850 Jul 28 20:24:07.490755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1261/2661] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:07.509424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-592c5f43-b60c-4944-92fa-915a3719546d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:07.510149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-592c5f43-b60c-4944-92fa-915a3719546d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:07.516616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-592c5f43-b60c-4944-92fa-915a3719546d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:07.517071 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-592c5f43-b60c-4944-92fa-915a3719546d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:07.517956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-592c5f43-b60c-4944-92fa-915a3719546d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:07.518385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-592c5f43-b60c-4944-92fa-915a3719546d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:07.523512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:24:07.524031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:24:07.524413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:24:07.524986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:24:07.525390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:24:07.534773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:07.536449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:07.536709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:07.536941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:07.554442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for project d6612a467ab54632a74cf113b4666eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:24:07.558789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for user bd0b2bfa3d014222afd4e050ca8498f9 and project d6612a467ab54632a74cf113b4666eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:24:07.572623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:24:07.576697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:24:07.641176 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b87fdbe8-82ef-45e0-8d60-92980c5e7bdf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.729191 Jul 28 20:24:07.641822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1401/2662] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:24:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 20:24:07.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f345bae4-7a58-43a9-8357-910db7cc9b85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:07.656323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f345bae4-7a58-43a9-8357-910db7cc9b85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:07.673407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-592c5f43-b60c-4944-92fa-915a3719546d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:07.690375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-592c5f43-b60c-4944-92fa-915a3719546d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.184978 Jul 28 20:24:07.691045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1262/2663] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:07 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:07.733367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f345bae4-7a58-43a9-8357-910db7cc9b85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:07.741653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f345bae4-7a58-43a9-8357-910db7cc9b85 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1242 microversion: 2.1 time: 0.090149 Jul 28 20:24:07.742136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1402/2664] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:07 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:08.511403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e197f62b-fd9e-4b7b-bc70-07481300b360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:08.512147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e197f62b-fd9e-4b7b-bc70-07481300b360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:08.518620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e197f62b-fd9e-4b7b-bc70-07481300b360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:08.519063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e197f62b-fd9e-4b7b-bc70-07481300b360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:08.519810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e197f62b-fd9e-4b7b-bc70-07481300b360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:08.520235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e197f62b-fd9e-4b7b-bc70-07481300b360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:08.583487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e197f62b-fd9e-4b7b-bc70-07481300b360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:08.591297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e197f62b-fd9e-4b7b-bc70-07481300b360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083788 Jul 28 20:24:08.591847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1263/2665] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:08.711359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f47c1c4f-a997-4ad2-b85b-3d215cb33668 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:08.711922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f47c1c4f-a997-4ad2-b85b-3d215cb33668 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:08.718410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f47c1c4f-a997-4ad2-b85b-3d215cb33668 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:08.718850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f47c1c4f-a997-4ad2-b85b-3d215cb33668 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:08.719600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f47c1c4f-a997-4ad2-b85b-3d215cb33668 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:08.720026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f47c1c4f-a997-4ad2-b85b-3d215cb33668 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:08.764446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-96041d84-b98c-4fb5-b591-f0bcd1a9ecce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:08.765206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-96041d84-b98c-4fb5-b591-f0bcd1a9ecce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:08.771366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-96041d84-b98c-4fb5-b591-f0bcd1a9ecce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:08.771888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-96041d84-b98c-4fb5-b591-f0bcd1a9ecce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:08.772757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-96041d84-b98c-4fb5-b591-f0bcd1a9ecce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:08.773362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-96041d84-b98c-4fb5-b591-f0bcd1a9ecce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:08.857762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-96041d84-b98c-4fb5-b591-f0bcd1a9ecce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:08.871003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-96041d84-b98c-4fb5-b591-f0bcd1a9ecce tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1302 microversion: 2.1 time: 0.111236 Jul 28 20:24:08.886611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f47c1c4f-a997-4ad2-b85b-3d215cb33668 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:08.887848 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1264/2666] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:08 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1302 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:08.894600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f47c1c4f-a997-4ad2-b85b-3d215cb33668 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.187156 Jul 28 20:24:08.895221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1403/2667] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:08 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:09.611759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a98c67d7-8953-472a-be31-cea453138f0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:09.613139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a98c67d7-8953-472a-be31-cea453138f0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:09.620198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a98c67d7-8953-472a-be31-cea453138f0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:09.620788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a98c67d7-8953-472a-be31-cea453138f0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:09.621810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a98c67d7-8953-472a-be31-cea453138f0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:09.622321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a98c67d7-8953-472a-be31-cea453138f0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:09.692149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a98c67d7-8953-472a-be31-cea453138f0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:09.695615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:09.701982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a98c67d7-8953-472a-be31-cea453138f0e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.094313 Jul 28 20:24:09.704393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1265/2668] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:09 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:09.893325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0d2ef321-c52a-4231-989b-1ea6d351d6bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:09.894026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0d2ef321-c52a-4231-989b-1ea6d351d6bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:09.901710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d2ef321-c52a-4231-989b-1ea6d351d6bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:09.902233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d2ef321-c52a-4231-989b-1ea6d351d6bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:09.903055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d2ef321-c52a-4231-989b-1ea6d351d6bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:09.903800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d2ef321-c52a-4231-989b-1ea6d351d6bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:09.916039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d9f82e10-f8a7-4588-b96c-90750658146e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:09.916672 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d9f82e10-f8a7-4588-b96c-90750658146e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:09.923327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9f82e10-f8a7-4588-b96c-90750658146e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:09.923766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9f82e10-f8a7-4588-b96c-90750658146e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:09.924745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9f82e10-f8a7-4588-b96c-90750658146e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:09.925174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9f82e10-f8a7-4588-b96c-90750658146e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:10.115283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0d2ef321-c52a-4231-989b-1ea6d351d6bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:10.123592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0d2ef321-c52a-4231-989b-1ea6d351d6bc tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1367 microversion: 2.1 time: 0.234055 Jul 28 20:24:10.124508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1404/2669] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:09 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:10.135291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d9f82e10-f8a7-4588-b96c-90750658146e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:10.149184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d9f82e10-f8a7-4588-b96c-90750658146e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.237031 Jul 28 20:24:10.150075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1266/2670] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:09 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:10.255478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-6564b292-c0f4-4504-9991-fa6e5edbf9df req-3e1a7c9e-b4c0-4d51-8dfd-70d74743ebf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e331bb00-5b75-40e7-9658-3c691aee4e24", "tag": "76e06d6f-2c0b-45fa-9513-bb7d5fcd96ed"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:24:10.266488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-6564b292-c0f4-4504-9991-fa6e5edbf9df req-3e1a7c9e-b4c0-4d51-8dfd-70d74743ebf6 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:10.267512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-6564b292-c0f4-4504-9991-fa6e5edbf9df req-3e1a7c9e-b4c0-4d51-8dfd-70d74743ebf6 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:10.281600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-6564b292-c0f4-4504-9991-fa6e5edbf9df req-3e1a7c9e-b4c0-4d51-8dfd-70d74743ebf6 service nova] Creating event network-changed:76e06d6f-2c0b-45fa-9513-bb7d5fcd96ed for instance e331bb00-5b75-40e7-9658-3c691aee4e24 on hv-cinder-85144 Jul 28 20:24:10.287323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-6564b292-c0f4-4504-9991-fa6e5edbf9df req-3e1a7c9e-b4c0-4d51-8dfd-70d74743ebf6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035987 Jul 28 20:24:10.287931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1405/2671] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:24:10.723872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cb32d154-66a7-4569-84ef-b5790a130e5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:10.724649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cb32d154-66a7-4569-84ef-b5790a130e5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:10.731417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb32d154-66a7-4569-84ef-b5790a130e5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:10.732070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb32d154-66a7-4569-84ef-b5790a130e5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:10.732874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb32d154-66a7-4569-84ef-b5790a130e5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:10.733352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cb32d154-66a7-4569-84ef-b5790a130e5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:10.797158 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cb32d154-66a7-4569-84ef-b5790a130e5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:10.805022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cb32d154-66a7-4569-84ef-b5790a130e5c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085603 Jul 28 20:24:10.805581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1267/2672] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:10 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:11.147981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-be62702a-4a6b-40dd-8be3-571e60c22996 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:11.148732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-be62702a-4a6b-40dd-8be3-571e60c22996 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:11.155231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be62702a-4a6b-40dd-8be3-571e60c22996 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:11.155675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be62702a-4a6b-40dd-8be3-571e60c22996 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:11.156423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be62702a-4a6b-40dd-8be3-571e60c22996 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:11.156888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-be62702a-4a6b-40dd-8be3-571e60c22996 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:11.171194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-677d4787-7da6-43e7-92f5-ce7c777f590a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:11.171799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-677d4787-7da6-43e7-92f5-ce7c777f590a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:11.177767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-677d4787-7da6-43e7-92f5-ce7c777f590a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:11.178209 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-677d4787-7da6-43e7-92f5-ce7c777f590a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:11.178957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-677d4787-7da6-43e7-92f5-ce7c777f590a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:11.179387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-677d4787-7da6-43e7-92f5-ce7c777f590a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:11.350327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-be62702a-4a6b-40dd-8be3-571e60c22996 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:11.356838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-677d4787-7da6-43e7-92f5-ce7c777f590a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:11.358124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-be62702a-4a6b-40dd-8be3-571e60c22996 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1367 microversion: 2.1 time: 0.215545 Jul 28 20:24:11.358819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1406/2673] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:11 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:11.365837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-677d4787-7da6-43e7-92f5-ce7c777f590a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.198521 Jul 28 20:24:11.366385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1268/2674] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:11 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:11.825440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8730a914-3ceb-4e3a-ace3-bac6352423a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:11.826046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8730a914-3ceb-4e3a-ace3-bac6352423a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:11.831965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8730a914-3ceb-4e3a-ace3-bac6352423a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:11.832501 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8730a914-3ceb-4e3a-ace3-bac6352423a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:11.833271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8730a914-3ceb-4e3a-ace3-bac6352423a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:11.833699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8730a914-3ceb-4e3a-ace3-bac6352423a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:11.894005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8730a914-3ceb-4e3a-ace3-bac6352423a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:11.902056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8730a914-3ceb-4e3a-ace3-bac6352423a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080416 Jul 28 20:24:11.902607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1407/2675] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:12.379455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-066919c7-c468-4e26-872a-d574237ed815 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:12.380138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-066919c7-c468-4e26-872a-d574237ed815 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:12.386151 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d6ab9d49-fe20-4e1a-8e8f-07747410a6b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:12.386842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d6ab9d49-fe20-4e1a-8e8f-07747410a6b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:12.387050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-066919c7-c468-4e26-872a-d574237ed815 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:12.387496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-066919c7-c468-4e26-872a-d574237ed815 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:12.388246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-066919c7-c468-4e26-872a-d574237ed815 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:12.388707 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-066919c7-c468-4e26-872a-d574237ed815 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:12.393560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6ab9d49-fe20-4e1a-8e8f-07747410a6b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:12.394082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6ab9d49-fe20-4e1a-8e8f-07747410a6b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:12.395439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6ab9d49-fe20-4e1a-8e8f-07747410a6b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:12.395934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d6ab9d49-fe20-4e1a-8e8f-07747410a6b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:12.580061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-066919c7-c468-4e26-872a-d574237ed815 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:12.584710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d6ab9d49-fe20-4e1a-8e8f-07747410a6b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:12.588488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-066919c7-c468-4e26-872a-d574237ed815 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1367 microversion: 2.1 time: 0.213002 Jul 28 20:24:12.589087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1269/2676] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:12 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:12.592917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d6ab9d49-fe20-4e1a-8e8f-07747410a6b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.210639 Jul 28 20:24:12.593548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1408/2677] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:12 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:12.923591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cadc3d99-38fe-48a7-bd25-6ab3a1ebf3d4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:12.924269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cadc3d99-38fe-48a7-bd25-6ab3a1ebf3d4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:12.930344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cadc3d99-38fe-48a7-bd25-6ab3a1ebf3d4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:12.930793 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cadc3d99-38fe-48a7-bd25-6ab3a1ebf3d4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:12.931546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cadc3d99-38fe-48a7-bd25-6ab3a1ebf3d4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:12.931976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cadc3d99-38fe-48a7-bd25-6ab3a1ebf3d4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:12.995908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cadc3d99-38fe-48a7-bd25-6ab3a1ebf3d4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:13.003947 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cadc3d99-38fe-48a7-bd25-6ab3a1ebf3d4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084195 Jul 28 20:24:13.004512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1270/2678] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:13.609692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dde6d7fd-d115-4184-a4a1-14be3f6a215f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:13.610279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dde6d7fd-d115-4184-a4a1-14be3f6a215f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:13.615151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b5d2b1cd-7efe-4d3b-be5d-113900fcdc6f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:13.615775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b5d2b1cd-7efe-4d3b-be5d-113900fcdc6f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:13.617321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dde6d7fd-d115-4184-a4a1-14be3f6a215f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:13.617760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dde6d7fd-d115-4184-a4a1-14be3f6a215f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:13.618505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dde6d7fd-d115-4184-a4a1-14be3f6a215f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:13.618926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dde6d7fd-d115-4184-a4a1-14be3f6a215f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:13.622535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5d2b1cd-7efe-4d3b-be5d-113900fcdc6f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:13.622987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5d2b1cd-7efe-4d3b-be5d-113900fcdc6f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:13.623745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5d2b1cd-7efe-4d3b-be5d-113900fcdc6f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:13.624177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5d2b1cd-7efe-4d3b-be5d-113900fcdc6f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:13.637199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:13.807105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b5d2b1cd-7efe-4d3b-be5d-113900fcdc6f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:13.811103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dde6d7fd-d115-4184-a4a1-14be3f6a215f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:13.815263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b5d2b1cd-7efe-4d3b-be5d-113900fcdc6f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.204930 Jul 28 20:24:13.815829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1271/2679] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:13 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:13.819195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dde6d7fd-d115-4184-a4a1-14be3f6a215f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1367 microversion: 2.1 time: 0.213314 Jul 28 20:24:13.819747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1409/2680] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:13 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:14.025018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f30d5f09-be2d-43e5-bcbd-cb00c2ae45a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:14.025546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f30d5f09-be2d-43e5-bcbd-cb00c2ae45a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:14.031807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f30d5f09-be2d-43e5-bcbd-cb00c2ae45a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:14.032254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f30d5f09-be2d-43e5-bcbd-cb00c2ae45a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:14.033031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f30d5f09-be2d-43e5-bcbd-cb00c2ae45a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:14.033463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f30d5f09-be2d-43e5-bcbd-cb00c2ae45a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:14.306973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f30d5f09-be2d-43e5-bcbd-cb00c2ae45a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:14.314930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f30d5f09-be2d-43e5-bcbd-cb00c2ae45a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.293792 Jul 28 20:24:14.315495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1272/2681] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:14.837512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-df412004-ef05-4a9c-b22f-611a62e312f5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:14.838121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-df412004-ef05-4a9c-b22f-611a62e312f5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:14.839716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0819a393-1cd8-4cad-9f1a-5286f905fb1f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:14.840324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0819a393-1cd8-4cad-9f1a-5286f905fb1f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:14.845090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df412004-ef05-4a9c-b22f-611a62e312f5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:14.845539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df412004-ef05-4a9c-b22f-611a62e312f5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:14.846363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df412004-ef05-4a9c-b22f-611a62e312f5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:14.846789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-df412004-ef05-4a9c-b22f-611a62e312f5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:14.846915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0819a393-1cd8-4cad-9f1a-5286f905fb1f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:14.847254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0819a393-1cd8-4cad-9f1a-5286f905fb1f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:14.848180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0819a393-1cd8-4cad-9f1a-5286f905fb1f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:14.848646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0819a393-1cd8-4cad-9f1a-5286f905fb1f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:15.031696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-df412004-ef05-4a9c-b22f-611a62e312f5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:15.042576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-df412004-ef05-4a9c-b22f-611a62e312f5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.208843 Jul 28 20:24:15.043739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1410/2682] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:14 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:15.046789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0819a393-1cd8-4cad-9f1a-5286f905fb1f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:15.060589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0819a393-1cd8-4cad-9f1a-5286f905fb1f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1367 microversion: 2.1 time: 0.224431 Jul 28 20:24:15.061094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1273/2683] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:14 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:15.335292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-17d1c664-8a39-4092-8215-0fa7135d3199 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:15.336724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-17d1c664-8a39-4092-8215-0fa7135d3199 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:15.342751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17d1c664-8a39-4092-8215-0fa7135d3199 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:15.343193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17d1c664-8a39-4092-8215-0fa7135d3199 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:15.343934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17d1c664-8a39-4092-8215-0fa7135d3199 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:15.344362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-17d1c664-8a39-4092-8215-0fa7135d3199 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:15.404410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-17d1c664-8a39-4092-8215-0fa7135d3199 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:15.413798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-17d1c664-8a39-4092-8215-0fa7135d3199 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082427 Jul 28 20:24:15.414351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1411/2684] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:16.064212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-615a3dd7-cc6a-43f0-ab99-627451510e0b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:16.064858 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-615a3dd7-cc6a-43f0-ab99-627451510e0b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:16.066753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:16.072551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-615a3dd7-cc6a-43f0-ab99-627451510e0b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:16.073008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-615a3dd7-cc6a-43f0-ab99-627451510e0b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:16.073763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-615a3dd7-cc6a-43f0-ab99-627451510e0b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:16.074193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-615a3dd7-cc6a-43f0-ab99-627451510e0b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:16.081328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8b7f81c9-6576-4674-9e33-d29dafb5c77f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:16.081933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8b7f81c9-6576-4674-9e33-d29dafb5c77f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:16.089080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b7f81c9-6576-4674-9e33-d29dafb5c77f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:16.089519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b7f81c9-6576-4674-9e33-d29dafb5c77f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:16.090263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b7f81c9-6576-4674-9e33-d29dafb5c77f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:16.090686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8b7f81c9-6576-4674-9e33-d29dafb5c77f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:16.267040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-615a3dd7-cc6a-43f0-ab99-627451510e0b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:16.276044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-615a3dd7-cc6a-43f0-ab99-627451510e0b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.215703 Jul 28 20:24:16.277054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1274/2685] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:16 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:16.280218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8b7f81c9-6576-4674-9e33-d29dafb5c77f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:16.290179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8b7f81c9-6576-4674-9e33-d29dafb5c77f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1367 microversion: 2.1 time: 0.212416 Jul 28 20:24:16.290995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1412/2686] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:16 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:16.435610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5597ae74-67fd-4e3d-8ec3-8aae0ee8e5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:16.436296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5597ae74-67fd-4e3d-8ec3-8aae0ee8e5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:16.443522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5597ae74-67fd-4e3d-8ec3-8aae0ee8e5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:16.444080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5597ae74-67fd-4e3d-8ec3-8aae0ee8e5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:16.445010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5597ae74-67fd-4e3d-8ec3-8aae0ee8e5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:16.445546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5597ae74-67fd-4e3d-8ec3-8aae0ee8e5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:16.470914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-735a277d-a36e-459f-bead-485607cdf9de req-e8abe092-dc0c-487e-ab32-552828aa6b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e331bb00-5b75-40e7-9658-3c691aee4e24", "name": "network-vif-plugged", "status": "completed", "tag": "76e06d6f-2c0b-45fa-9513-bb7d5fcd96ed"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:24:16.481523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-735a277d-a36e-459f-bead-485607cdf9de req-e8abe092-dc0c-487e-ab32-552828aa6b77 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:16.482210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-735a277d-a36e-459f-bead-485607cdf9de req-e8abe092-dc0c-487e-ab32-552828aa6b77 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:16.496183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-735a277d-a36e-459f-bead-485607cdf9de req-e8abe092-dc0c-487e-ab32-552828aa6b77 service nova] Creating event network-vif-plugged:76e06d6f-2c0b-45fa-9513-bb7d5fcd96ed for instance e331bb00-5b75-40e7-9658-3c691aee4e24 on hv-cinder-85144 Jul 28 20:24:16.502861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-735a277d-a36e-459f-bead-485607cdf9de req-e8abe092-dc0c-487e-ab32-552828aa6b77 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093297 Jul 28 20:24:16.503458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1275/2687] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:24:16.512898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5597ae74-67fd-4e3d-8ec3-8aae0ee8e5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:16.521553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5597ae74-67fd-4e3d-8ec3-8aae0ee8e5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.090154 Jul 28 20:24:16.522108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1413/2688] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:16 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:17.298286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0baa6b51-77b7-48de-b351-13403b3f565e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:17.298980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0baa6b51-77b7-48de-b351-13403b3f565e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:17.306543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0baa6b51-77b7-48de-b351-13403b3f565e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:17.306991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0baa6b51-77b7-48de-b351-13403b3f565e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:17.307745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0baa6b51-77b7-48de-b351-13403b3f565e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:17.308176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0baa6b51-77b7-48de-b351-13403b3f565e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:17.311002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2741782b-e043-40de-ad0a-49405acf50ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:17.311718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2741782b-e043-40de-ad0a-49405acf50ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:17.318180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2741782b-e043-40de-ad0a-49405acf50ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:17.318626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2741782b-e043-40de-ad0a-49405acf50ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:17.319386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2741782b-e043-40de-ad0a-49405acf50ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:17.319821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2741782b-e043-40de-ad0a-49405acf50ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:17.504442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0baa6b51-77b7-48de-b351-13403b3f565e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:17.507202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2741782b-e043-40de-ad0a-49405acf50ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:17.512535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0baa6b51-77b7-48de-b351-13403b3f565e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.218392 Jul 28 20:24:17.513116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1276/2689] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:17 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:17.514530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2741782b-e043-40de-ad0a-49405acf50ab tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1367 microversion: 2.1 time: 0.207297 Jul 28 20:24:17.515083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1414/2690] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:17 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:17.542553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a603afaa-2c7e-4530-a369-d593b707c39c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:17.543162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a603afaa-2c7e-4530-a369-d593b707c39c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:17.549230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a603afaa-2c7e-4530-a369-d593b707c39c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:17.549667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a603afaa-2c7e-4530-a369-d593b707c39c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:17.550432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a603afaa-2c7e-4530-a369-d593b707c39c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:17.550913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a603afaa-2c7e-4530-a369-d593b707c39c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:17.610483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a603afaa-2c7e-4530-a369-d593b707c39c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:17.619202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a603afaa-2c7e-4530-a369-d593b707c39c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080389 Jul 28 20:24:17.619763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1277/2691] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:18.535311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d3109ee9-ec3f-4c45-9405-551ca6acc384 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:18.535926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4a826b27-c0ea-46ce-a298-75c58087523f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:18.536314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d3109ee9-ec3f-4c45-9405-551ca6acc384 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:18.536429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4a826b27-c0ea-46ce-a298-75c58087523f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:18.541722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:18.542398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=8 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:18.542874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a826b27-c0ea-46ce-a298-75c58087523f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:18.543333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a826b27-c0ea-46ce-a298-75c58087523f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:18.544104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a826b27-c0ea-46ce-a298-75c58087523f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:18.544773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4a826b27-c0ea-46ce-a298-75c58087523f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:18.545004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3109ee9-ec3f-4c45-9405-551ca6acc384 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:18.545477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3109ee9-ec3f-4c45-9405-551ca6acc384 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:18.546247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3109ee9-ec3f-4c45-9405-551ca6acc384 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:18.546682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3109ee9-ec3f-4c45-9405-551ca6acc384 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:18.749523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4a826b27-c0ea-46ce-a298-75c58087523f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:18.757013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d3109ee9-ec3f-4c45-9405-551ca6acc384 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:18.757662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4a826b27-c0ea-46ce-a298-75c58087523f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1557 microversion: 2.1 time: 0.226096 Jul 28 20:24:18.758216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1278/2692] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:18 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1557 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:18.762670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-944215b2-726e-4f73-9107-2fbddc97966c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:18.763278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-944215b2-726e-4f73-9107-2fbddc97966c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:18.765290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d3109ee9-ec3f-4c45-9405-551ca6acc384 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.233939 Jul 28 20:24:18.769176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-944215b2-726e-4f73-9107-2fbddc97966c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:18.769631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-944215b2-726e-4f73-9107-2fbddc97966c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:18.770387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-944215b2-726e-4f73-9107-2fbddc97966c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:18.770822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-944215b2-726e-4f73-9107-2fbddc97966c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:18.776893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1415/2693] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:18 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:18.782225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f0a781c1-8540-4a98-99dd-fa05b7b057d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:18.782794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f0a781c1-8540-4a98-99dd-fa05b7b057d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:18.789485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0a781c1-8540-4a98-99dd-fa05b7b057d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:18.789935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0a781c1-8540-4a98-99dd-fa05b7b057d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:18.790693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0a781c1-8540-4a98-99dd-fa05b7b057d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:18.791129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f0a781c1-8540-4a98-99dd-fa05b7b057d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:18.849396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-944215b2-726e-4f73-9107-2fbddc97966c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:18.858129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-944215b2-726e-4f73-9107-2fbddc97966c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.098926 Jul 28 20:24:18.858787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1279/2694] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:18.890820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f0a781c1-8540-4a98-99dd-fa05b7b057d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112547 Jul 28 20:24:18.891392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1416/2695] 10.222.0.67 () {58 vars in 1275 bytes} [Thu Jul 28 20:24:18 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:24:19.787491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-20e47a8f-f8f6-45d4-a6ed-38bcc57770b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:19.788148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-20e47a8f-f8f6-45d4-a6ed-38bcc57770b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:19.795586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20e47a8f-f8f6-45d4-a6ed-38bcc57770b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:19.795795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20e47a8f-f8f6-45d4-a6ed-38bcc57770b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:19.796454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20e47a8f-f8f6-45d4-a6ed-38bcc57770b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:19.796929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-20e47a8f-f8f6-45d4-a6ed-38bcc57770b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:19.901977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-814885a8-0f28-4f49-8535-f38a3b63a84b req-f37aeb0e-bc60-4bf3-984a-89babd9be663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e331bb00-5b75-40e7-9658-3c691aee4e24", "tag": "76e06d6f-2c0b-45fa-9513-bb7d5fcd96ed"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:24:19.912044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-814885a8-0f28-4f49-8535-f38a3b63a84b req-f37aeb0e-bc60-4bf3-984a-89babd9be663 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:19.912862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-814885a8-0f28-4f49-8535-f38a3b63a84b req-f37aeb0e-bc60-4bf3-984a-89babd9be663 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:19.924689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-814885a8-0f28-4f49-8535-f38a3b63a84b req-f37aeb0e-bc60-4bf3-984a-89babd9be663 service nova] Creating event network-changed:76e06d6f-2c0b-45fa-9513-bb7d5fcd96ed for instance e331bb00-5b75-40e7-9658-3c691aee4e24 on hv-cinder-85144 Jul 28 20:24:19.931470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-814885a8-0f28-4f49-8535-f38a3b63a84b req-f37aeb0e-bc60-4bf3-984a-89babd9be663 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100475 Jul 28 20:24:19.932388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1417/2696] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:24:19.938329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-81efe0e3-1200-4a62-90ad-86a59f8c0874 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:19.939098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-81efe0e3-1200-4a62-90ad-86a59f8c0874 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:19.946184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81efe0e3-1200-4a62-90ad-86a59f8c0874 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:19.946627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81efe0e3-1200-4a62-90ad-86a59f8c0874 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:19.947380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81efe0e3-1200-4a62-90ad-86a59f8c0874 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:19.947809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81efe0e3-1200-4a62-90ad-86a59f8c0874 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:19.972483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-20e47a8f-f8f6-45d4-a6ed-38bcc57770b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:19.987469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-20e47a8f-f8f6-45d4-a6ed-38bcc57770b5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.203950 Jul 28 20:24:19.988374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1280/2697] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:19 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:20.014977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-81efe0e3-1200-4a62-90ad-86a59f8c0874 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:20.024056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-81efe0e3-1200-4a62-90ad-86a59f8c0874 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.090070 Jul 28 20:24:20.024651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1418/2698] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:21.012100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-80205e99-8772-4543-b578-0820431b3a0f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:21.012752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-80205e99-8772-4543-b578-0820431b3a0f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:21.020159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80205e99-8772-4543-b578-0820431b3a0f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:21.020660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80205e99-8772-4543-b578-0820431b3a0f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:21.021426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80205e99-8772-4543-b578-0820431b3a0f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:21.022764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80205e99-8772-4543-b578-0820431b3a0f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:21.047062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a0ad9d36-86da-4b21-b73f-ec6ad8131334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:21.047702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a0ad9d36-86da-4b21-b73f-ec6ad8131334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:21.054871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0ad9d36-86da-4b21-b73f-ec6ad8131334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:21.055311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0ad9d36-86da-4b21-b73f-ec6ad8131334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:21.056060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0ad9d36-86da-4b21-b73f-ec6ad8131334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:21.056490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0ad9d36-86da-4b21-b73f-ec6ad8131334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:21.136612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a0ad9d36-86da-4b21-b73f-ec6ad8131334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:21.144571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a0ad9d36-86da-4b21-b73f-ec6ad8131334 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.102212 Jul 28 20:24:21.145123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1419/2699] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:21.183718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-80205e99-8772-4543-b578-0820431b3a0f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:21.191512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-80205e99-8772-4543-b578-0820431b3a0f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.183392 Jul 28 20:24:21.192063 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1281/2700] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:21 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:22.165396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-553d6160-6e6b-4f25-860f-715f0a19aabf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:22.166107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-553d6160-6e6b-4f25-860f-715f0a19aabf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:22.173010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-553d6160-6e6b-4f25-860f-715f0a19aabf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:22.173453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-553d6160-6e6b-4f25-860f-715f0a19aabf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:22.174464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-553d6160-6e6b-4f25-860f-715f0a19aabf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:22.174896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-553d6160-6e6b-4f25-860f-715f0a19aabf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:22.216753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fe78ac67-fd2c-4e8d-a422-0f58aacd9eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:22.217842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fe78ac67-fd2c-4e8d-a422-0f58aacd9eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:22.225778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe78ac67-fd2c-4e8d-a422-0f58aacd9eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:22.226225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe78ac67-fd2c-4e8d-a422-0f58aacd9eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:22.226989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe78ac67-fd2c-4e8d-a422-0f58aacd9eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:22.227419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fe78ac67-fd2c-4e8d-a422-0f58aacd9eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:22.241947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-553d6160-6e6b-4f25-860f-715f0a19aabf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:22.249691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-553d6160-6e6b-4f25-860f-715f0a19aabf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.088230 Jul 28 20:24:22.250244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1420/2701] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:22 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:22.353443 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fe78ac67-fd2c-4e8d-a422-0f58aacd9eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:22.361959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fe78ac67-fd2c-4e8d-a422-0f58aacd9eed tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152018 Jul 28 20:24:22.362213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1282/2702] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:22 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:23.272047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f2b0c9d-08f3-4423-97be-139f3ef1dcef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:23.273093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f2b0c9d-08f3-4423-97be-139f3ef1dcef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:23.279596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f2b0c9d-08f3-4423-97be-139f3ef1dcef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:23.280037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f2b0c9d-08f3-4423-97be-139f3ef1dcef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:23.280804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f2b0c9d-08f3-4423-97be-139f3ef1dcef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:23.281229 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f2b0c9d-08f3-4423-97be-139f3ef1dcef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:23.344673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2f2b0c9d-08f3-4423-97be-139f3ef1dcef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:23.352571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f2b0c9d-08f3-4423-97be-139f3ef1dcef tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085029 Jul 28 20:24:23.353112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1421/2703] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:23.383970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b5bda7a5-3f39-4afd-b779-b0134cd10136 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:23.384607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b5bda7a5-3f39-4afd-b779-b0134cd10136 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:23.388282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:23.392033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5bda7a5-3f39-4afd-b779-b0134cd10136 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:23.392479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5bda7a5-3f39-4afd-b779-b0134cd10136 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:23.393263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5bda7a5-3f39-4afd-b779-b0134cd10136 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:23.393699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5bda7a5-3f39-4afd-b779-b0134cd10136 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:23.398217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:23.524187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b5bda7a5-3f39-4afd-b779-b0134cd10136 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:23.532238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b5bda7a5-3f39-4afd-b779-b0134cd10136 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152744 Jul 28 20:24:23.532840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1283/2704] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:23 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:24.374015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fe282988-9bda-447a-a0af-e3f54d01d30b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:24.374630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fe282988-9bda-447a-a0af-e3f54d01d30b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:24.381112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe282988-9bda-447a-a0af-e3f54d01d30b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:24.381570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe282988-9bda-447a-a0af-e3f54d01d30b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:24.382909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe282988-9bda-447a-a0af-e3f54d01d30b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:24.383370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe282988-9bda-447a-a0af-e3f54d01d30b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:24.444266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fe282988-9bda-447a-a0af-e3f54d01d30b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:24.452304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fe282988-9bda-447a-a0af-e3f54d01d30b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082133 Jul 28 20:24:24.452903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1422/2705] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:24.554009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-01558101-3357-40f0-b2a1-5dd43cdf537e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:24.555317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-01558101-3357-40f0-b2a1-5dd43cdf537e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:24.561833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01558101-3357-40f0-b2a1-5dd43cdf537e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:24.562279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01558101-3357-40f0-b2a1-5dd43cdf537e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:24.563028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01558101-3357-40f0-b2a1-5dd43cdf537e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:24.563461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01558101-3357-40f0-b2a1-5dd43cdf537e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:24.696742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-01558101-3357-40f0-b2a1-5dd43cdf537e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:24.704569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-01558101-3357-40f0-b2a1-5dd43cdf537e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154501 Jul 28 20:24:24.705132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1284/2706] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:24 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:25.473279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-75d7e8da-4288-47bc-b931-2b671b514c42 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:25.473888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-75d7e8da-4288-47bc-b931-2b671b514c42 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:25.476906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:25.482418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75d7e8da-4288-47bc-b931-2b671b514c42 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:25.482858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75d7e8da-4288-47bc-b931-2b671b514c42 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:25.483600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75d7e8da-4288-47bc-b931-2b671b514c42 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:25.484028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75d7e8da-4288-47bc-b931-2b671b514c42 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:25.548700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-75d7e8da-4288-47bc-b931-2b671b514c42 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:25.556756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-75d7e8da-4288-47bc-b931-2b671b514c42 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087246 Jul 28 20:24:25.557303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1423/2707] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:25.726849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1d116ad7-5b1b-49e9-8886-4aa738f6064d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:25.727386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1d116ad7-5b1b-49e9-8886-4aa738f6064d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:25.733838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d116ad7-5b1b-49e9-8886-4aa738f6064d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:25.734287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d116ad7-5b1b-49e9-8886-4aa738f6064d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:25.735037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d116ad7-5b1b-49e9-8886-4aa738f6064d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:25.735472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d116ad7-5b1b-49e9-8886-4aa738f6064d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:25.871411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1d116ad7-5b1b-49e9-8886-4aa738f6064d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:25.879511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1d116ad7-5b1b-49e9-8886-4aa738f6064d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.157229 Jul 28 20:24:25.880075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1285/2708] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:25 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:26.577165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b75ece32-6e0a-47d3-9556-36eea4185193 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:26.577779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b75ece32-6e0a-47d3-9556-36eea4185193 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:26.584404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b75ece32-6e0a-47d3-9556-36eea4185193 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:26.584888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b75ece32-6e0a-47d3-9556-36eea4185193 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:26.585741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b75ece32-6e0a-47d3-9556-36eea4185193 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:26.586166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b75ece32-6e0a-47d3-9556-36eea4185193 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:26.648685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b75ece32-6e0a-47d3-9556-36eea4185193 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:26.656892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b75ece32-6e0a-47d3-9556-36eea4185193 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083580 Jul 28 20:24:26.657438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1424/2709] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:26.899926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d421f0b7-6ff8-4387-8f37-8f6cf795985c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:26.900480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d421f0b7-6ff8-4387-8f37-8f6cf795985c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:26.907371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d421f0b7-6ff8-4387-8f37-8f6cf795985c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:26.907821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d421f0b7-6ff8-4387-8f37-8f6cf795985c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:26.908606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d421f0b7-6ff8-4387-8f37-8f6cf795985c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:26.909047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d421f0b7-6ff8-4387-8f37-8f6cf795985c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:27.041156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d421f0b7-6ff8-4387-8f37-8f6cf795985c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:27.049196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d421f0b7-6ff8-4387-8f37-8f6cf795985c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153190 Jul 28 20:24:27.049764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1286/2710] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:26 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:27.677828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5c8e39ac-9456-49cd-9a3a-9e67fab3fd88 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:27.678433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5c8e39ac-9456-49cd-9a3a-9e67fab3fd88 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:27.685112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c8e39ac-9456-49cd-9a3a-9e67fab3fd88 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:27.685550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c8e39ac-9456-49cd-9a3a-9e67fab3fd88 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:27.686288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c8e39ac-9456-49cd-9a3a-9e67fab3fd88 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:27.686709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5c8e39ac-9456-49cd-9a3a-9e67fab3fd88 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:27.746823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5c8e39ac-9456-49cd-9a3a-9e67fab3fd88 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:27.754581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5c8e39ac-9456-49cd-9a3a-9e67fab3fd88 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080605 Jul 28 20:24:27.755150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1425/2711] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:27 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:28.070886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dd2dd4c5-380b-4659-81ea-8f818619a4a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:28.071500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dd2dd4c5-380b-4659-81ea-8f818619a4a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:28.078039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2dd4c5-380b-4659-81ea-8f818619a4a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:28.078486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2dd4c5-380b-4659-81ea-8f818619a4a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:28.079233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2dd4c5-380b-4659-81ea-8f818619a4a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:28.079664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2dd4c5-380b-4659-81ea-8f818619a4a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:28.212504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd2dd4c5-380b-4659-81ea-8f818619a4a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:28.220351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dd2dd4c5-380b-4659-81ea-8f818619a4a6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153948 Jul 28 20:24:28.220954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1287/2712] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:28 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:28.777835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6cdd6b2d-5102-448e-94db-f1e10dec69a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:28.778753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6cdd6b2d-5102-448e-94db-f1e10dec69a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:28.785202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cdd6b2d-5102-448e-94db-f1e10dec69a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:28.785643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cdd6b2d-5102-448e-94db-f1e10dec69a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:28.786385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cdd6b2d-5102-448e-94db-f1e10dec69a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:28.786811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cdd6b2d-5102-448e-94db-f1e10dec69a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:28.847068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6cdd6b2d-5102-448e-94db-f1e10dec69a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:28.855202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6cdd6b2d-5102-448e-94db-f1e10dec69a7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083477 Jul 28 20:24:28.855763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1426/2713] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:29.241742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-04e56859-8a25-4743-b451-eccd2a662531 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:29.242366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-04e56859-8a25-4743-b451-eccd2a662531 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:29.248768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-04e56859-8a25-4743-b451-eccd2a662531 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:29.249222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-04e56859-8a25-4743-b451-eccd2a662531 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:29.249971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-04e56859-8a25-4743-b451-eccd2a662531 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:29.250401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-04e56859-8a25-4743-b451-eccd2a662531 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:29.379709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-04e56859-8a25-4743-b451-eccd2a662531 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:29.388304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-04e56859-8a25-4743-b451-eccd2a662531 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150811 Jul 28 20:24:29.388898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1288/2714] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:29 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:29.877197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cea2e86d-b609-4eec-ad91-ab29071fe36b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:29.890105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cea2e86d-b609-4eec-ad91-ab29071fe36b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:29.890105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cea2e86d-b609-4eec-ad91-ab29071fe36b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:29.890105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cea2e86d-b609-4eec-ad91-ab29071fe36b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:29.890105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cea2e86d-b609-4eec-ad91-ab29071fe36b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:29.890500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cea2e86d-b609-4eec-ad91-ab29071fe36b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:29.894789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:29.955626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cea2e86d-b609-4eec-ad91-ab29071fe36b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:29.964831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cea2e86d-b609-4eec-ad91-ab29071fe36b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.091535 Jul 28 20:24:29.965396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1427/2715] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:30.409618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0f9b8b44-f8c9-4870-8756-9945c917e3e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:30.410224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0f9b8b44-f8c9-4870-8756-9945c917e3e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:30.417104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f9b8b44-f8c9-4870-8756-9945c917e3e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:30.417490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f9b8b44-f8c9-4870-8756-9945c917e3e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:30.418228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f9b8b44-f8c9-4870-8756-9945c917e3e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:30.418679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f9b8b44-f8c9-4870-8756-9945c917e3e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:30.546076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0f9b8b44-f8c9-4870-8756-9945c917e3e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:30.555048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0f9b8b44-f8c9-4870-8756-9945c917e3e2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148221 Jul 28 20:24:30.555621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1289/2716] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:30 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:30.986209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c9ad98c7-e0b2-423f-b812-9f0b30d4c9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:30.986807 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c9ad98c7-e0b2-423f-b812-9f0b30d4c9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:30.994004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9ad98c7-e0b2-423f-b812-9f0b30d4c9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:30.994440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9ad98c7-e0b2-423f-b812-9f0b30d4c9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:30.995186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9ad98c7-e0b2-423f-b812-9f0b30d4c9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:30.995612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c9ad98c7-e0b2-423f-b812-9f0b30d4c9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:31.056432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c9ad98c7-e0b2-423f-b812-9f0b30d4c9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:31.064375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c9ad98c7-e0b2-423f-b812-9f0b30d4c9a6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082038 Jul 28 20:24:31.064972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1428/2717] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:31.576252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e26ce757-7698-4f34-9a9d-8ffe3d6e5063 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:31.576880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e26ce757-7698-4f34-9a9d-8ffe3d6e5063 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:31.582960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e26ce757-7698-4f34-9a9d-8ffe3d6e5063 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:31.583402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e26ce757-7698-4f34-9a9d-8ffe3d6e5063 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:31.584137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e26ce757-7698-4f34-9a9d-8ffe3d6e5063 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:31.584596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e26ce757-7698-4f34-9a9d-8ffe3d6e5063 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:31.713418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e26ce757-7698-4f34-9a9d-8ffe3d6e5063 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:31.721178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e26ce757-7698-4f34-9a9d-8ffe3d6e5063 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148958 Jul 28 20:24:31.721731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1290/2718] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:31 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:32.086080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-944fe7cb-e38e-4848-a103-876517482a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:32.086685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-944fe7cb-e38e-4848-a103-876517482a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:32.093701 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-944fe7cb-e38e-4848-a103-876517482a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:32.094145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-944fe7cb-e38e-4848-a103-876517482a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:32.094919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-944fe7cb-e38e-4848-a103-876517482a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:32.095347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-944fe7cb-e38e-4848-a103-876517482a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:32.155262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-944fe7cb-e38e-4848-a103-876517482a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:32.163553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-944fe7cb-e38e-4848-a103-876517482a06 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081816 Jul 28 20:24:32.170986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1429/2719] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:32.743380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-63d87780-0ba6-4d55-b538-9b6477e05461 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:32.743925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-63d87780-0ba6-4d55-b538-9b6477e05461 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:32.750541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63d87780-0ba6-4d55-b538-9b6477e05461 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:32.750988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63d87780-0ba6-4d55-b538-9b6477e05461 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:32.751736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63d87780-0ba6-4d55-b538-9b6477e05461 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:32.752167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63d87780-0ba6-4d55-b538-9b6477e05461 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:32.878535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-63d87780-0ba6-4d55-b538-9b6477e05461 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:32.887145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-63d87780-0ba6-4d55-b538-9b6477e05461 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148418 Jul 28 20:24:32.887702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1291/2720] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:32 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:33.184985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dc930a16-f470-4d11-9a34-252242d8ff6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:33.185596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dc930a16-f470-4d11-9a34-252242d8ff6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:33.191728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc930a16-f470-4d11-9a34-252242d8ff6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:33.192178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc930a16-f470-4d11-9a34-252242d8ff6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:33.192951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc930a16-f470-4d11-9a34-252242d8ff6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:33.193382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc930a16-f470-4d11-9a34-252242d8ff6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:33.256816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dc930a16-f470-4d11-9a34-252242d8ff6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:33.265105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dc930a16-f470-4d11-9a34-252242d8ff6a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084001 Jul 28 20:24:33.265661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1430/2721] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:33.908105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9481925c-2e4f-4c85-97b8-568597a6bb2b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:33.908737 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9481925c-2e4f-4c85-97b8-568597a6bb2b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:33.915614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9481925c-2e4f-4c85-97b8-568597a6bb2b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:33.916059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9481925c-2e4f-4c85-97b8-568597a6bb2b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:33.916833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9481925c-2e4f-4c85-97b8-568597a6bb2b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:33.917268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9481925c-2e4f-4c85-97b8-568597a6bb2b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:34.046462 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9481925c-2e4f-4c85-97b8-568597a6bb2b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:34.055368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9481925c-2e4f-4c85-97b8-568597a6bb2b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151165 Jul 28 20:24:34.055931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1292/2722] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:33 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:34.287002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8f7ec586-b0bb-460a-8284-1e27beeecbf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:34.287616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8f7ec586-b0bb-460a-8284-1e27beeecbf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:34.295011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f7ec586-b0bb-460a-8284-1e27beeecbf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:34.295455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f7ec586-b0bb-460a-8284-1e27beeecbf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:34.296203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f7ec586-b0bb-460a-8284-1e27beeecbf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:34.296667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f7ec586-b0bb-460a-8284-1e27beeecbf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:34.357669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8f7ec586-b0bb-460a-8284-1e27beeecbf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:34.365624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8f7ec586-b0bb-460a-8284-1e27beeecbf4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082488 Jul 28 20:24:34.367147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1431/2723] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:35.077067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d7a7ab38-db65-4ff6-8e73-cb68e74869bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:35.077670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d7a7ab38-db65-4ff6-8e73-cb68e74869bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:35.084131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7a7ab38-db65-4ff6-8e73-cb68e74869bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:35.084607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7a7ab38-db65-4ff6-8e73-cb68e74869bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:35.086008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7a7ab38-db65-4ff6-8e73-cb68e74869bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:35.086435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d7a7ab38-db65-4ff6-8e73-cb68e74869bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:35.217115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d7a7ab38-db65-4ff6-8e73-cb68e74869bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:35.225017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d7a7ab38-db65-4ff6-8e73-cb68e74869bf tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151819 Jul 28 20:24:35.225587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1293/2724] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:35 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:35.391216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7919686c-b4a5-4e7c-850e-2abbf96d584e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:35.391760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7919686c-b4a5-4e7c-850e-2abbf96d584e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:35.398360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7919686c-b4a5-4e7c-850e-2abbf96d584e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:35.398809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7919686c-b4a5-4e7c-850e-2abbf96d584e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:35.399567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7919686c-b4a5-4e7c-850e-2abbf96d584e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:35.400004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7919686c-b4a5-4e7c-850e-2abbf96d584e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:35.463579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7919686c-b4a5-4e7c-850e-2abbf96d584e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:35.471433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7919686c-b4a5-4e7c-850e-2abbf96d584e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084163 Jul 28 20:24:35.471981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1432/2725] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:36.245753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a1380f52-ded0-47ab-8134-537523a5d23e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:36.246364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a1380f52-ded0-47ab-8134-537523a5d23e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:36.252827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1380f52-ded0-47ab-8134-537523a5d23e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:36.253277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1380f52-ded0-47ab-8134-537523a5d23e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:36.254024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1380f52-ded0-47ab-8134-537523a5d23e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:36.254457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a1380f52-ded0-47ab-8134-537523a5d23e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:36.382038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a1380f52-ded0-47ab-8134-537523a5d23e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:36.390994 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a1380f52-ded0-47ab-8134-537523a5d23e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149088 Jul 28 20:24:36.391583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1294/2726] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:36 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:36.492401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6dc73f51-af4d-48a0-bd2b-da381c53e69d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:36.493020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6dc73f51-af4d-48a0-bd2b-da381c53e69d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:36.499314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6dc73f51-af4d-48a0-bd2b-da381c53e69d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:36.499770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6dc73f51-af4d-48a0-bd2b-da381c53e69d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:36.500502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6dc73f51-af4d-48a0-bd2b-da381c53e69d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:36.500951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6dc73f51-af4d-48a0-bd2b-da381c53e69d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:36.564353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6dc73f51-af4d-48a0-bd2b-da381c53e69d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:36.573007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6dc73f51-af4d-48a0-bd2b-da381c53e69d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084543 Jul 28 20:24:36.573568 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1433/2727] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:36 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:37.413638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-778d15b9-2c66-477d-a2d4-ab83a5647893 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:37.414244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-778d15b9-2c66-477d-a2d4-ab83a5647893 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:37.420877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-778d15b9-2c66-477d-a2d4-ab83a5647893 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:37.421264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-778d15b9-2c66-477d-a2d4-ab83a5647893 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:37.422010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-778d15b9-2c66-477d-a2d4-ab83a5647893 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:37.422436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-778d15b9-2c66-477d-a2d4-ab83a5647893 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:37.549296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-778d15b9-2c66-477d-a2d4-ab83a5647893 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:37.557220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-778d15b9-2c66-477d-a2d4-ab83a5647893 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147934 Jul 28 20:24:37.557771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1295/2728] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:37 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:37.594078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-92a0f822-d7e8-4bd1-86dc-e12618f9fbfb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:37.594681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-92a0f822-d7e8-4bd1-86dc-e12618f9fbfb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:37.601675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92a0f822-d7e8-4bd1-86dc-e12618f9fbfb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:37.602113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92a0f822-d7e8-4bd1-86dc-e12618f9fbfb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:37.602850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92a0f822-d7e8-4bd1-86dc-e12618f9fbfb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:37.603278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-92a0f822-d7e8-4bd1-86dc-e12618f9fbfb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:37.662419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-92a0f822-d7e8-4bd1-86dc-e12618f9fbfb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:37.671539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-92a0f822-d7e8-4bd1-86dc-e12618f9fbfb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081151 Jul 28 20:24:37.672054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1434/2729] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:38.577996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-91060a3a-e1b1-4a6d-99e6-22435f707476 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:38.578608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-91060a3a-e1b1-4a6d-99e6-22435f707476 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:38.585174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91060a3a-e1b1-4a6d-99e6-22435f707476 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:38.585635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91060a3a-e1b1-4a6d-99e6-22435f707476 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:38.586364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91060a3a-e1b1-4a6d-99e6-22435f707476 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:38.586790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91060a3a-e1b1-4a6d-99e6-22435f707476 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:38.692689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c8181354-bcdc-4baa-9b76-da73917f8817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:38.693297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c8181354-bcdc-4baa-9b76-da73917f8817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:38.699848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8181354-bcdc-4baa-9b76-da73917f8817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:38.700265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8181354-bcdc-4baa-9b76-da73917f8817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:38.701039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8181354-bcdc-4baa-9b76-da73917f8817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:38.701463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8181354-bcdc-4baa-9b76-da73917f8817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:38.715622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-91060a3a-e1b1-4a6d-99e6-22435f707476 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:38.723597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-91060a3a-e1b1-4a6d-99e6-22435f707476 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149468 Jul 28 20:24:38.724166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1296/2730] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:38 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:38.761770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c8181354-bcdc-4baa-9b76-da73917f8817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:38.769632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c8181354-bcdc-4baa-9b76-da73917f8817 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080879 Jul 28 20:24:38.770187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1435/2731] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:39.745271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-34bc56cc-f348-47e3-878e-06fcc05d4523 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:39.745869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-34bc56cc-f348-47e3-878e-06fcc05d4523 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:39.752411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34bc56cc-f348-47e3-878e-06fcc05d4523 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:39.752895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34bc56cc-f348-47e3-878e-06fcc05d4523 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:39.753661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34bc56cc-f348-47e3-878e-06fcc05d4523 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:39.754096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34bc56cc-f348-47e3-878e-06fcc05d4523 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:39.790686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-42f1997a-e46f-4f01-8b0d-aa62ec2b308d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:39.791396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-42f1997a-e46f-4f01-8b0d-aa62ec2b308d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:39.798117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42f1997a-e46f-4f01-8b0d-aa62ec2b308d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:39.798647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42f1997a-e46f-4f01-8b0d-aa62ec2b308d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:39.799486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42f1997a-e46f-4f01-8b0d-aa62ec2b308d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:39.800019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-42f1997a-e46f-4f01-8b0d-aa62ec2b308d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:39.876865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-42f1997a-e46f-4f01-8b0d-aa62ec2b308d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:39.885633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-42f1997a-e46f-4f01-8b0d-aa62ec2b308d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.098905 Jul 28 20:24:39.886201 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1436/2732] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:39.906751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-34bc56cc-f348-47e3-878e-06fcc05d4523 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:39.914878 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-34bc56cc-f348-47e3-878e-06fcc05d4523 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.173504 Jul 28 20:24:39.915445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1297/2733] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:39 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:40.907041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-082d5efe-db7c-4865-a3de-f4c246ed2001 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:40.907632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-082d5efe-db7c-4865-a3de-f4c246ed2001 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:40.914635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-082d5efe-db7c-4865-a3de-f4c246ed2001 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:40.915075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-082d5efe-db7c-4865-a3de-f4c246ed2001 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:40.915818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-082d5efe-db7c-4865-a3de-f4c246ed2001 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:40.916242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-082d5efe-db7c-4865-a3de-f4c246ed2001 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:40.935998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0dc199cf-da2d-4877-b7ee-84bb2a459f06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:40.936638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0dc199cf-da2d-4877-b7ee-84bb2a459f06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:40.943067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dc199cf-da2d-4877-b7ee-84bb2a459f06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:40.943547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dc199cf-da2d-4877-b7ee-84bb2a459f06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:40.944954 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dc199cf-da2d-4877-b7ee-84bb2a459f06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:40.945388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0dc199cf-da2d-4877-b7ee-84bb2a459f06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:40.979355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-082d5efe-db7c-4865-a3de-f4c246ed2001 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:40.987380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-082d5efe-db7c-4865-a3de-f4c246ed2001 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084558 Jul 28 20:24:40.987951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1437/2734] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:41.073369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0dc199cf-da2d-4877-b7ee-84bb2a459f06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:41.081508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0dc199cf-da2d-4877-b7ee-84bb2a459f06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149571 Jul 28 20:24:41.082060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1298/2735] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:40 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:42.008928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4023dbab-2a32-4540-9531-f787df6e3226 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:42.009569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4023dbab-2a32-4540-9531-f787df6e3226 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:42.016006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4023dbab-2a32-4540-9531-f787df6e3226 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:42.016453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4023dbab-2a32-4540-9531-f787df6e3226 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:42.017243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4023dbab-2a32-4540-9531-f787df6e3226 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:42.017679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4023dbab-2a32-4540-9531-f787df6e3226 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:42.081038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4023dbab-2a32-4540-9531-f787df6e3226 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:42.089070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4023dbab-2a32-4540-9531-f787df6e3226 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084570 Jul 28 20:24:42.089628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1438/2736] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:42.103246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c288e232-1368-4d54-9b40-4435591f7485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:42.103889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c288e232-1368-4d54-9b40-4435591f7485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:42.110470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c288e232-1368-4d54-9b40-4435591f7485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:42.110914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c288e232-1368-4d54-9b40-4435591f7485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:42.111662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c288e232-1368-4d54-9b40-4435591f7485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:42.112099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c288e232-1368-4d54-9b40-4435591f7485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:42.244678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c288e232-1368-4d54-9b40-4435591f7485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:42.248055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:42.253311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c288e232-1368-4d54-9b40-4435591f7485 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154294 Jul 28 20:24:42.253869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1299/2737] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:42 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:43.109881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f68dbbb6-bf4a-488d-baf4-b4806c4f6e57 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:43.110484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f68dbbb6-bf4a-488d-baf4-b4806c4f6e57 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:43.117032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f68dbbb6-bf4a-488d-baf4-b4806c4f6e57 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:43.117479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f68dbbb6-bf4a-488d-baf4-b4806c4f6e57 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:43.118224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f68dbbb6-bf4a-488d-baf4-b4806c4f6e57 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:43.118655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f68dbbb6-bf4a-488d-baf4-b4806c4f6e57 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:43.179560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f68dbbb6-bf4a-488d-baf4-b4806c4f6e57 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:43.187477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f68dbbb6-bf4a-488d-baf4-b4806c4f6e57 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081465 Jul 28 20:24:43.188036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1439/2738] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:43.274776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cbed7e36-94fb-4dfa-9951-873d7865cd69 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:43.275384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cbed7e36-94fb-4dfa-9951-873d7865cd69 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:43.282195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbed7e36-94fb-4dfa-9951-873d7865cd69 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:43.282634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbed7e36-94fb-4dfa-9951-873d7865cd69 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:43.283380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbed7e36-94fb-4dfa-9951-873d7865cd69 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:43.283879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cbed7e36-94fb-4dfa-9951-873d7865cd69 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:43.411058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cbed7e36-94fb-4dfa-9951-873d7865cd69 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:43.419840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cbed7e36-94fb-4dfa-9951-873d7865cd69 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148933 Jul 28 20:24:43.420399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1300/2739] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:43 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:44.209011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f2585b7d-407f-48e2-beb9-c56cb7ff7933 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:44.210343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f2585b7d-407f-48e2-beb9-c56cb7ff7933 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:44.217006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2585b7d-407f-48e2-beb9-c56cb7ff7933 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:44.217451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2585b7d-407f-48e2-beb9-c56cb7ff7933 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:44.218190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2585b7d-407f-48e2-beb9-c56cb7ff7933 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:44.218617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2585b7d-407f-48e2-beb9-c56cb7ff7933 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:44.281956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f2585b7d-407f-48e2-beb9-c56cb7ff7933 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:44.289854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f2585b7d-407f-48e2-beb9-c56cb7ff7933 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084707 Jul 28 20:24:44.290406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1440/2740] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:44.441045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6fc1b384-400c-4839-9b54-a6e77dcca41d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:44.441590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6fc1b384-400c-4839-9b54-a6e77dcca41d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:44.449522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fc1b384-400c-4839-9b54-a6e77dcca41d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:44.449971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fc1b384-400c-4839-9b54-a6e77dcca41d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:44.450767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fc1b384-400c-4839-9b54-a6e77dcca41d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:44.451201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fc1b384-400c-4839-9b54-a6e77dcca41d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:44.577937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6fc1b384-400c-4839-9b54-a6e77dcca41d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:44.585859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6fc1b384-400c-4839-9b54-a6e77dcca41d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148682 Jul 28 20:24:44.586414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1301/2741] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:44 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:45.310653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3763d450-12f8-41f2-b5d7-cfcc1d09d7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:45.311245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3763d450-12f8-41f2-b5d7-cfcc1d09d7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:45.317967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3763d450-12f8-41f2-b5d7-cfcc1d09d7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:45.318417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3763d450-12f8-41f2-b5d7-cfcc1d09d7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:45.319812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3763d450-12f8-41f2-b5d7-cfcc1d09d7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:45.320279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3763d450-12f8-41f2-b5d7-cfcc1d09d7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:45.380069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3763d450-12f8-41f2-b5d7-cfcc1d09d7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:45.388813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3763d450-12f8-41f2-b5d7-cfcc1d09d7dc tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082094 Jul 28 20:24:45.389381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1441/2742] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:45.607500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-90fa2d25-27f5-48eb-a3da-4fb46c4869b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:45.608114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-90fa2d25-27f5-48eb-a3da-4fb46c4869b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:45.614587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90fa2d25-27f5-48eb-a3da-4fb46c4869b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:45.615035 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90fa2d25-27f5-48eb-a3da-4fb46c4869b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:45.615785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90fa2d25-27f5-48eb-a3da-4fb46c4869b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:45.616217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-90fa2d25-27f5-48eb-a3da-4fb46c4869b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:45.960801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-90fa2d25-27f5-48eb-a3da-4fb46c4869b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:45.969282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-90fa2d25-27f5-48eb-a3da-4fb46c4869b7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.365590 Jul 28 20:24:45.969839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1302/2743] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:45 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:46.410242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-76d211a4-ef1a-4162-a636-46aae966d829 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:46.410846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-76d211a4-ef1a-4162-a636-46aae966d829 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:46.418254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76d211a4-ef1a-4162-a636-46aae966d829 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:46.418691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76d211a4-ef1a-4162-a636-46aae966d829 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:46.419432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76d211a4-ef1a-4162-a636-46aae966d829 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:46.419858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76d211a4-ef1a-4162-a636-46aae966d829 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:46.483096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-76d211a4-ef1a-4162-a636-46aae966d829 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:46.491115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-76d211a4-ef1a-4162-a636-46aae966d829 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084679 Jul 28 20:24:46.491809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1442/2744] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:46.991064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-05723886-c645-4c73-8b65-767d28207cf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:46.991772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-05723886-c645-4c73-8b65-767d28207cf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:46.998674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05723886-c645-4c73-8b65-767d28207cf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:46.999121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05723886-c645-4c73-8b65-767d28207cf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:46.999872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05723886-c645-4c73-8b65-767d28207cf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:47.000305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-05723886-c645-4c73-8b65-767d28207cf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:47.132833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-05723886-c645-4c73-8b65-767d28207cf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:47.140900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-05723886-c645-4c73-8b65-767d28207cf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153572 Jul 28 20:24:47.141678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1303/2745] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:46 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:47.512015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-28a5975f-9374-4898-a562-654e8d9c3a97 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:47.512670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-28a5975f-9374-4898-a562-654e8d9c3a97 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:47.519158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28a5975f-9374-4898-a562-654e8d9c3a97 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:47.519629 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28a5975f-9374-4898-a562-654e8d9c3a97 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:47.520389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28a5975f-9374-4898-a562-654e8d9c3a97 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:47.520851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-28a5975f-9374-4898-a562-654e8d9c3a97 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:47.584864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-28a5975f-9374-4898-a562-654e8d9c3a97 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:47.588757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:47.594102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-28a5975f-9374-4898-a562-654e8d9c3a97 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086759 Jul 28 20:24:47.594660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1443/2746] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:47 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:48.162892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c5e76838-3569-4abc-8763-cd24b1be2081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:48.163662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c5e76838-3569-4abc-8763-cd24b1be2081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:48.170449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5e76838-3569-4abc-8763-cd24b1be2081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:48.170897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5e76838-3569-4abc-8763-cd24b1be2081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:48.171661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5e76838-3569-4abc-8763-cd24b1be2081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:48.172087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c5e76838-3569-4abc-8763-cd24b1be2081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:48.301190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c5e76838-3569-4abc-8763-cd24b1be2081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:48.309553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c5e76838-3569-4abc-8763-cd24b1be2081 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150537 Jul 28 20:24:48.310113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1304/2747] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:48 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:48.615849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-52ebb50c-06a6-4781-8fa5-22bdcb21d5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:48.616912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-52ebb50c-06a6-4781-8fa5-22bdcb21d5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:48.623599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-52ebb50c-06a6-4781-8fa5-22bdcb21d5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:48.624047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-52ebb50c-06a6-4781-8fa5-22bdcb21d5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:48.624824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-52ebb50c-06a6-4781-8fa5-22bdcb21d5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:48.625251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-52ebb50c-06a6-4781-8fa5-22bdcb21d5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:48.685778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-52ebb50c-06a6-4781-8fa5-22bdcb21d5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:48.693567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-52ebb50c-06a6-4781-8fa5-22bdcb21d5f7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081649 Jul 28 20:24:48.694146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1444/2748] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:49.331265 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8858fe5a-0f57-4583-889f-11d17e4badd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:49.331900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8858fe5a-0f57-4583-889f-11d17e4badd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:49.338572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8858fe5a-0f57-4583-889f-11d17e4badd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:49.339017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8858fe5a-0f57-4583-889f-11d17e4badd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:49.339757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8858fe5a-0f57-4583-889f-11d17e4badd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:49.340187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8858fe5a-0f57-4583-889f-11d17e4badd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:49.473571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8858fe5a-0f57-4583-889f-11d17e4badd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:49.482853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8858fe5a-0f57-4583-889f-11d17e4badd3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.155412 Jul 28 20:24:49.483422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1305/2749] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:49 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:49.715993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c8487bda-3e18-449e-932a-81a4f13e7810 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:49.716558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c8487bda-3e18-449e-932a-81a4f13e7810 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:49.722975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8487bda-3e18-449e-932a-81a4f13e7810 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:49.723419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8487bda-3e18-449e-932a-81a4f13e7810 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:49.724170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8487bda-3e18-449e-932a-81a4f13e7810 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:49.724637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c8487bda-3e18-449e-932a-81a4f13e7810 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:49.790748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c8487bda-3e18-449e-932a-81a4f13e7810 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:49.798694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c8487bda-3e18-449e-932a-81a4f13e7810 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086793 Jul 28 20:24:49.799256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1445/2750] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:50.504463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9f0e1acd-a46a-4d6e-93d4-af55bf783609 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:50.505070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9f0e1acd-a46a-4d6e-93d4-af55bf783609 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:50.512280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f0e1acd-a46a-4d6e-93d4-af55bf783609 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:50.512759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f0e1acd-a46a-4d6e-93d4-af55bf783609 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:50.513507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f0e1acd-a46a-4d6e-93d4-af55bf783609 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:50.513930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9f0e1acd-a46a-4d6e-93d4-af55bf783609 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:50.640729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9f0e1acd-a46a-4d6e-93d4-af55bf783609 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:50.648835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9f0e1acd-a46a-4d6e-93d4-af55bf783609 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148287 Jul 28 20:24:50.649398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1306/2751] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:50 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:50.825572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dbe1f9b6-48f8-4aa0-ae51-8d16d94d21e9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:50.826173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dbe1f9b6-48f8-4aa0-ae51-8d16d94d21e9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:50.832606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dbe1f9b6-48f8-4aa0-ae51-8d16d94d21e9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:50.833052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dbe1f9b6-48f8-4aa0-ae51-8d16d94d21e9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:50.833790 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dbe1f9b6-48f8-4aa0-ae51-8d16d94d21e9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:50.834217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dbe1f9b6-48f8-4aa0-ae51-8d16d94d21e9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:50.896158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dbe1f9b6-48f8-4aa0-ae51-8d16d94d21e9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:50.904823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dbe1f9b6-48f8-4aa0-ae51-8d16d94d21e9 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083013 Jul 28 20:24:50.905379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1446/2752] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:51.670211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8b1f8fa6-c43f-4c20-a936-6e03b4d3f7c6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:51.670826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8b1f8fa6-c43f-4c20-a936-6e03b4d3f7c6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:51.677305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b1f8fa6-c43f-4c20-a936-6e03b4d3f7c6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:51.677755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b1f8fa6-c43f-4c20-a936-6e03b4d3f7c6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:51.678505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b1f8fa6-c43f-4c20-a936-6e03b4d3f7c6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:51.679505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b1f8fa6-c43f-4c20-a936-6e03b4d3f7c6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:51.815907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8b1f8fa6-c43f-4c20-a936-6e03b4d3f7c6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:51.825177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8b1f8fa6-c43f-4c20-a936-6e03b4d3f7c6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.158857 Jul 28 20:24:51.825750 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1307/2753] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:51 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:51.927163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0159b13b-0c97-4c83-96a4-d8c5ea3d3321 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:51.927771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0159b13b-0c97-4c83-96a4-d8c5ea3d3321 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:51.935992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0159b13b-0c97-4c83-96a4-d8c5ea3d3321 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:51.936433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0159b13b-0c97-4c83-96a4-d8c5ea3d3321 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:51.937235 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0159b13b-0c97-4c83-96a4-d8c5ea3d3321 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:51.937657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0159b13b-0c97-4c83-96a4-d8c5ea3d3321 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:52.003134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0159b13b-0c97-4c83-96a4-d8c5ea3d3321 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:52.011743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0159b13b-0c97-4c83-96a4-d8c5ea3d3321 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.088612 Jul 28 20:24:52.012303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1447/2754] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:52.847002 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-434a58e7-b9a3-437f-a9e5-a6ecd1007aea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:52.847607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-434a58e7-b9a3-437f-a9e5-a6ecd1007aea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:52.854911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-434a58e7-b9a3-437f-a9e5-a6ecd1007aea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:52.855357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-434a58e7-b9a3-437f-a9e5-a6ecd1007aea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:52.856109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-434a58e7-b9a3-437f-a9e5-a6ecd1007aea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:52.856559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-434a58e7-b9a3-437f-a9e5-a6ecd1007aea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:53.000037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-434a58e7-b9a3-437f-a9e5-a6ecd1007aea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:53.009353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-434a58e7-b9a3-437f-a9e5-a6ecd1007aea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.166098 Jul 28 20:24:53.013636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1308/2755] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:52 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:53.034257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-475b706e-e950-4e7a-ad27-ffb7ef0ed842 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:53.034824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-475b706e-e950-4e7a-ad27-ffb7ef0ed842 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:53.042523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-475b706e-e950-4e7a-ad27-ffb7ef0ed842 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:53.042975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-475b706e-e950-4e7a-ad27-ffb7ef0ed842 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:53.044040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-475b706e-e950-4e7a-ad27-ffb7ef0ed842 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:53.044685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-475b706e-e950-4e7a-ad27-ffb7ef0ed842 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:53.111827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-475b706e-e950-4e7a-ad27-ffb7ef0ed842 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:53.126365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-475b706e-e950-4e7a-ad27-ffb7ef0ed842 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.096523 Jul 28 20:24:53.130114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1448/2756] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:53.944700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-4e1be787-2c49-4315-83f4-726de2772dc3 req-f53369f1-8a51-40d2-a8c9-02716ecd8ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1cb56a8-6993-4767-9e30-5786f3b94743", "name": "network-vif-deleted", "tag": "3420a2fe-6251-47ba-bc14-fdf7b2db8f58"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:24:53.952005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=52 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:53.956481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-4e1be787-2c49-4315-83f4-726de2772dc3 req-f53369f1-8a51-40d2-a8c9-02716ecd8ae8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:53.956959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-4e1be787-2c49-4315-83f4-726de2772dc3 req-f53369f1-8a51-40d2-a8c9-02716ecd8ae8 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:53.968195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-4e1be787-2c49-4315-83f4-726de2772dc3 req-f53369f1-8a51-40d2-a8c9-02716ecd8ae8 service nova] Creating event network-vif-deleted:3420a2fe-6251-47ba-bc14-fdf7b2db8f58 for instance c1cb56a8-6993-4767-9e30-5786f3b94743 on hv-cinder-85144 Jul 28 20:24:53.974455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-4e1be787-2c49-4315-83f4-726de2772dc3 req-f53369f1-8a51-40d2-a8c9-02716ecd8ae8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Jul 28 20:24:53.975046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1309/2757] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:24:54.031482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a2a1d544-c0a7-43c4-bd15-975f7759216f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:54.032200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a2a1d544-c0a7-43c4-bd15-975f7759216f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:54.040221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2a1d544-c0a7-43c4-bd15-975f7759216f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:54.040915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2a1d544-c0a7-43c4-bd15-975f7759216f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:54.041441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2a1d544-c0a7-43c4-bd15-975f7759216f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:54.041866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a2a1d544-c0a7-43c4-bd15-975f7759216f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:54.149575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1ac1ce96-00d2-48b6-9085-c01440d2698d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:54.150161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1ac1ce96-00d2-48b6-9085-c01440d2698d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:54.158314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ac1ce96-00d2-48b6-9085-c01440d2698d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:54.158850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ac1ce96-00d2-48b6-9085-c01440d2698d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:54.163359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ac1ce96-00d2-48b6-9085-c01440d2698d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:54.163359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1ac1ce96-00d2-48b6-9085-c01440d2698d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:54.185226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a2a1d544-c0a7-43c4-bd15-975f7759216f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:54.196179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a2a1d544-c0a7-43c4-bd15-975f7759216f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.167447 Jul 28 20:24:54.196976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1449/2758] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:54 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:54.237136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1ac1ce96-00d2-48b6-9085-c01440d2698d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:54.246127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1ac1ce96-00d2-48b6-9085-c01440d2698d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.101771 Jul 28 20:24:54.247214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1310/2759] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:55.217482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0e2d68ff-ea62-4d07-b17c-dcc08acea967 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:55.218087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0e2d68ff-ea62-4d07-b17c-dcc08acea967 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:55.224845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e2d68ff-ea62-4d07-b17c-dcc08acea967 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:55.225287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e2d68ff-ea62-4d07-b17c-dcc08acea967 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:55.226178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e2d68ff-ea62-4d07-b17c-dcc08acea967 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:55.226605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0e2d68ff-ea62-4d07-b17c-dcc08acea967 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:55.268377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4209ae71-726d-4eba-836a-0a54be49e4d6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:55.269050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4209ae71-726d-4eba-836a-0a54be49e4d6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:55.276110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4209ae71-726d-4eba-836a-0a54be49e4d6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:55.276559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4209ae71-726d-4eba-836a-0a54be49e4d6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:55.277317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4209ae71-726d-4eba-836a-0a54be49e4d6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:55.277996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4209ae71-726d-4eba-836a-0a54be49e4d6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:55.350346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4209ae71-726d-4eba-836a-0a54be49e4d6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:55.358677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4209ae71-726d-4eba-836a-0a54be49e4d6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.094012 Jul 28 20:24:55.359430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1311/2760] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:55.379477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0e2d68ff-ea62-4d07-b17c-dcc08acea967 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:55.388111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0e2d68ff-ea62-4d07-b17c-dcc08acea967 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.174429 Jul 28 20:24:55.388692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1450/2761] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:55 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:56.059662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6f5cbd09-7645-4c03-a251-2c66901102d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:56.060072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6f5cbd09-7645-4c03-a251-2c66901102d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:56.065987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd09-7645-4c03-a251-2c66901102d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:56.066432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd09-7645-4c03-a251-2c66901102d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:56.067169 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd09-7645-4c03-a251-2c66901102d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:56.067594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f5cbd09-7645-4c03-a251-2c66901102d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:56.091821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6f5cbd09-7645-4c03-a251-2c66901102d9 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24/ips" status: 200 len: 150 microversion: 2.1 time: 0.036040 Jul 28 20:24:56.092382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1312/2762] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 20:24:56 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:24:56.379560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6b714f6d-9bf8-4573-a713-92d299ba8668 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:56.380178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6b714f6d-9bf8-4573-a713-92d299ba8668 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:56.383331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=56 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:24:56.388643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b714f6d-9bf8-4573-a713-92d299ba8668 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:56.389089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b714f6d-9bf8-4573-a713-92d299ba8668 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:56.389874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b714f6d-9bf8-4573-a713-92d299ba8668 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:56.390303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6b714f6d-9bf8-4573-a713-92d299ba8668 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:56.410235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c883a402-a8c4-4dbf-9390-36ae063c3949 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:56.411451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c883a402-a8c4-4dbf-9390-36ae063c3949 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:56.417978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c883a402-a8c4-4dbf-9390-36ae063c3949 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:56.418503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c883a402-a8c4-4dbf-9390-36ae063c3949 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:56.419340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c883a402-a8c4-4dbf-9390-36ae063c3949 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:56.419850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c883a402-a8c4-4dbf-9390-36ae063c3949 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:56.455765 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6b714f6d-9bf8-4573-a713-92d299ba8668 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:56.464109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6b714f6d-9bf8-4573-a713-92d299ba8668 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.088377 Jul 28 20:24:56.464699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1451/2763] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:56 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:56.550460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c883a402-a8c4-4dbf-9390-36ae063c3949 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:56.558948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c883a402-a8c4-4dbf-9390-36ae063c3949 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152673 Jul 28 20:24:56.559512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1313/2764] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:56 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:24:57.485407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3b591e5b-ac7c-4fa9-9a6b-4259ee01afe6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:57.485942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3b591e5b-ac7c-4fa9-9a6b-4259ee01afe6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:57.492693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b591e5b-ac7c-4fa9-9a6b-4259ee01afe6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:57.493139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b591e5b-ac7c-4fa9-9a6b-4259ee01afe6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:57.493883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b591e5b-ac7c-4fa9-9a6b-4259ee01afe6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:57.494309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b591e5b-ac7c-4fa9-9a6b-4259ee01afe6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:57.558378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3b591e5b-ac7c-4fa9-9a6b-4259ee01afe6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:57.566168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3b591e5b-ac7c-4fa9-9a6b-4259ee01afe6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084654 Jul 28 20:24:57.566715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1452/2765] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:57.580264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-722a38c5-3a87-4496-8c92-3530efbee8fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:57.580927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-722a38c5-3a87-4496-8c92-3530efbee8fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:57.588340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-722a38c5-3a87-4496-8c92-3530efbee8fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:57.588807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-722a38c5-3a87-4496-8c92-3530efbee8fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:57.589554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-722a38c5-3a87-4496-8c92-3530efbee8fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:57.589982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-722a38c5-3a87-4496-8c92-3530efbee8fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:57.716455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-722a38c5-3a87-4496-8c92-3530efbee8fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:57.724348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-722a38c5-3a87-4496-8c92-3530efbee8fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147919 Jul 28 20:24:57.724991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1314/2766] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:57 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:58.588129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-da8c2ef1-a973-4f23-9d2a-1511d7e4366d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:58.588767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-da8c2ef1-a973-4f23-9d2a-1511d7e4366d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:58.595243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da8c2ef1-a973-4f23-9d2a-1511d7e4366d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:58.595689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da8c2ef1-a973-4f23-9d2a-1511d7e4366d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:58.596434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da8c2ef1-a973-4f23-9d2a-1511d7e4366d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:58.596892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da8c2ef1-a973-4f23-9d2a-1511d7e4366d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:58.657121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-da8c2ef1-a973-4f23-9d2a-1511d7e4366d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:58.665715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-da8c2ef1-a973-4f23-9d2a-1511d7e4366d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081935 Jul 28 20:24:58.666273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1453/2767] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:58.745236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a39a9b2e-d301-429b-b51d-5afc6aa2b781 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:58.745844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a39a9b2e-d301-429b-b51d-5afc6aa2b781 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:58.752374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a39a9b2e-d301-429b-b51d-5afc6aa2b781 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:58.752850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a39a9b2e-d301-429b-b51d-5afc6aa2b781 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:58.753603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a39a9b2e-d301-429b-b51d-5afc6aa2b781 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:58.754039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a39a9b2e-d301-429b-b51d-5afc6aa2b781 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:58.887588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a39a9b2e-d301-429b-b51d-5afc6aa2b781 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:58.895504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a39a9b2e-d301-429b-b51d-5afc6aa2b781 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154102 Jul 28 20:24:58.896064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1315/2768] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:58 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:59.686844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc022e1c-ac0b-42ed-9530-f0d6329b0c00 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:59.687482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc022e1c-ac0b-42ed-9530-f0d6329b0c00 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:59.693941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc022e1c-ac0b-42ed-9530-f0d6329b0c00 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:59.694545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc022e1c-ac0b-42ed-9530-f0d6329b0c00 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:59.695296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc022e1c-ac0b-42ed-9530-f0d6329b0c00 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:59.695729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc022e1c-ac0b-42ed-9530-f0d6329b0c00 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:59.756377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cc022e1c-ac0b-42ed-9530-f0d6329b0c00 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:24:59.764315 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc022e1c-ac0b-42ed-9530-f0d6329b0c00 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081367 Jul 28 20:24:59.764911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1454/2769] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:24:59.917581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-45196137-fc85-4f4c-8c0b-8b172446e237 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:24:59.918185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-45196137-fc85-4f4c-8c0b-8b172446e237 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:24:59.924532 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45196137-fc85-4f4c-8c0b-8b172446e237 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:59.925032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45196137-fc85-4f4c-8c0b-8b172446e237 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:24:59.925775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45196137-fc85-4f4c-8c0b-8b172446e237 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:24:59.926198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45196137-fc85-4f4c-8c0b-8b172446e237 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:00.055150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-45196137-fc85-4f4c-8c0b-8b172446e237 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:00.062981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-45196137-fc85-4f4c-8c0b-8b172446e237 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149895 Jul 28 20:25:00.063536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1316/2770] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:24:59 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:00.784949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d8f0fe79-b817-4170-b57c-61a12df74674 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:00.785502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d8f0fe79-b817-4170-b57c-61a12df74674 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:00.791995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d8f0fe79-b817-4170-b57c-61a12df74674 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:00.792430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d8f0fe79-b817-4170-b57c-61a12df74674 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:00.793204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d8f0fe79-b817-4170-b57c-61a12df74674 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:00.793625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d8f0fe79-b817-4170-b57c-61a12df74674 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:00.857087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d8f0fe79-b817-4170-b57c-61a12df74674 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:00.864946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d8f0fe79-b817-4170-b57c-61a12df74674 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083908 Jul 28 20:25:00.865507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1455/2771] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:01.083138 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7e36f3ac-c689-4a45-b3f6-05201546371a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:01.083743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7e36f3ac-c689-4a45-b3f6-05201546371a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:01.090092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e36f3ac-c689-4a45-b3f6-05201546371a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:01.090534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e36f3ac-c689-4a45-b3f6-05201546371a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:01.091269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e36f3ac-c689-4a45-b3f6-05201546371a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:01.091695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e36f3ac-c689-4a45-b3f6-05201546371a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:01.109034 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:01.219588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7e36f3ac-c689-4a45-b3f6-05201546371a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:01.228090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7e36f3ac-c689-4a45-b3f6-05201546371a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148747 Jul 28 20:25:01.228680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1317/2772] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:01 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:01.886985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-10e6cba5-94e5-4e23-8883-92781c60204c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:01.887593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-10e6cba5-94e5-4e23-8883-92781c60204c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:01.894119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10e6cba5-94e5-4e23-8883-92781c60204c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:01.894571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10e6cba5-94e5-4e23-8883-92781c60204c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:01.895326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10e6cba5-94e5-4e23-8883-92781c60204c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:01.895762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-10e6cba5-94e5-4e23-8883-92781c60204c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:01.956695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-10e6cba5-94e5-4e23-8883-92781c60204c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:01.965369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-10e6cba5-94e5-4e23-8883-92781c60204c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082284 Jul 28 20:25:01.965925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1456/2773] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:02.248912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e9abe2d0-b441-47fd-8df9-544aefcee960 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:02.249554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e9abe2d0-b441-47fd-8df9-544aefcee960 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:02.256007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9abe2d0-b441-47fd-8df9-544aefcee960 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:02.257078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9abe2d0-b441-47fd-8df9-544aefcee960 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:02.257980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9abe2d0-b441-47fd-8df9-544aefcee960 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:02.258417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9abe2d0-b441-47fd-8df9-544aefcee960 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:02.389976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e9abe2d0-b441-47fd-8df9-544aefcee960 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:02.397936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e9abe2d0-b441-47fd-8df9-544aefcee960 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152843 Jul 28 20:25:02.398493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1318/2774] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:02 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:02.985972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-958f1060-78ae-4bc1-a666-6eaba8a4dcb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:02.986587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-958f1060-78ae-4bc1-a666-6eaba8a4dcb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:02.993304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-958f1060-78ae-4bc1-a666-6eaba8a4dcb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:02.993747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-958f1060-78ae-4bc1-a666-6eaba8a4dcb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:02.994499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-958f1060-78ae-4bc1-a666-6eaba8a4dcb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:02.994929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-958f1060-78ae-4bc1-a666-6eaba8a4dcb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:03.057423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-958f1060-78ae-4bc1-a666-6eaba8a4dcb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:03.065349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-958f1060-78ae-4bc1-a666-6eaba8a4dcb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083268 Jul 28 20:25:03.065912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1457/2775] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:02 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:03.418314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-35c854c1-6173-4043-b521-67f47c2cb72e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:03.418939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-35c854c1-6173-4043-b521-67f47c2cb72e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:03.425475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35c854c1-6173-4043-b521-67f47c2cb72e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:03.425912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35c854c1-6173-4043-b521-67f47c2cb72e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:03.426656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35c854c1-6173-4043-b521-67f47c2cb72e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:03.427082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35c854c1-6173-4043-b521-67f47c2cb72e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:03.554753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-35c854c1-6173-4043-b521-67f47c2cb72e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:03.562574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-35c854c1-6173-4043-b521-67f47c2cb72e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148060 Jul 28 20:25:03.563126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1319/2776] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:03 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:04.086402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9ff728af-e284-4d26-80ff-fa31e747a166 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:04.087007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9ff728af-e284-4d26-80ff-fa31e747a166 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:04.093542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ff728af-e284-4d26-80ff-fa31e747a166 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:04.093983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ff728af-e284-4d26-80ff-fa31e747a166 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:04.094724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ff728af-e284-4d26-80ff-fa31e747a166 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:04.095148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ff728af-e284-4d26-80ff-fa31e747a166 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:04.159263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9ff728af-e284-4d26-80ff-fa31e747a166 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:04.169342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9ff728af-e284-4d26-80ff-fa31e747a166 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086754 Jul 28 20:25:04.170141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1458/2777] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:04.583525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7a13c386-e852-4e9c-ab29-626c449bca77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:04.584136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7a13c386-e852-4e9c-ab29-626c449bca77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:04.591419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a13c386-e852-4e9c-ab29-626c449bca77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:04.591859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a13c386-e852-4e9c-ab29-626c449bca77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:04.592620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a13c386-e852-4e9c-ab29-626c449bca77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:04.593050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7a13c386-e852-4e9c-ab29-626c449bca77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:04.722685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7a13c386-e852-4e9c-ab29-626c449bca77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:04.731788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7a13c386-e852-4e9c-ab29-626c449bca77 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152100 Jul 28 20:25:04.732352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1320/2778] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:04 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:05.191012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aead3162-de4d-4403-9a6c-831c1b63d067 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:05.191616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aead3162-de4d-4403-9a6c-831c1b63d067 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:05.199166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aead3162-de4d-4403-9a6c-831c1b63d067 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:05.199607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aead3162-de4d-4403-9a6c-831c1b63d067 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:05.200352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aead3162-de4d-4403-9a6c-831c1b63d067 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:05.200805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aead3162-de4d-4403-9a6c-831c1b63d067 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:05.265724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-aead3162-de4d-4403-9a6c-831c1b63d067 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:05.274447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aead3162-de4d-4403-9a6c-831c1b63d067 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.087284 Jul 28 20:25:05.275013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1459/2779] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:05 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:05.752651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c174d543-cafb-4188-bcbc-2da93d2359f2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:05.753258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c174d543-cafb-4188-bcbc-2da93d2359f2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:05.759733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c174d543-cafb-4188-bcbc-2da93d2359f2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:05.760177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c174d543-cafb-4188-bcbc-2da93d2359f2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:05.760968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c174d543-cafb-4188-bcbc-2da93d2359f2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:05.761426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c174d543-cafb-4188-bcbc-2da93d2359f2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:05.898807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c174d543-cafb-4188-bcbc-2da93d2359f2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:05.906952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c174d543-cafb-4188-bcbc-2da93d2359f2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.158152 Jul 28 20:25:05.907510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1321/2780] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:05 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:06.295605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-49c06f41-bf0d-4e40-9854-59900e20904a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:06.296213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-49c06f41-bf0d-4e40-9854-59900e20904a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:06.302628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49c06f41-bf0d-4e40-9854-59900e20904a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:06.303105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49c06f41-bf0d-4e40-9854-59900e20904a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:06.304078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49c06f41-bf0d-4e40-9854-59900e20904a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:06.304519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-49c06f41-bf0d-4e40-9854-59900e20904a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:06.322133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:06.366217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-49c06f41-bf0d-4e40-9854-59900e20904a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:06.374043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-49c06f41-bf0d-4e40-9854-59900e20904a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082274 Jul 28 20:25:06.374604 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1460/2781] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:06.929712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-80b91d99-47a1-41c9-8273-912236025fff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:06.930332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-80b91d99-47a1-41c9-8273-912236025fff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:06.936841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80b91d99-47a1-41c9-8273-912236025fff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:06.937292 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80b91d99-47a1-41c9-8273-912236025fff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:06.938046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80b91d99-47a1-41c9-8273-912236025fff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:06.938480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80b91d99-47a1-41c9-8273-912236025fff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:07.068413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-80b91d99-47a1-41c9-8273-912236025fff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:07.080017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-80b91d99-47a1-41c9-8273-912236025fff tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.155159 Jul 28 20:25:07.080603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1322/2782] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:06 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:07.395109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c97b7e1d-0774-4733-a1ef-26b7987b81cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:07.395750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c97b7e1d-0774-4733-a1ef-26b7987b81cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:07.403183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c97b7e1d-0774-4733-a1ef-26b7987b81cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:07.403627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c97b7e1d-0774-4733-a1ef-26b7987b81cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:07.404374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c97b7e1d-0774-4733-a1ef-26b7987b81cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:07.404835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c97b7e1d-0774-4733-a1ef-26b7987b81cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:07.469214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c97b7e1d-0774-4733-a1ef-26b7987b81cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:07.477252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c97b7e1d-0774-4733-a1ef-26b7987b81cb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085952 Jul 28 20:25:07.477809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1461/2783] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:08.101124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-550d220a-018f-4ee0-a4a9-120764364955 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:08.101727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-550d220a-018f-4ee0-a4a9-120764364955 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:08.108132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-550d220a-018f-4ee0-a4a9-120764364955 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:08.108592 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-550d220a-018f-4ee0-a4a9-120764364955 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:08.109338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-550d220a-018f-4ee0-a4a9-120764364955 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:08.109765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-550d220a-018f-4ee0-a4a9-120764364955 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:08.239274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-550d220a-018f-4ee0-a4a9-120764364955 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:08.247419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-550d220a-018f-4ee0-a4a9-120764364955 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150219 Jul 28 20:25:08.247987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1323/2784] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:08 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:08.322042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:25:08.322249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:25:08.497805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-878072c6-334f-4cac-9901-cb81b8159dd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:08.498429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-878072c6-334f-4cac-9901-cb81b8159dd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:08.504972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-878072c6-334f-4cac-9901-cb81b8159dd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:08.505420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-878072c6-334f-4cac-9901-cb81b8159dd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:08.506277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-878072c6-334f-4cac-9901-cb81b8159dd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:08.507202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-878072c6-334f-4cac-9901-cb81b8159dd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:08.567349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-878072c6-334f-4cac-9901-cb81b8159dd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:08.575639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-878072c6-334f-4cac-9901-cb81b8159dd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081670 Jul 28 20:25:08.576191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1462/2785] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:09.269108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-27ae4742-9033-4609-af00-86a43993c34a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:09.269723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-27ae4742-9033-4609-af00-86a43993c34a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:09.278003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ae4742-9033-4609-af00-86a43993c34a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:09.278449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ae4742-9033-4609-af00-86a43993c34a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:09.279206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ae4742-9033-4609-af00-86a43993c34a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:09.279628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27ae4742-9033-4609-af00-86a43993c34a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:09.421271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-27ae4742-9033-4609-af00-86a43993c34a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:09.429820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-27ae4742-9033-4609-af00-86a43993c34a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.164838 Jul 28 20:25:09.430397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1324/2786] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:09 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:09.596814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-74480199-e0a6-414b-b1d4-5b2803b904de tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:09.597409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-74480199-e0a6-414b-b1d4-5b2803b904de tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:09.604706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74480199-e0a6-414b-b1d4-5b2803b904de tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:09.605153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74480199-e0a6-414b-b1d4-5b2803b904de tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:09.605912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74480199-e0a6-414b-b1d4-5b2803b904de tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:09.606359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-74480199-e0a6-414b-b1d4-5b2803b904de tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:09.671568 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-74480199-e0a6-414b-b1d4-5b2803b904de tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:09.679709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-74480199-e0a6-414b-b1d4-5b2803b904de tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086806 Jul 28 20:25:09.680253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1463/2787] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:09 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:10.452896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cdca0b22-cbb8-4241-8509-0c5596a918c3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:10.453440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cdca0b22-cbb8-4241-8509-0c5596a918c3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:10.460051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdca0b22-cbb8-4241-8509-0c5596a918c3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:10.460496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdca0b22-cbb8-4241-8509-0c5596a918c3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:10.461279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdca0b22-cbb8-4241-8509-0c5596a918c3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:10.461712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdca0b22-cbb8-4241-8509-0c5596a918c3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:10.590641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cdca0b22-cbb8-4241-8509-0c5596a918c3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:10.598607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cdca0b22-cbb8-4241-8509-0c5596a918c3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149736 Jul 28 20:25:10.599169 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1325/2788] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:10 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:10.700365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-253b7e58-3a2c-4609-aa17-c4e6667afb1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:10.701031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-253b7e58-3a2c-4609-aa17-c4e6667afb1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:10.707502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-253b7e58-3a2c-4609-aa17-c4e6667afb1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:10.707896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-253b7e58-3a2c-4609-aa17-c4e6667afb1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:10.708683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-253b7e58-3a2c-4609-aa17-c4e6667afb1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:10.709652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-253b7e58-3a2c-4609-aa17-c4e6667afb1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:10.780007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-253b7e58-3a2c-4609-aa17-c4e6667afb1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:10.788840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-253b7e58-3a2c-4609-aa17-c4e6667afb1a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.092083 Jul 28 20:25:10.789397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1464/2789] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:10 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:11.620493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-989095d1-77a7-400f-980c-4b31228637dd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:11.621123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-989095d1-77a7-400f-980c-4b31228637dd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:11.627782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-989095d1-77a7-400f-980c-4b31228637dd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:11.628255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-989095d1-77a7-400f-980c-4b31228637dd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:11.629053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-989095d1-77a7-400f-980c-4b31228637dd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:11.629490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-989095d1-77a7-400f-980c-4b31228637dd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:11.759253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-989095d1-77a7-400f-980c-4b31228637dd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:11.767112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-989095d1-77a7-400f-980c-4b31228637dd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151671 Jul 28 20:25:11.767668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1326/2790] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:11 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:11.809695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fcb85687-1fd3-48e5-9f50-d21dace00896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:11.810357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fcb85687-1fd3-48e5-9f50-d21dace00896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:11.816844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fcb85687-1fd3-48e5-9f50-d21dace00896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:11.817285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fcb85687-1fd3-48e5-9f50-d21dace00896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:11.818026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fcb85687-1fd3-48e5-9f50-d21dace00896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:11.819051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fcb85687-1fd3-48e5-9f50-d21dace00896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:11.877973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fcb85687-1fd3-48e5-9f50-d21dace00896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:11.886347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fcb85687-1fd3-48e5-9f50-d21dace00896 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080522 Jul 28 20:25:11.886893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1465/2791] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:12.047320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:25:12.047542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:25:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:25:12.789958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e9965231-3694-41e4-8d49-c423c260a289 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:12.790654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e9965231-3694-41e4-8d49-c423c260a289 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:12.797038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9965231-3694-41e4-8d49-c423c260a289 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:12.797480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9965231-3694-41e4-8d49-c423c260a289 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:12.798249 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9965231-3694-41e4-8d49-c423c260a289 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:12.798676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9965231-3694-41e4-8d49-c423c260a289 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:12.907451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-88feffb3-59a2-4302-a673-d68dfce630e0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:12.908057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-88feffb3-59a2-4302-a673-d68dfce630e0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:12.915065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88feffb3-59a2-4302-a673-d68dfce630e0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:12.915511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88feffb3-59a2-4302-a673-d68dfce630e0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:12.916261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88feffb3-59a2-4302-a673-d68dfce630e0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:12.916719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88feffb3-59a2-4302-a673-d68dfce630e0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:12.927486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e9965231-3694-41e4-8d49-c423c260a289 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:12.936620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e9965231-3694-41e4-8d49-c423c260a289 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151090 Jul 28 20:25:12.937180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1327/2792] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:12 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:12.978397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-88feffb3-59a2-4302-a673-d68dfce630e0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:12.986188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-88feffb3-59a2-4302-a673-d68dfce630e0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082575 Jul 28 20:25:12.986736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1466/2793] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:13.957571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8456ed38-4b25-439b-bae6-d2ccea8d018b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:13.958159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8456ed38-4b25-439b-bae6-d2ccea8d018b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:13.965184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8456ed38-4b25-439b-bae6-d2ccea8d018b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:13.965631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8456ed38-4b25-439b-bae6-d2ccea8d018b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:13.966375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8456ed38-4b25-439b-bae6-d2ccea8d018b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:13.966801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8456ed38-4b25-439b-bae6-d2ccea8d018b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:14.009438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ce907192-6548-47e3-a987-e2f2ef3e1de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:14.010056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ce907192-6548-47e3-a987-e2f2ef3e1de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:14.016614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ce907192-6548-47e3-a987-e2f2ef3e1de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:14.017062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ce907192-6548-47e3-a987-e2f2ef3e1de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:14.017816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ce907192-6548-47e3-a987-e2f2ef3e1de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:14.018256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ce907192-6548-47e3-a987-e2f2ef3e1de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:14.096489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ce907192-6548-47e3-a987-e2f2ef3e1de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:14.105511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ce907192-6548-47e3-a987-e2f2ef3e1de0 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.100506 Jul 28 20:25:14.106070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1467/2794] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:14.118222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8456ed38-4b25-439b-bae6-d2ccea8d018b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:14.126165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8456ed38-4b25-439b-bae6-d2ccea8d018b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.172452 Jul 28 20:25:14.126724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1328/2795] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:13 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:15.126507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c6a9d3e1-6c3d-445a-bbe2-375f16ba1c94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:15.127114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c6a9d3e1-6c3d-445a-bbe2-375f16ba1c94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:15.134477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e1-6c3d-445a-bbe2-375f16ba1c94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:15.134916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e1-6c3d-445a-bbe2-375f16ba1c94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:15.135655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e1-6c3d-445a-bbe2-375f16ba1c94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:15.136078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c6a9d3e1-6c3d-445a-bbe2-375f16ba1c94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:15.146196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a29e827c-a16f-45ee-9017-5938b0e48297 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:15.146820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a29e827c-a16f-45ee-9017-5938b0e48297 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:15.154200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a29e827c-a16f-45ee-9017-5938b0e48297 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:15.154651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a29e827c-a16f-45ee-9017-5938b0e48297 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:15.155409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a29e827c-a16f-45ee-9017-5938b0e48297 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:15.155868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a29e827c-a16f-45ee-9017-5938b0e48297 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:15.203635 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c6a9d3e1-6c3d-445a-bbe2-375f16ba1c94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:15.212282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c6a9d3e1-6c3d-445a-bbe2-375f16ba1c94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.089534 Jul 28 20:25:15.212878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1468/2796] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:15 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:15.299593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a29e827c-a16f-45ee-9017-5938b0e48297 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:15.307505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a29e827c-a16f-45ee-9017-5938b0e48297 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.165166 Jul 28 20:25:15.308051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1329/2797] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:15 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:16.234119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-849919e5-a216-4652-8bfb-2d2faceacc7e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:16.234732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-849919e5-a216-4652-8bfb-2d2faceacc7e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:16.241261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-849919e5-a216-4652-8bfb-2d2faceacc7e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:16.241709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-849919e5-a216-4652-8bfb-2d2faceacc7e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:16.243032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-849919e5-a216-4652-8bfb-2d2faceacc7e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:16.243473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-849919e5-a216-4652-8bfb-2d2faceacc7e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:16.304447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-849919e5-a216-4652-8bfb-2d2faceacc7e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:16.312323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-849919e5-a216-4652-8bfb-2d2faceacc7e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082026 Jul 28 20:25:16.312914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1469/2798] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:16 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:16.328670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-037e87f7-090d-4760-b084-0766c1552c1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:16.329288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-037e87f7-090d-4760-b084-0766c1552c1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:16.335744 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-037e87f7-090d-4760-b084-0766c1552c1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:16.336821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-037e87f7-090d-4760-b084-0766c1552c1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:16.337598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-037e87f7-090d-4760-b084-0766c1552c1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:16.338019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-037e87f7-090d-4760-b084-0766c1552c1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:16.467773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-037e87f7-090d-4760-b084-0766c1552c1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:16.475655 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-037e87f7-090d-4760-b084-0766c1552c1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150795 Jul 28 20:25:16.476219 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1330/2799] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:16 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:17.333166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a4fc7fff-e3c2-400f-8785-7ec7b2e0b2a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:17.333771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a4fc7fff-e3c2-400f-8785-7ec7b2e0b2a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:17.340375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a4fc7fff-e3c2-400f-8785-7ec7b2e0b2a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:17.341122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a4fc7fff-e3c2-400f-8785-7ec7b2e0b2a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:17.341872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a4fc7fff-e3c2-400f-8785-7ec7b2e0b2a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:17.342298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a4fc7fff-e3c2-400f-8785-7ec7b2e0b2a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:17.402833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a4fc7fff-e3c2-400f-8785-7ec7b2e0b2a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:17.410571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a4fc7fff-e3c2-400f-8785-7ec7b2e0b2a3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081290 Jul 28 20:25:17.411118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1470/2800] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:17.498053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7e1b73ea-2fe5-415a-ba73-a9306e7e95ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:17.498571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7e1b73ea-2fe5-415a-ba73-a9306e7e95ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:17.504989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e1b73ea-2fe5-415a-ba73-a9306e7e95ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:17.505430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e1b73ea-2fe5-415a-ba73-a9306e7e95ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:17.506175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e1b73ea-2fe5-415a-ba73-a9306e7e95ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:17.506600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e1b73ea-2fe5-415a-ba73-a9306e7e95ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:17.629925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7e1b73ea-2fe5-415a-ba73-a9306e7e95ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:17.638098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7e1b73ea-2fe5-415a-ba73-a9306e7e95ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.143894 Jul 28 20:25:17.638693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1331/2801] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:17 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:18.431225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a94c77b7-7457-417c-b344-80a709ba3704 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:18.431773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a94c77b7-7457-417c-b344-80a709ba3704 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:18.439116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a94c77b7-7457-417c-b344-80a709ba3704 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:18.439559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a94c77b7-7457-417c-b344-80a709ba3704 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:18.440310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a94c77b7-7457-417c-b344-80a709ba3704 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:18.440778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a94c77b7-7457-417c-b344-80a709ba3704 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:18.504344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a94c77b7-7457-417c-b344-80a709ba3704 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:18.513325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a94c77b7-7457-417c-b344-80a709ba3704 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086065 Jul 28 20:25:18.513893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1471/2802] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:18.659260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-78690a6a-b3fd-402f-90b6-c76b15f6c44d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:18.659867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-78690a6a-b3fd-402f-90b6-c76b15f6c44d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:18.666865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78690a6a-b3fd-402f-90b6-c76b15f6c44d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:18.667311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78690a6a-b3fd-402f-90b6-c76b15f6c44d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:18.668072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78690a6a-b3fd-402f-90b6-c76b15f6c44d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:18.668501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-78690a6a-b3fd-402f-90b6-c76b15f6c44d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:18.801033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-78690a6a-b3fd-402f-90b6-c76b15f6c44d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:18.809404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-78690a6a-b3fd-402f-90b6-c76b15f6c44d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153993 Jul 28 20:25:18.809958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1332/2803] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:18 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:19.534463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fc33b166-7928-4800-9599-7daa0ff9e8a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:19.535019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fc33b166-7928-4800-9599-7daa0ff9e8a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:19.541620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc33b166-7928-4800-9599-7daa0ff9e8a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:19.542165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc33b166-7928-4800-9599-7daa0ff9e8a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:19.543012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc33b166-7928-4800-9599-7daa0ff9e8a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:19.543439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc33b166-7928-4800-9599-7daa0ff9e8a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:19.604447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fc33b166-7928-4800-9599-7daa0ff9e8a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:19.612406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fc33b166-7928-4800-9599-7daa0ff9e8a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081926 Jul 28 20:25:19.612994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1472/2804] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:19.830155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8c9948bc-3613-49d9-aaeb-359da77e1eea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:19.830774 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8c9948bc-3613-49d9-aaeb-359da77e1eea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:19.838101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8c9948bc-3613-49d9-aaeb-359da77e1eea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:19.838555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8c9948bc-3613-49d9-aaeb-359da77e1eea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:19.839312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8c9948bc-3613-49d9-aaeb-359da77e1eea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:19.839751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8c9948bc-3613-49d9-aaeb-359da77e1eea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:20.125845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8c9948bc-3613-49d9-aaeb-359da77e1eea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:20.134525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8c9948bc-3613-49d9-aaeb-359da77e1eea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.308229 Jul 28 20:25:20.135080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1333/2805] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:19 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:20.633251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-21ea3dbe-7ec6-482f-b9f7-86163d5d7bba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:20.633834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-21ea3dbe-7ec6-482f-b9f7-86163d5d7bba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:20.640282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21ea3dbe-7ec6-482f-b9f7-86163d5d7bba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:20.640700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21ea3dbe-7ec6-482f-b9f7-86163d5d7bba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:20.641441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21ea3dbe-7ec6-482f-b9f7-86163d5d7bba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:20.641867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-21ea3dbe-7ec6-482f-b9f7-86163d5d7bba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:20.703263 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-21ea3dbe-7ec6-482f-b9f7-86163d5d7bba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:20.711984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-21ea3dbe-7ec6-482f-b9f7-86163d5d7bba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082455 Jul 28 20:25:20.712526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1473/2806] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:20 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:21.156113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-25d45a06-bd22-4099-840e-02947501f2ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:21.156723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-25d45a06-bd22-4099-840e-02947501f2ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:21.166810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25d45a06-bd22-4099-840e-02947501f2ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:21.166810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25d45a06-bd22-4099-840e-02947501f2ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:21.166810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25d45a06-bd22-4099-840e-02947501f2ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:21.166810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25d45a06-bd22-4099-840e-02947501f2ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:21.169653 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:21.297730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-25d45a06-bd22-4099-840e-02947501f2ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:21.306051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-25d45a06-bd22-4099-840e-02947501f2ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154130 Jul 28 20:25:21.306603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1334/2807] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:21 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:21.733747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-da23d0d7-c95b-478d-bff0-d70d68a912be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:21.734310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-da23d0d7-c95b-478d-bff0-d70d68a912be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:21.740854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da23d0d7-c95b-478d-bff0-d70d68a912be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:21.741302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da23d0d7-c95b-478d-bff0-d70d68a912be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:21.742777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da23d0d7-c95b-478d-bff0-d70d68a912be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:21.743207 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-da23d0d7-c95b-478d-bff0-d70d68a912be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:21.808427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-da23d0d7-c95b-478d-bff0-d70d68a912be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:21.816583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-da23d0d7-c95b-478d-bff0-d70d68a912be tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086930 Jul 28 20:25:21.817139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1474/2808] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:22.327092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-98ffd7f5-57e0-4032-8082-65452c0b7e53 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:22.327695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-98ffd7f5-57e0-4032-8082-65452c0b7e53 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:22.334140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98ffd7f5-57e0-4032-8082-65452c0b7e53 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:22.334590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98ffd7f5-57e0-4032-8082-65452c0b7e53 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:22.335340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98ffd7f5-57e0-4032-8082-65452c0b7e53 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:22.336328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98ffd7f5-57e0-4032-8082-65452c0b7e53 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:22.464032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-98ffd7f5-57e0-4032-8082-65452c0b7e53 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:22.471963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-98ffd7f5-57e0-4032-8082-65452c0b7e53 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148737 Jul 28 20:25:22.472514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1335/2809] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:22 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:22.838259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8efe86d5-217f-445c-9333-0e4f19dfaa62 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:22.838884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8efe86d5-217f-445c-9333-0e4f19dfaa62 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:22.845407 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8efe86d5-217f-445c-9333-0e4f19dfaa62 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:22.845850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8efe86d5-217f-445c-9333-0e4f19dfaa62 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:22.846600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8efe86d5-217f-445c-9333-0e4f19dfaa62 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:22.847029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8efe86d5-217f-445c-9333-0e4f19dfaa62 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:22.910619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8efe86d5-217f-445c-9333-0e4f19dfaa62 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:22.918730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8efe86d5-217f-445c-9333-0e4f19dfaa62 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085373 Jul 28 20:25:22.919281 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1475/2810] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:22 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:23.494323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dc55b8e2-e59f-40dd-9909-f3db5383d348 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:23.494887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dc55b8e2-e59f-40dd-9909-f3db5383d348 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:23.501328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc55b8e2-e59f-40dd-9909-f3db5383d348 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:23.502057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc55b8e2-e59f-40dd-9909-f3db5383d348 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:23.502815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc55b8e2-e59f-40dd-9909-f3db5383d348 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:23.503243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dc55b8e2-e59f-40dd-9909-f3db5383d348 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:23.631104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dc55b8e2-e59f-40dd-9909-f3db5383d348 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:23.639788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dc55b8e2-e59f-40dd-9909-f3db5383d348 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150154 Jul 28 20:25:23.640348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1336/2811] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:23 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:23.939266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c21d0918-b416-4990-a8c3-798f8177718f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:23.939877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c21d0918-b416-4990-a8c3-798f8177718f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:23.947759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c21d0918-b416-4990-a8c3-798f8177718f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:23.948212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c21d0918-b416-4990-a8c3-798f8177718f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:23.949014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c21d0918-b416-4990-a8c3-798f8177718f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:23.949447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c21d0918-b416-4990-a8c3-798f8177718f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:24.010802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c21d0918-b416-4990-a8c3-798f8177718f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:24.018621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c21d0918-b416-4990-a8c3-798f8177718f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083236 Jul 28 20:25:24.019201 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1476/2812] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:24.662084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aac281ae-ae03-4267-89b3-200ef948a1a7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:24.662699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aac281ae-ae03-4267-89b3-200ef948a1a7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:24.665595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=56 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:24.670908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aac281ae-ae03-4267-89b3-200ef948a1a7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:24.671347 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aac281ae-ae03-4267-89b3-200ef948a1a7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:24.672092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aac281ae-ae03-4267-89b3-200ef948a1a7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:24.672521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aac281ae-ae03-4267-89b3-200ef948a1a7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:24.799510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aac281ae-ae03-4267-89b3-200ef948a1a7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:24.807579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aac281ae-ae03-4267-89b3-200ef948a1a7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149573 Jul 28 20:25:24.808137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1337/2813] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:24 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:25.039798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-06759e32-d7a3-48bd-bef5-d0d391da431a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:25.040346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-06759e32-d7a3-48bd-bef5-d0d391da431a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:25.047342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06759e32-d7a3-48bd-bef5-d0d391da431a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:25.047786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06759e32-d7a3-48bd-bef5-d0d391da431a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:25.048560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06759e32-d7a3-48bd-bef5-d0d391da431a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:25.049026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-06759e32-d7a3-48bd-bef5-d0d391da431a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:25.053130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:25.113016 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-06759e32-d7a3-48bd-bef5-d0d391da431a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:25.121496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-06759e32-d7a3-48bd-bef5-d0d391da431a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086174 Jul 28 20:25:25.122045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1477/2814] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:25.829074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0d272e60-a26d-498e-ae8b-ab811dff8957 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:25.829676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0d272e60-a26d-498e-ae8b-ab811dff8957 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:25.836426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d272e60-a26d-498e-ae8b-ab811dff8957 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:25.836905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d272e60-a26d-498e-ae8b-ab811dff8957 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:25.837656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d272e60-a26d-498e-ae8b-ab811dff8957 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:25.838088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d272e60-a26d-498e-ae8b-ab811dff8957 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:25.966924 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0d272e60-a26d-498e-ae8b-ab811dff8957 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:25.974768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0d272e60-a26d-498e-ae8b-ab811dff8957 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149531 Jul 28 20:25:25.975315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1338/2815] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:25 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:26.143180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6cf34b3-7de8-4b34-b5a6-aeafa14af1c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:26.143729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b6cf34b3-7de8-4b34-b5a6-aeafa14af1c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:26.150352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6cf34b3-7de8-4b34-b5a6-aeafa14af1c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:26.151078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6cf34b3-7de8-4b34-b5a6-aeafa14af1c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:26.151828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6cf34b3-7de8-4b34-b5a6-aeafa14af1c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:26.152258 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6cf34b3-7de8-4b34-b5a6-aeafa14af1c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:26.213401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b6cf34b3-7de8-4b34-b5a6-aeafa14af1c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:26.221286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b6cf34b3-7de8-4b34-b5a6-aeafa14af1c6 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082031 Jul 28 20:25:26.221844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1478/2816] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:26 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:26.997446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-81b8eda6-8c7c-4470-998a-c29c92f30a5c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:26.998384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-81b8eda6-8c7c-4470-998a-c29c92f30a5c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:27.004584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81b8eda6-8c7c-4470-998a-c29c92f30a5c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:27.005037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81b8eda6-8c7c-4470-998a-c29c92f30a5c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:27.005836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81b8eda6-8c7c-4470-998a-c29c92f30a5c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:27.006221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-81b8eda6-8c7c-4470-998a-c29c92f30a5c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:27.141842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-81b8eda6-8c7c-4470-998a-c29c92f30a5c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:27.150604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-81b8eda6-8c7c-4470-998a-c29c92f30a5c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.157037 Jul 28 20:25:27.151150 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1339/2817] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:26 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:27.242972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-988aa819-5401-4689-92ef-7991e0946877 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:27.243578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-988aa819-5401-4689-92ef-7991e0946877 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:27.245867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=56 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:27.251108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-988aa819-5401-4689-92ef-7991e0946877 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:27.251552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-988aa819-5401-4689-92ef-7991e0946877 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:27.252292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-988aa819-5401-4689-92ef-7991e0946877 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:27.252746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-988aa819-5401-4689-92ef-7991e0946877 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:27.312991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-988aa819-5401-4689-92ef-7991e0946877 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:27.321389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-988aa819-5401-4689-92ef-7991e0946877 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082328 Jul 28 20:25:27.321938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1479/2818] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:27 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:28.173395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0c84d8af-71cb-42b4-b2e8-ff8fdc5fbd72 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:28.174013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0c84d8af-71cb-42b4-b2e8-ff8fdc5fbd72 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:28.180775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c84d8af-71cb-42b4-b2e8-ff8fdc5fbd72 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:28.181230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c84d8af-71cb-42b4-b2e8-ff8fdc5fbd72 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:28.181992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c84d8af-71cb-42b4-b2e8-ff8fdc5fbd72 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:28.182429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c84d8af-71cb-42b4-b2e8-ff8fdc5fbd72 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:28.307922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0c84d8af-71cb-42b4-b2e8-ff8fdc5fbd72 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:28.315732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0c84d8af-71cb-42b4-b2e8-ff8fdc5fbd72 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.146189 Jul 28 20:25:28.316283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1340/2819] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:28 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:28.342829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1b183456-143f-406e-9c4a-d172e6aecc59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:28.343487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1b183456-143f-406e-9c4a-d172e6aecc59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:28.349873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b183456-143f-406e-9c4a-d172e6aecc59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:28.350305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b183456-143f-406e-9c4a-d172e6aecc59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:28.351736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b183456-143f-406e-9c4a-d172e6aecc59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:28.352389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1b183456-143f-406e-9c4a-d172e6aecc59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:28.416193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1b183456-143f-406e-9c4a-d172e6aecc59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:28.424203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1b183456-143f-406e-9c4a-d172e6aecc59 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085104 Jul 28 20:25:28.424732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1480/2820] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:29.336277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2d6391c4-3f64-4974-81ad-82ddaabb6a06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:29.336886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2d6391c4-3f64-4974-81ad-82ddaabb6a06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:29.343340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d6391c4-3f64-4974-81ad-82ddaabb6a06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:29.343784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d6391c4-3f64-4974-81ad-82ddaabb6a06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:29.344525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d6391c4-3f64-4974-81ad-82ddaabb6a06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:29.344981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d6391c4-3f64-4974-81ad-82ddaabb6a06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:29.445532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc113c0b-95c1-4f4a-8966-e3f30df0dbbe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:29.446144 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc113c0b-95c1-4f4a-8966-e3f30df0dbbe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:29.452789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc113c0b-95c1-4f4a-8966-e3f30df0dbbe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:29.453238 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc113c0b-95c1-4f4a-8966-e3f30df0dbbe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:29.453993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc113c0b-95c1-4f4a-8966-e3f30df0dbbe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:29.454425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc113c0b-95c1-4f4a-8966-e3f30df0dbbe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:29.472392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2d6391c4-3f64-4974-81ad-82ddaabb6a06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:29.481981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2d6391c4-3f64-4974-81ad-82ddaabb6a06 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149545 Jul 28 20:25:29.482740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1341/2821] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:29 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:29.515522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cc113c0b-95c1-4f4a-8966-e3f30df0dbbe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:29.523561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc113c0b-95c1-4f4a-8966-e3f30df0dbbe tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081929 Jul 28 20:25:29.524149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1481/2822] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:30.503343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fc6aaa6b-c30e-4c09-ab9f-b61debd07579 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:30.503865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fc6aaa6b-c30e-4c09-ab9f-b61debd07579 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:30.511718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fc6aaa6b-c30e-4c09-ab9f-b61debd07579 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:30.512170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fc6aaa6b-c30e-4c09-ab9f-b61debd07579 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:30.512965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fc6aaa6b-c30e-4c09-ab9f-b61debd07579 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:30.513405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fc6aaa6b-c30e-4c09-ab9f-b61debd07579 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:30.543667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d07b3525-665f-4b5b-8f93-87355a264fee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:30.544288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d07b3525-665f-4b5b-8f93-87355a264fee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:30.550812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d07b3525-665f-4b5b-8f93-87355a264fee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:30.551266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d07b3525-665f-4b5b-8f93-87355a264fee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:30.552034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d07b3525-665f-4b5b-8f93-87355a264fee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:30.552468 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d07b3525-665f-4b5b-8f93-87355a264fee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:30.628558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d07b3525-665f-4b5b-8f93-87355a264fee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:30.637221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d07b3525-665f-4b5b-8f93-87355a264fee tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.097460 Jul 28 20:25:30.637785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1482/2823] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:30.666251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fc6aaa6b-c30e-4c09-ab9f-b61debd07579 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:30.674037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fc6aaa6b-c30e-4c09-ab9f-b61debd07579 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.174671 Jul 28 20:25:30.674586 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1342/2824] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:30 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:31.658453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d162ab97-c60a-4845-bfd3-2f06e7ab1295 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:31.659061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d162ab97-c60a-4845-bfd3-2f06e7ab1295 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:31.665961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d162ab97-c60a-4845-bfd3-2f06e7ab1295 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:31.666404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d162ab97-c60a-4845-bfd3-2f06e7ab1295 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:31.667142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d162ab97-c60a-4845-bfd3-2f06e7ab1295 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:31.667566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d162ab97-c60a-4845-bfd3-2f06e7ab1295 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:31.695749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2b9b9131-c67f-418a-9aee-4147d6599188 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:31.696345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2b9b9131-c67f-418a-9aee-4147d6599188 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:31.702357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b9b9131-c67f-418a-9aee-4147d6599188 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:31.702801 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b9b9131-c67f-418a-9aee-4147d6599188 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:31.703547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b9b9131-c67f-418a-9aee-4147d6599188 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:31.703972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2b9b9131-c67f-418a-9aee-4147d6599188 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:31.728611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d162ab97-c60a-4845-bfd3-2f06e7ab1295 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:31.736685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d162ab97-c60a-4845-bfd3-2f06e7ab1295 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081963 Jul 28 20:25:31.737344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1483/2825] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:31.833988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2b9b9131-c67f-418a-9aee-4147d6599188 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:31.842506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2b9b9131-c67f-418a-9aee-4147d6599188 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151192 Jul 28 20:25:31.843057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1343/2826] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:31 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:32.758053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d59d77f0-110d-4bfa-b7e1-1e4dfa6f455a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:32.758667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d59d77f0-110d-4bfa-b7e1-1e4dfa6f455a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:32.764874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d59d77f0-110d-4bfa-b7e1-1e4dfa6f455a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:32.765324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d59d77f0-110d-4bfa-b7e1-1e4dfa6f455a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:32.766077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d59d77f0-110d-4bfa-b7e1-1e4dfa6f455a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:32.766511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d59d77f0-110d-4bfa-b7e1-1e4dfa6f455a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:32.826410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d59d77f0-110d-4bfa-b7e1-1e4dfa6f455a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:32.835034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d59d77f0-110d-4bfa-b7e1-1e4dfa6f455a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081145 Jul 28 20:25:32.836217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1484/2827] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:32.863600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-31d87bc8-cdad-466f-b66a-cde2ac34ebc6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:32.864250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-31d87bc8-cdad-466f-b66a-cde2ac34ebc6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:32.871366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-31d87bc8-cdad-466f-b66a-cde2ac34ebc6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:32.871818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-31d87bc8-cdad-466f-b66a-cde2ac34ebc6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:32.872594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-31d87bc8-cdad-466f-b66a-cde2ac34ebc6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:32.873031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-31d87bc8-cdad-466f-b66a-cde2ac34ebc6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:33.000961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-31d87bc8-cdad-466f-b66a-cde2ac34ebc6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:33.009688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-31d87bc8-cdad-466f-b66a-cde2ac34ebc6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149949 Jul 28 20:25:33.010190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1344/2828] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:32 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:33.857023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e2b8514d-d335-492a-a9b9-1f9a80ad9e68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:33.857660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e2b8514d-d335-492a-a9b9-1f9a80ad9e68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:33.864098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2b8514d-d335-492a-a9b9-1f9a80ad9e68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:33.864569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2b8514d-d335-492a-a9b9-1f9a80ad9e68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:33.865312 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2b8514d-d335-492a-a9b9-1f9a80ad9e68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:33.865735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2b8514d-d335-492a-a9b9-1f9a80ad9e68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:33.930051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e2b8514d-d335-492a-a9b9-1f9a80ad9e68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:33.937856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e2b8514d-d335-492a-a9b9-1f9a80ad9e68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084659 Jul 28 20:25:33.938417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1485/2829] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:34.031288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-381c841d-0877-4812-886f-177db2e577c5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:34.031905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-381c841d-0877-4812-886f-177db2e577c5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:34.038922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-381c841d-0877-4812-886f-177db2e577c5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:34.039381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-381c841d-0877-4812-886f-177db2e577c5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:34.040140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-381c841d-0877-4812-886f-177db2e577c5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:34.040602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-381c841d-0877-4812-886f-177db2e577c5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:34.166311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-381c841d-0877-4812-886f-177db2e577c5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:34.174291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-381c841d-0877-4812-886f-177db2e577c5 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147157 Jul 28 20:25:34.174843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1345/2830] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:34 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:34.959093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-639020aa-0e07-42c2-8985-1485f94199d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:34.959736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-639020aa-0e07-42c2-8985-1485f94199d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:34.966320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-639020aa-0e07-42c2-8985-1485f94199d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:34.966768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-639020aa-0e07-42c2-8985-1485f94199d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:34.967523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-639020aa-0e07-42c2-8985-1485f94199d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:34.967952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-639020aa-0e07-42c2-8985-1485f94199d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:35.032187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-639020aa-0e07-42c2-8985-1485f94199d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:35.040853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-639020aa-0e07-42c2-8985-1485f94199d7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085540 Jul 28 20:25:35.041425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1486/2831] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:35.196274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3a7e8dc7-aaf8-4f94-8952-5b29fe1e4c12 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:35.196950 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3a7e8dc7-aaf8-4f94-8952-5b29fe1e4c12 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:35.203348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a7e8dc7-aaf8-4f94-8952-5b29fe1e4c12 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:35.203791 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a7e8dc7-aaf8-4f94-8952-5b29fe1e4c12 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:35.204591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a7e8dc7-aaf8-4f94-8952-5b29fe1e4c12 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:35.204993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3a7e8dc7-aaf8-4f94-8952-5b29fe1e4c12 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:35.339097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3a7e8dc7-aaf8-4f94-8952-5b29fe1e4c12 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:35.346957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3a7e8dc7-aaf8-4f94-8952-5b29fe1e4c12 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.155321 Jul 28 20:25:35.347513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1346/2832] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:35 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:36.063269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f46a34b0-a350-4551-9dec-ecc9894d149b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:36.063871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f46a34b0-a350-4551-9dec-ecc9894d149b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:36.070947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f46a34b0-a350-4551-9dec-ecc9894d149b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:36.071385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f46a34b0-a350-4551-9dec-ecc9894d149b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:36.072128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f46a34b0-a350-4551-9dec-ecc9894d149b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:36.072576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f46a34b0-a350-4551-9dec-ecc9894d149b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:36.131856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f46a34b0-a350-4551-9dec-ecc9894d149b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:36.140617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f46a34b0-a350-4551-9dec-ecc9894d149b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081164 Jul 28 20:25:36.141167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1487/2833] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:36 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:36.369533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-622e0e07-9919-42f5-8706-5cc08ef809d6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:36.370149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-622e0e07-9919-42f5-8706-5cc08ef809d6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:36.376599 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-622e0e07-9919-42f5-8706-5cc08ef809d6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:36.377049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-622e0e07-9919-42f5-8706-5cc08ef809d6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:36.377806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-622e0e07-9919-42f5-8706-5cc08ef809d6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:36.378239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-622e0e07-9919-42f5-8706-5cc08ef809d6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:36.506058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-622e0e07-9919-42f5-8706-5cc08ef809d6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:36.515205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-622e0e07-9919-42f5-8706-5cc08ef809d6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150666 Jul 28 20:25:36.515764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1347/2834] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:36 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:37.162242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-76d47a62-ed7f-4f43-968b-723ac810daf7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:37.162849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-76d47a62-ed7f-4f43-968b-723ac810daf7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:37.170385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76d47a62-ed7f-4f43-968b-723ac810daf7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:37.170828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76d47a62-ed7f-4f43-968b-723ac810daf7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:37.171576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76d47a62-ed7f-4f43-968b-723ac810daf7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:37.172001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-76d47a62-ed7f-4f43-968b-723ac810daf7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:37.235930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-76d47a62-ed7f-4f43-968b-723ac810daf7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:37.244211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-76d47a62-ed7f-4f43-968b-723ac810daf7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085574 Jul 28 20:25:37.244871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1488/2835] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:37.536872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-10ff386c-7a6e-4fee-9ac6-521683920cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:37.537425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-10ff386c-7a6e-4fee-9ac6-521683920cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:37.544024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10ff386c-7a6e-4fee-9ac6-521683920cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:37.544506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10ff386c-7a6e-4fee-9ac6-521683920cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:37.545288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10ff386c-7a6e-4fee-9ac6-521683920cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:37.545725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-10ff386c-7a6e-4fee-9ac6-521683920cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:37.677231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-10ff386c-7a6e-4fee-9ac6-521683920cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:37.685602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-10ff386c-7a6e-4fee-9ac6-521683920cba tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152739 Jul 28 20:25:37.686234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1348/2836] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:37 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:38.265132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dedde8da-8451-4380-a961-622bf4cadf58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:38.265848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dedde8da-8451-4380-a961-622bf4cadf58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:38.272612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dedde8da-8451-4380-a961-622bf4cadf58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:38.273167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dedde8da-8451-4380-a961-622bf4cadf58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:38.273916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dedde8da-8451-4380-a961-622bf4cadf58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:38.274343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dedde8da-8451-4380-a961-622bf4cadf58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:38.336660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dedde8da-8451-4380-a961-622bf4cadf58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:38.344394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dedde8da-8451-4380-a961-622bf4cadf58 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083126 Jul 28 20:25:38.344988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1489/2837] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:38.707787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f20f31ac-93b1-4ab2-b044-c1a8498c330e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:38.708405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f20f31ac-93b1-4ab2-b044-c1a8498c330e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:38.715566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f20f31ac-93b1-4ab2-b044-c1a8498c330e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:38.716022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f20f31ac-93b1-4ab2-b044-c1a8498c330e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:38.716818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f20f31ac-93b1-4ab2-b044-c1a8498c330e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:38.717260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f20f31ac-93b1-4ab2-b044-c1a8498c330e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:38.845699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f20f31ac-93b1-4ab2-b044-c1a8498c330e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:38.854675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f20f31ac-93b1-4ab2-b044-c1a8498c330e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150788 Jul 28 20:25:38.855228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1349/2838] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:38 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:39.367190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d49117e7-4d19-45c2-9a26-037541fd32b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:39.367808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d49117e7-4d19-45c2-9a26-037541fd32b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:39.374356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d49117e7-4d19-45c2-9a26-037541fd32b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:39.374798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d49117e7-4d19-45c2-9a26-037541fd32b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:39.375538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d49117e7-4d19-45c2-9a26-037541fd32b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:39.375969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d49117e7-4d19-45c2-9a26-037541fd32b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:39.436250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d49117e7-4d19-45c2-9a26-037541fd32b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:39.444188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d49117e7-4d19-45c2-9a26-037541fd32b1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081431 Jul 28 20:25:39.445409 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1490/2839] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:39.875251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e85e5e37-ac9c-4975-9d39-f335e7bf7073 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:39.875863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e85e5e37-ac9c-4975-9d39-f335e7bf7073 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:39.882323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e85e5e37-ac9c-4975-9d39-f335e7bf7073 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:39.882781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e85e5e37-ac9c-4975-9d39-f335e7bf7073 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:39.883511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e85e5e37-ac9c-4975-9d39-f335e7bf7073 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:39.883940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e85e5e37-ac9c-4975-9d39-f335e7bf7073 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:40.011688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e85e5e37-ac9c-4975-9d39-f335e7bf7073 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:40.015045 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:40.020213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e85e5e37-ac9c-4975-9d39-f335e7bf7073 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148826 Jul 28 20:25:40.020803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1350/2840] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:39 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:40.466525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7e6bba36-702e-4b40-acb4-ed6cf32563a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:40.467059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7e6bba36-702e-4b40-acb4-ed6cf32563a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:40.473707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e6bba36-702e-4b40-acb4-ed6cf32563a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:40.474157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e6bba36-702e-4b40-acb4-ed6cf32563a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:40.474912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e6bba36-702e-4b40-acb4-ed6cf32563a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:40.475345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7e6bba36-702e-4b40-acb4-ed6cf32563a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:40.540299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7e6bba36-702e-4b40-acb4-ed6cf32563a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:40.548366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7e6bba36-702e-4b40-acb4-ed6cf32563a2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085779 Jul 28 20:25:40.548959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1491/2841] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:41.042472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-03fff539-156d-4b9c-98dd-f5b9ed6ff44c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:41.043104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-03fff539-156d-4b9c-98dd-f5b9ed6ff44c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:41.049626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-03fff539-156d-4b9c-98dd-f5b9ed6ff44c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:41.050067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-03fff539-156d-4b9c-98dd-f5b9ed6ff44c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:41.050843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-03fff539-156d-4b9c-98dd-f5b9ed6ff44c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:41.051270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-03fff539-156d-4b9c-98dd-f5b9ed6ff44c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:41.177414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-03fff539-156d-4b9c-98dd-f5b9ed6ff44c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:41.185440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-03fff539-156d-4b9c-98dd-f5b9ed6ff44c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147953 Jul 28 20:25:41.185995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1351/2842] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:41 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:41.570070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-44162362-0ed6-44de-97d2-ff33876f0bd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:41.570745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-44162362-0ed6-44de-97d2-ff33876f0bd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:41.577510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44162362-0ed6-44de-97d2-ff33876f0bd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:41.577988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44162362-0ed6-44de-97d2-ff33876f0bd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:41.578746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44162362-0ed6-44de-97d2-ff33876f0bd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:41.579181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44162362-0ed6-44de-97d2-ff33876f0bd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:41.640270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-44162362-0ed6-44de-97d2-ff33876f0bd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:41.648308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-44162362-0ed6-44de-97d2-ff33876f0bd5 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082659 Jul 28 20:25:41.648901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1492/2843] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:42.206044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-831449ae-be0b-4fdc-8fbb-14520433ff99 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:42.206660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-831449ae-be0b-4fdc-8fbb-14520433ff99 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:42.213977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-831449ae-be0b-4fdc-8fbb-14520433ff99 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:42.214427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-831449ae-be0b-4fdc-8fbb-14520433ff99 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:42.215178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-831449ae-be0b-4fdc-8fbb-14520433ff99 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:42.215609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-831449ae-be0b-4fdc-8fbb-14520433ff99 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:42.346635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-831449ae-be0b-4fdc-8fbb-14520433ff99 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:42.354631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-831449ae-be0b-4fdc-8fbb-14520433ff99 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152496 Jul 28 20:25:42.355178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1352/2844] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:42 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:42.669521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c423fe83-ab6c-4f99-a73e-d37fad25516a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:42.670174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c423fe83-ab6c-4f99-a73e-d37fad25516a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:42.676518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c423fe83-ab6c-4f99-a73e-d37fad25516a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:42.676993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c423fe83-ab6c-4f99-a73e-d37fad25516a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:42.677732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c423fe83-ab6c-4f99-a73e-d37fad25516a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:42.678156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c423fe83-ab6c-4f99-a73e-d37fad25516a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:42.738907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c423fe83-ab6c-4f99-a73e-d37fad25516a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:42.743450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:42.748335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c423fe83-ab6c-4f99-a73e-d37fad25516a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082595 Jul 28 20:25:42.748924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1493/2845] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:43.375232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-28d6c8c2-6bc4-458e-8957-9f4daeb38ee3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:43.375877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-28d6c8c2-6bc4-458e-8957-9f4daeb38ee3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:43.382868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28d6c8c2-6bc4-458e-8957-9f4daeb38ee3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:43.383315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28d6c8c2-6bc4-458e-8957-9f4daeb38ee3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:43.384065 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28d6c8c2-6bc4-458e-8957-9f4daeb38ee3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:43.384499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-28d6c8c2-6bc4-458e-8957-9f4daeb38ee3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:43.510059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-28d6c8c2-6bc4-458e-8957-9f4daeb38ee3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:43.517926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-28d6c8c2-6bc4-458e-8957-9f4daeb38ee3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.146535 Jul 28 20:25:43.518474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1353/2846] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:43 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:43.768419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-668a6542-d0e2-4724-98e5-7e7a214b3b37 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:43.769015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-668a6542-d0e2-4724-98e5-7e7a214b3b37 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:43.777456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-668a6542-d0e2-4724-98e5-7e7a214b3b37 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:43.777905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-668a6542-d0e2-4724-98e5-7e7a214b3b37 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:43.778654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-668a6542-d0e2-4724-98e5-7e7a214b3b37 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:43.779084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-668a6542-d0e2-4724-98e5-7e7a214b3b37 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:43.842026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-668a6542-d0e2-4724-98e5-7e7a214b3b37 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:43.849844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-668a6542-d0e2-4724-98e5-7e7a214b3b37 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085356 Jul 28 20:25:43.851153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1494/2847] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:44.539899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ee87a8e8-c15b-4e10-aa30-efdae50f6f1b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:44.540423 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ee87a8e8-c15b-4e10-aa30-efdae50f6f1b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:44.546941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee87a8e8-c15b-4e10-aa30-efdae50f6f1b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:44.547452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee87a8e8-c15b-4e10-aa30-efdae50f6f1b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:44.548201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee87a8e8-c15b-4e10-aa30-efdae50f6f1b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:44.548654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee87a8e8-c15b-4e10-aa30-efdae50f6f1b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:44.674603 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ee87a8e8-c15b-4e10-aa30-efdae50f6f1b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:44.683058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ee87a8e8-c15b-4e10-aa30-efdae50f6f1b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147239 Jul 28 20:25:44.683608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1354/2848] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:44 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:44.871451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-113229fc-4537-474b-85fb-a0d73be3dc75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:44.872058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-113229fc-4537-474b-85fb-a0d73be3dc75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:44.878589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-113229fc-4537-474b-85fb-a0d73be3dc75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:44.879032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-113229fc-4537-474b-85fb-a0d73be3dc75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:44.879773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-113229fc-4537-474b-85fb-a0d73be3dc75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:44.880198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-113229fc-4537-474b-85fb-a0d73be3dc75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:44.941291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-113229fc-4537-474b-85fb-a0d73be3dc75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:44.949777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-113229fc-4537-474b-85fb-a0d73be3dc75 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082364 Jul 28 20:25:44.950329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1495/2849] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:45.705094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7ebdd2db-16b9-4530-b7ec-ebe4472bf9ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:45.705657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7ebdd2db-16b9-4530-b7ec-ebe4472bf9ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:45.712641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ebdd2db-16b9-4530-b7ec-ebe4472bf9ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:45.713090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ebdd2db-16b9-4530-b7ec-ebe4472bf9ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:45.713851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ebdd2db-16b9-4530-b7ec-ebe4472bf9ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:45.714284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ebdd2db-16b9-4530-b7ec-ebe4472bf9ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:45.847330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7ebdd2db-16b9-4530-b7ec-ebe4472bf9ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:45.856080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7ebdd2db-16b9-4530-b7ec-ebe4472bf9ab tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154994 Jul 28 20:25:45.856967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1355/2850] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:45 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:45.970457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bd28ef75-74e5-4744-8142-fd5d222ff020 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:45.971020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bd28ef75-74e5-4744-8142-fd5d222ff020 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:45.977436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd28ef75-74e5-4744-8142-fd5d222ff020 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:45.977872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd28ef75-74e5-4744-8142-fd5d222ff020 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:45.978630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd28ef75-74e5-4744-8142-fd5d222ff020 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:45.979055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd28ef75-74e5-4744-8142-fd5d222ff020 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:46.039543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bd28ef75-74e5-4744-8142-fd5d222ff020 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:46.047381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bd28ef75-74e5-4744-8142-fd5d222ff020 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080826 Jul 28 20:25:46.047931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1496/2851] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:46.876393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c28b7247-a691-4641-a80c-dde696673567 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:46.877098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c28b7247-a691-4641-a80c-dde696673567 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:46.883753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c28b7247-a691-4641-a80c-dde696673567 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:46.884197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c28b7247-a691-4641-a80c-dde696673567 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:46.884981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c28b7247-a691-4641-a80c-dde696673567 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:46.885412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c28b7247-a691-4641-a80c-dde696673567 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:47.010824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c28b7247-a691-4641-a80c-dde696673567 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:47.018820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c28b7247-a691-4641-a80c-dde696673567 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.146317 Jul 28 20:25:47.019379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1356/2852] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:46 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:47.068511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-166886a3-b616-4454-9a86-6f22b98c25cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:47.069158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-166886a3-b616-4454-9a86-6f22b98c25cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:47.075740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-166886a3-b616-4454-9a86-6f22b98c25cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:47.076194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-166886a3-b616-4454-9a86-6f22b98c25cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:47.076987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-166886a3-b616-4454-9a86-6f22b98c25cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:47.077422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-166886a3-b616-4454-9a86-6f22b98c25cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:47.141074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-166886a3-b616-4454-9a86-6f22b98c25cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:47.149545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-166886a3-b616-4454-9a86-6f22b98c25cd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084844 Jul 28 20:25:47.150111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1497/2853] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:47 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:48.041956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7f6ef029-9355-403a-9e5d-6c8e0802db80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:48.042555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7f6ef029-9355-403a-9e5d-6c8e0802db80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:48.049050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f6ef029-9355-403a-9e5d-6c8e0802db80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:48.049496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f6ef029-9355-403a-9e5d-6c8e0802db80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:48.050243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f6ef029-9355-403a-9e5d-6c8e0802db80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:48.050677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f6ef029-9355-403a-9e5d-6c8e0802db80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:48.171818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-936d62a3-5300-4ec7-8240-2d781bb63725 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:48.172428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-936d62a3-5300-4ec7-8240-2d781bb63725 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:48.180132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-936d62a3-5300-4ec7-8240-2d781bb63725 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:48.180594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-936d62a3-5300-4ec7-8240-2d781bb63725 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:48.181363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-936d62a3-5300-4ec7-8240-2d781bb63725 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:48.181786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-936d62a3-5300-4ec7-8240-2d781bb63725 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:48.355862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-936d62a3-5300-4ec7-8240-2d781bb63725 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:48.363749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-936d62a3-5300-4ec7-8240-2d781bb63725 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.195782 Jul 28 20:25:48.364314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1498/2854] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:48.415525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7f6ef029-9355-403a-9e5d-6c8e0802db80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:48.423577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7f6ef029-9355-403a-9e5d-6c8e0802db80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.385950 Jul 28 20:25:48.424251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1357/2855] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:48 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:49.385433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f41f5807-b0af-417c-8ffe-861e85ba8d3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:49.386019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f41f5807-b0af-417c-8ffe-861e85ba8d3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:49.392383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f41f5807-b0af-417c-8ffe-861e85ba8d3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:49.392865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f41f5807-b0af-417c-8ffe-861e85ba8d3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:49.393595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f41f5807-b0af-417c-8ffe-861e85ba8d3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:49.394021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f41f5807-b0af-417c-8ffe-861e85ba8d3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:49.445891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e56b94ef-d372-4b66-9b49-dc15ca88cd13 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:49.446495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e56b94ef-d372-4b66-9b49-dc15ca88cd13 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:49.452870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e56b94ef-d372-4b66-9b49-dc15ca88cd13 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:49.453312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e56b94ef-d372-4b66-9b49-dc15ca88cd13 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:49.454349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e56b94ef-d372-4b66-9b49-dc15ca88cd13 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:49.454475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e56b94ef-d372-4b66-9b49-dc15ca88cd13 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:49.456744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f41f5807-b0af-417c-8ffe-861e85ba8d3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:49.465489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f41f5807-b0af-417c-8ffe-861e85ba8d3b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083964 Jul 28 20:25:49.466064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1499/2856] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:49.583971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e56b94ef-d372-4b66-9b49-dc15ca88cd13 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:49.592949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e56b94ef-d372-4b66-9b49-dc15ca88cd13 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151079 Jul 28 20:25:49.593508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1358/2857] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:49 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:50.487324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4863e860-99bd-48ca-b116-d89846c0e43b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:50.487845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4863e860-99bd-48ca-b116-d89846c0e43b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:50.495601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4863e860-99bd-48ca-b116-d89846c0e43b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:50.496046 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4863e860-99bd-48ca-b116-d89846c0e43b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:50.496819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4863e860-99bd-48ca-b116-d89846c0e43b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:50.497251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4863e860-99bd-48ca-b116-d89846c0e43b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:50.559421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4863e860-99bd-48ca-b116-d89846c0e43b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:50.567278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4863e860-99bd-48ca-b116-d89846c0e43b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083902 Jul 28 20:25:50.567915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1500/2858] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:50.613963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b51b7cb6-6dd9-452c-850d-bcda027e8e35 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:50.614584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b51b7cb6-6dd9-452c-850d-bcda027e8e35 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:50.621700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b51b7cb6-6dd9-452c-850d-bcda027e8e35 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:50.622152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b51b7cb6-6dd9-452c-850d-bcda027e8e35 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:50.622913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b51b7cb6-6dd9-452c-850d-bcda027e8e35 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:50.623354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b51b7cb6-6dd9-452c-850d-bcda027e8e35 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:50.753913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b51b7cb6-6dd9-452c-850d-bcda027e8e35 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:50.762405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b51b7cb6-6dd9-452c-850d-bcda027e8e35 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152364 Jul 28 20:25:50.762957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1359/2859] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:50 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:51.588006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7c9ff844-dac5-447b-ba16-77ec8917b2d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:51.588673 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7c9ff844-dac5-447b-ba16-77ec8917b2d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:51.595068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c9ff844-dac5-447b-ba16-77ec8917b2d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:51.595512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c9ff844-dac5-447b-ba16-77ec8917b2d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:51.596256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c9ff844-dac5-447b-ba16-77ec8917b2d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:51.596731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c9ff844-dac5-447b-ba16-77ec8917b2d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:51.657523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7c9ff844-dac5-447b-ba16-77ec8917b2d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:51.668559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7c9ff844-dac5-447b-ba16-77ec8917b2d3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084373 Jul 28 20:25:51.669147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1501/2860] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:51.784630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bcee3496-7ba2-4587-832f-584acf689cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:51.785245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bcee3496-7ba2-4587-832f-584acf689cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:51.792775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcee3496-7ba2-4587-832f-584acf689cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:51.793257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcee3496-7ba2-4587-832f-584acf689cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:51.794013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcee3496-7ba2-4587-832f-584acf689cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:51.794446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bcee3496-7ba2-4587-832f-584acf689cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:51.919843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bcee3496-7ba2-4587-832f-584acf689cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:51.927654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bcee3496-7ba2-4587-832f-584acf689cfa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147200 Jul 28 20:25:51.928788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1360/2861] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:51 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:52.690612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a06212c3-6804-487a-aae4-1c240f5df219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:52.691245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a06212c3-6804-487a-aae4-1c240f5df219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:52.699074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a06212c3-6804-487a-aae4-1c240f5df219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:52.699515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a06212c3-6804-487a-aae4-1c240f5df219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:52.700261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a06212c3-6804-487a-aae4-1c240f5df219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:52.700794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a06212c3-6804-487a-aae4-1c240f5df219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:52.764064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a06212c3-6804-487a-aae4-1c240f5df219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:52.772566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a06212c3-6804-487a-aae4-1c240f5df219 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085124 Jul 28 20:25:52.773114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1502/2862] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:52.951677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cfaf98c5-56e1-47da-98eb-bdca9694f52d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:52.952213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cfaf98c5-56e1-47da-98eb-bdca9694f52d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:52.958765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfaf98c5-56e1-47da-98eb-bdca9694f52d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:52.959222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfaf98c5-56e1-47da-98eb-bdca9694f52d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:52.960251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfaf98c5-56e1-47da-98eb-bdca9694f52d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:52.960719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfaf98c5-56e1-47da-98eb-bdca9694f52d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:53.087765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cfaf98c5-56e1-47da-98eb-bdca9694f52d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:53.095702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cfaf98c5-56e1-47da-98eb-bdca9694f52d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147983 Jul 28 20:25:53.096260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1361/2863] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:52 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:53.794570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e4fff6d5-e71e-42f7-8c4c-bf6c8e069d45 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:53.795196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e4fff6d5-e71e-42f7-8c4c-bf6c8e069d45 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:53.801724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4fff6d5-e71e-42f7-8c4c-bf6c8e069d45 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:53.802165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4fff6d5-e71e-42f7-8c4c-bf6c8e069d45 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:53.802952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4fff6d5-e71e-42f7-8c4c-bf6c8e069d45 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:53.803417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4fff6d5-e71e-42f7-8c4c-bf6c8e069d45 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:53.863216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e4fff6d5-e71e-42f7-8c4c-bf6c8e069d45 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:53.871009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e4fff6d5-e71e-42f7-8c4c-bf6c8e069d45 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080286 Jul 28 20:25:53.871561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1503/2864] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:53 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:54.116830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-026ab6e0-9436-4da2-88cc-86d72a6553fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:54.117445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-026ab6e0-9436-4da2-88cc-86d72a6553fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:54.123844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-026ab6e0-9436-4da2-88cc-86d72a6553fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:54.124291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-026ab6e0-9436-4da2-88cc-86d72a6553fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:54.125075 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-026ab6e0-9436-4da2-88cc-86d72a6553fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:54.125510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-026ab6e0-9436-4da2-88cc-86d72a6553fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:54.255644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-026ab6e0-9436-4da2-88cc-86d72a6553fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:54.264312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-026ab6e0-9436-4da2-88cc-86d72a6553fa tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151386 Jul 28 20:25:54.264913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1362/2865] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:54 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:54.891254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e2d486f1-a9f6-4f98-96e7-deebffe3a178 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:54.891864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e2d486f1-a9f6-4f98-96e7-deebffe3a178 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:54.898602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2d486f1-a9f6-4f98-96e7-deebffe3a178 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:54.899042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2d486f1-a9f6-4f98-96e7-deebffe3a178 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:54.899784 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2d486f1-a9f6-4f98-96e7-deebffe3a178 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:54.900211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2d486f1-a9f6-4f98-96e7-deebffe3a178 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:54.962934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e2d486f1-a9f6-4f98-96e7-deebffe3a178 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:54.970901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e2d486f1-a9f6-4f98-96e7-deebffe3a178 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083525 Jul 28 20:25:54.971459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1504/2866] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:54 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:55.286777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-01080134-5831-42c5-ad5e-f8b716a64053 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:55.287489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-01080134-5831-42c5-ad5e-f8b716a64053 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:55.290200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=52 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:55.295588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01080134-5831-42c5-ad5e-f8b716a64053 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:55.296033 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01080134-5831-42c5-ad5e-f8b716a64053 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:55.297022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01080134-5831-42c5-ad5e-f8b716a64053 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:55.297458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-01080134-5831-42c5-ad5e-f8b716a64053 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:55.434092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-01080134-5831-42c5-ad5e-f8b716a64053 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:55.442528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-01080134-5831-42c5-ad5e-f8b716a64053 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.159758 Jul 28 20:25:55.443377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1363/2867] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:55 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:55.992933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-96480d91-1d9e-4646-81e1-001ca60d7370 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:55.993736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-96480d91-1d9e-4646-81e1-001ca60d7370 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:56.000570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96480d91-1d9e-4646-81e1-001ca60d7370 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:56.001021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96480d91-1d9e-4646-81e1-001ca60d7370 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:56.001769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96480d91-1d9e-4646-81e1-001ca60d7370 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:56.002190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96480d91-1d9e-4646-81e1-001ca60d7370 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:56.066993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-96480d91-1d9e-4646-81e1-001ca60d7370 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:56.075888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-96480d91-1d9e-4646-81e1-001ca60d7370 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.088020 Jul 28 20:25:56.076450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1505/2868] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:55 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:56.165408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2a5a6f25-85c3-4a80-a878-8f98f4a31e76 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:56.166536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2a5a6f25-85c3-4a80-a878-8f98f4a31e76 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:56.173037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a5a6f25-85c3-4a80-a878-8f98f4a31e76 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:56.173499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a5a6f25-85c3-4a80-a878-8f98f4a31e76 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:56.174278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a5a6f25-85c3-4a80-a878-8f98f4a31e76 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:56.174737 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2a5a6f25-85c3-4a80-a878-8f98f4a31e76 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:56.205004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2a5a6f25-85c3-4a80-a878-8f98f4a31e76 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:25:56.286814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2a5a6f25-85c3-4a80-a878-8f98f4a31e76 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 204 len: 0 microversion: 2.1 time: 0.125338 Jul 28 20:25:56.287846 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1364/2869] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:25:56 2022] DELETE /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:25:56.296858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-872a1094-d82b-4735-bfd6-7dcfdb2577a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:56.297556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-872a1094-d82b-4735-bfd6-7dcfdb2577a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:56.304343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-872a1094-d82b-4735-bfd6-7dcfdb2577a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:56.304871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-872a1094-d82b-4735-bfd6-7dcfdb2577a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:56.305614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-872a1094-d82b-4735-bfd6-7dcfdb2577a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:56.306114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-872a1094-d82b-4735-bfd6-7dcfdb2577a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:56.451508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-872a1094-d82b-4735-bfd6-7dcfdb2577a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:56.460439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-872a1094-d82b-4735-bfd6-7dcfdb2577a8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1682 microversion: 2.1 time: 0.166410 Jul 28 20:25:56.461163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1506/2870] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:56 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:56.472713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4f46a1d4-12a1-4d37-aee7-424c3ae6a940 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:56.472713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4f46a1d4-12a1-4d37-aee7-424c3ae6a940 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:56.474572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4f46a1d4-12a1-4d37-aee7-424c3ae6a940 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:56.475876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4f46a1d4-12a1-4d37-aee7-424c3ae6a940 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:56.477019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4f46a1d4-12a1-4d37-aee7-424c3ae6a940 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:56.477520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4f46a1d4-12a1-4d37-aee7-424c3ae6a940 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:56.617339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4f46a1d4-12a1-4d37-aee7-424c3ae6a940 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:56.621148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:56.627111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4f46a1d4-12a1-4d37-aee7-424c3ae6a940 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.164752 Jul 28 20:25:56.627700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1365/2871] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:56 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:57.096429 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-66a073c6-7c9f-4900-850d-45e2b3118d3d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:57.097243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-66a073c6-7c9f-4900-850d-45e2b3118d3d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:57.111338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66a073c6-7c9f-4900-850d-45e2b3118d3d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:57.111873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66a073c6-7c9f-4900-850d-45e2b3118d3d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:57.112747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66a073c6-7c9f-4900-850d-45e2b3118d3d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:57.113208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66a073c6-7c9f-4900-850d-45e2b3118d3d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:57.177558 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-66a073c6-7c9f-4900-850d-45e2b3118d3d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:57.187707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-66a073c6-7c9f-4900-850d-45e2b3118d3d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.095137 Jul 28 20:25:57.188385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1507/2872] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:57 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:57.482675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1f8f01c8-ceb4-4935-acc8-7837af14e59a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:57.483282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1f8f01c8-ceb4-4935-acc8-7837af14e59a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:57.491040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1f8f01c8-ceb4-4935-acc8-7837af14e59a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:57.491459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1f8f01c8-ceb4-4935-acc8-7837af14e59a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:57.492231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1f8f01c8-ceb4-4935-acc8-7837af14e59a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:57.492752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1f8f01c8-ceb4-4935-acc8-7837af14e59a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:57.626962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1f8f01c8-ceb4-4935-acc8-7837af14e59a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:57.635083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1f8f01c8-ceb4-4935-acc8-7837af14e59a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1682 microversion: 2.1 time: 0.156268 Jul 28 20:25:57.635730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1366/2873] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:57 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:57.649986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6eca7d62-e4c9-4266-8e04-79498c057ba8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:57.650603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6eca7d62-e4c9-4266-8e04-79498c057ba8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:57.652986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=58 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:57.658014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6eca7d62-e4c9-4266-8e04-79498c057ba8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:57.658464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6eca7d62-e4c9-4266-8e04-79498c057ba8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:57.659219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6eca7d62-e4c9-4266-8e04-79498c057ba8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:57.659648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6eca7d62-e4c9-4266-8e04-79498c057ba8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:57.790293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6eca7d62-e4c9-4266-8e04-79498c057ba8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:57.798309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6eca7d62-e4c9-4266-8e04-79498c057ba8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.153354 Jul 28 20:25:57.798869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1508/2874] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:57 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:58.210394 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eac0bca8-672c-416c-b5fd-ebafcb7e11ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:58.210648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eac0bca8-672c-416c-b5fd-ebafcb7e11ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:58.216689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eac0bca8-672c-416c-b5fd-ebafcb7e11ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:58.217130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eac0bca8-672c-416c-b5fd-ebafcb7e11ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:58.217907 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eac0bca8-672c-416c-b5fd-ebafcb7e11ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:58.218340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eac0bca8-672c-416c-b5fd-ebafcb7e11ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:58.279664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-eac0bca8-672c-416c-b5fd-ebafcb7e11ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:58.287649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eac0bca8-672c-416c-b5fd-ebafcb7e11ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081632 Jul 28 20:25:58.288998 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1367/2875] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:58 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:58.657431 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-82e6d618-e13c-4f1c-be3f-68175eb1b1ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:58.658080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-82e6d618-e13c-4f1c-be3f-68175eb1b1ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:58.664506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82e6d618-e13c-4f1c-be3f-68175eb1b1ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:58.664975 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82e6d618-e13c-4f1c-be3f-68175eb1b1ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:58.665720 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82e6d618-e13c-4f1c-be3f-68175eb1b1ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:58.666146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-82e6d618-e13c-4f1c-be3f-68175eb1b1ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:58.729184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-82e6d618-e13c-4f1c-be3f-68175eb1b1ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:58.736865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-82e6d618-e13c-4f1c-be3f-68175eb1b1ad tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 200 len: 1615 microversion: 2.1 time: 0.083232 Jul 28 20:25:58.737434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1509/2876] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:58 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 1615 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:58.820821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e58fed1b-54c1-4229-9cc9-df31e35b22ea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:58.822230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e58fed1b-54c1-4229-9cc9-df31e35b22ea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:58.828984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e58fed1b-54c1-4229-9cc9-df31e35b22ea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:58.829789 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e58fed1b-54c1-4229-9cc9-df31e35b22ea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:58.830752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e58fed1b-54c1-4229-9cc9-df31e35b22ea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:58.831381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e58fed1b-54c1-4229-9cc9-df31e35b22ea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:58.867425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:25:58.983608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-f12cf8b7-1471-4f46-86c4-941b42f4367d req-465abc45-291c-45bf-9480-6dc4ac79f62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e331bb00-5b75-40e7-9658-3c691aee4e24", "name": "network-vif-deleted", "tag": "76e06d6f-2c0b-45fa-9513-bb7d5fcd96ed"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:25:59.000000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-f12cf8b7-1471-4f46-86c4-941b42f4367d req-465abc45-291c-45bf-9480-6dc4ac79f62f service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:59.000450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-f12cf8b7-1471-4f46-86c4-941b42f4367d req-465abc45-291c-45bf-9480-6dc4ac79f62f service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:59.016868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-f12cf8b7-1471-4f46-86c4-941b42f4367d req-465abc45-291c-45bf-9480-6dc4ac79f62f service nova] Creating event network-vif-deleted:76e06d6f-2c0b-45fa-9513-bb7d5fcd96ed for instance e331bb00-5b75-40e7-9658-3c691aee4e24 on hv-cinder-85144 Jul 28 20:25:59.018729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e58fed1b-54c1-4229-9cc9-df31e35b22ea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:59.028016 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-f12cf8b7-1471-4f46-86c4-941b42f4367d req-465abc45-291c-45bf-9480-6dc4ac79f62f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217862 Jul 28 20:25:59.028863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1368/2877] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:25:59.029748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e58fed1b-54c1-4229-9cc9-df31e35b22ea tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.213559 Jul 28 20:25:59.030565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1510/2878] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:58 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:25:59.310545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ae9a5cc0-44d7-4a58-b38c-f1551fa4bcdb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:59.311247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ae9a5cc0-44d7-4a58-b38c-f1551fa4bcdb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:59.318041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae9a5cc0-44d7-4a58-b38c-f1551fa4bcdb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:59.318555 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae9a5cc0-44d7-4a58-b38c-f1551fa4bcdb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:59.321188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae9a5cc0-44d7-4a58-b38c-f1551fa4bcdb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:59.321629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ae9a5cc0-44d7-4a58-b38c-f1551fa4bcdb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:59.387380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ae9a5cc0-44d7-4a58-b38c-f1551fa4bcdb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:25:59.395874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ae9a5cc0-44d7-4a58-b38c-f1551fa4bcdb tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.089492 Jul 28 20:25:59.405385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1369/2879] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:59 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:25:59.758426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:59.759115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:25:59.765605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:59.766307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:59.767068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:25:59.767494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:25:59.781412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 HTTP/1.1 Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:25:59.783141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:25:59.785063 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'e331bb00-5b75-40e7-9658-3c691aee4e24'} Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:25:59.790359 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:25:59.792966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:25:59.794443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:25:59.794443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-71d0bf77-cc87-4daa-8dbb-a91e5209c9b1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 404 len: 111 microversion: 2.1 time: 0.029924 Jul 28 20:25:59.794443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1511/2880] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:25:59 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:25:59.799851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0139b237-7c17-44f7-922f-449b98e3cbd5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '.version_select at 0x7f503b0c1d30>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:25:59.821043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0139b237-7c17-44f7-922f-449b98e3cbd5 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020770305" status: 202 len: 0 microversion: 2.1 time: 0.024890 Jul 28 20:25:59.821623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1370/2881] 10.222.0.67 () {58 vars in 1221 bytes} [Thu Jul 28 20:25:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020770305 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:26:00.052649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bb57145a-9e2a-4386-903e-294ecd73f182 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:00.053327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bb57145a-9e2a-4386-903e-294ecd73f182 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:00.059968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb57145a-9e2a-4386-903e-294ecd73f182 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:00.061005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb57145a-9e2a-4386-903e-294ecd73f182 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:00.061214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb57145a-9e2a-4386-903e-294ecd73f182 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:00.061645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bb57145a-9e2a-4386-903e-294ecd73f182 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:00.197365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bb57145a-9e2a-4386-903e-294ecd73f182 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:00.205326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bb57145a-9e2a-4386-903e-294ecd73f182 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.156647 Jul 28 20:26:00.205885 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1512/2882] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:00 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:00.418494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6268421d-eedc-4b3a-8782-f62fb2352b4e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:00.419972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6268421d-eedc-4b3a-8782-f62fb2352b4e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:00.427202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6268421d-eedc-4b3a-8782-f62fb2352b4e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:00.427652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6268421d-eedc-4b3a-8782-f62fb2352b4e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:00.429263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6268421d-eedc-4b3a-8782-f62fb2352b4e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:00.429698 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6268421d-eedc-4b3a-8782-f62fb2352b4e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:00.447143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c275d2ab-6e92-46f7-acea-b5831199fb6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: .version_select at 0x7f503b016ee0>, body: {"keypair": {"name": "tempest-keypair-210308177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALCy+7lXMehtvKxu6Oq/7n8ajnqMd8e68SeeDYfa7MOWDu1u3wlfEcone529gVkQUGevH6C+xZHCsmI33Qr1HT3+bR+jIc5DrD+jnmVYb8GOrfLzI+c5mYNUZmm/YG3xQ=="}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:26:00.462754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-c275d2ab-6e92-46f7-acea-b5831199fb6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for project d6612a467ab54632a74cf113b4666eb1. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:26:00.466523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-c275d2ab-6e92-46f7-acea-b5831199fb6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for user bd0b2bfa3d014222afd4e050ca8498f9 and project d6612a467ab54632a74cf113b4666eb1. Resources: {'key_pairs'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:26:00.491130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6268421d-eedc-4b3a-8782-f62fb2352b4e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:00.494567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c275d2ab-6e92-46f7-acea-b5831199fb6e tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051841 Jul 28 20:26:00.495243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1513/2883] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:26:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:26:00.500935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6268421d-eedc-4b3a-8782-f62fb2352b4e tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085691 Jul 28 20:26:00.500935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1371/2884] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:00 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:01.227321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-453295c7-7914-45df-9ab4-f13d114f5809 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:01.228032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-453295c7-7914-45df-9ab4-f13d114f5809 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:01.234084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-453295c7-7914-45df-9ab4-f13d114f5809 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:01.234530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-453295c7-7914-45df-9ab4-f13d114f5809 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:01.235291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-453295c7-7914-45df-9ab4-f13d114f5809 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:01.235721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-453295c7-7914-45df-9ab4-f13d114f5809 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:01.373680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-453295c7-7914-45df-9ab4-f13d114f5809 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:01.382401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-453295c7-7914-45df-9ab4-f13d114f5809 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.160716 Jul 28 20:26:01.382970 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1514/2885] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:01 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:01.521937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-57f3fe41-367a-4f22-b92a-d070b0f8476a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:01.522738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-57f3fe41-367a-4f22-b92a-d070b0f8476a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:01.529317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57f3fe41-367a-4f22-b92a-d070b0f8476a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:01.529769 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57f3fe41-367a-4f22-b92a-d070b0f8476a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:01.530530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57f3fe41-367a-4f22-b92a-d070b0f8476a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:01.530967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57f3fe41-367a-4f22-b92a-d070b0f8476a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:01.594461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-57f3fe41-367a-4f22-b92a-d070b0f8476a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:01.603607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-57f3fe41-367a-4f22-b92a-d070b0f8476a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085516 Jul 28 20:26:01.604177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1372/2886] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:01 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:01.776682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-73292702", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5173547b-0aef-47cd-835f-b2a192d02fb4"}], "security_groups": [{"name": "tempest-securitygroup--214184978"}], "key_name": "tempest-keypair-210308177", "user_data": "}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:26:01.878317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] validate_networks() for [('5173547b-0aef-47cd-835f-b2a192d02fb4', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:26:02.242002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:26:02.242637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:26:02.242872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:26:02.243273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:26:02.243672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:26:02.252377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:02.252851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:02.253633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:02.254061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:02.270732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for project d6612a467ab54632a74cf113b4666eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:26:02.274851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Getting quotas for user bd0b2bfa3d014222afd4e050ca8498f9 and project d6612a467ab54632a74cf113b4666eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:26:02.285754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:26:02.288166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:26:02.335546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b35505f9-384b-45cc-87fc-84ee0159c84c tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.563747 Jul 28 20:26:02.336362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1515/2887] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:26:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:26:02.346909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-49941b66-ec6d-43d2-9891-1cae75605f41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:02.347513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-49941b66-ec6d-43d2-9891-1cae75605f41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:02.404333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c7d3ab81-2afd-4b0d-96da-c68722c8e35a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:02.405184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c7d3ab81-2afd-4b0d-96da-c68722c8e35a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:02.406234 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-49941b66-ec6d-43d2-9891-1cae75605f41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:02.411449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7d3ab81-2afd-4b0d-96da-c68722c8e35a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:02.412301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7d3ab81-2afd-4b0d-96da-c68722c8e35a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:02.413777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7d3ab81-2afd-4b0d-96da-c68722c8e35a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:02.414537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7d3ab81-2afd-4b0d-96da-c68722c8e35a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:02.415840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-49941b66-ec6d-43d2-9891-1cae75605f41 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1239 microversion: 2.1 time: 0.072497 Jul 28 20:26:02.417705 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1373/2888] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:02 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:02.566751 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c7d3ab81-2afd-4b0d-96da-c68722c8e35a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:02.575488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c7d3ab81-2afd-4b0d-96da-c68722c8e35a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.175652 Jul 28 20:26:02.576196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1516/2889] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:02 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:02.626360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-188101c7-5f70-4498-bee3-5ca5baed5e72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:02.627134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-188101c7-5f70-4498-bee3-5ca5baed5e72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:02.634956 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-188101c7-5f70-4498-bee3-5ca5baed5e72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:02.635595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-188101c7-5f70-4498-bee3-5ca5baed5e72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:02.636442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-188101c7-5f70-4498-bee3-5ca5baed5e72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:02.636911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-188101c7-5f70-4498-bee3-5ca5baed5e72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:02.702355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-188101c7-5f70-4498-bee3-5ca5baed5e72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:02.711344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-188101c7-5f70-4498-bee3-5ca5baed5e72 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.089300 Jul 28 20:26:02.711909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1374/2890] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:02 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:03.437989 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e695c797-54b0-442f-9cb2-3bd9000c3463 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:03.438543 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e695c797-54b0-442f-9cb2-3bd9000c3463 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:03.444894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e695c797-54b0-442f-9cb2-3bd9000c3463 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:03.445689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e695c797-54b0-442f-9cb2-3bd9000c3463 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:03.446527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e695c797-54b0-442f-9cb2-3bd9000c3463 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:03.446969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e695c797-54b0-442f-9cb2-3bd9000c3463 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:03.511194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e695c797-54b0-442f-9cb2-3bd9000c3463 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:03.518948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e695c797-54b0-442f-9cb2-3bd9000c3463 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1299 microversion: 2.1 time: 0.084944 Jul 28 20:26:03.519714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1517/2891] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:03 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:03.597448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-797751c6-db82-4d4d-9213-4f5532d75e80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:03.598475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-797751c6-db82-4d4d-9213-4f5532d75e80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:03.607794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-797751c6-db82-4d4d-9213-4f5532d75e80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:03.608251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-797751c6-db82-4d4d-9213-4f5532d75e80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:03.609052 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-797751c6-db82-4d4d-9213-4f5532d75e80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:03.609487 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-797751c6-db82-4d4d-9213-4f5532d75e80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:03.742245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-797751c6-db82-4d4d-9213-4f5532d75e80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:03.750644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-797751c6-db82-4d4d-9213-4f5532d75e80 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.157597 Jul 28 20:26:03.751349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1375/2892] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:03 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:03.867727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b9bfaf86-374e-4620-9a73-79c05c7c3f84 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:03.868333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b9bfaf86-374e-4620-9a73-79c05c7c3f84 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:03.874307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9bfaf86-374e-4620-9a73-79c05c7c3f84 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:03.874744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9bfaf86-374e-4620-9a73-79c05c7c3f84 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:03.875495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9bfaf86-374e-4620-9a73-79c05c7c3f84 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:03.875920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9bfaf86-374e-4620-9a73-79c05c7c3f84 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:03.938333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b9bfaf86-374e-4620-9a73-79c05c7c3f84 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:03.946453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b9bfaf86-374e-4620-9a73-79c05c7c3f84 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.217220 Jul 28 20:26:03.946941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1518/2893] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:03 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:04.541040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1c02cdc8-99aa-4aa9-901f-b20b7b63e85d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:04.541664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1c02cdc8-99aa-4aa9-901f-b20b7b63e85d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:04.547755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c02cdc8-99aa-4aa9-901f-b20b7b63e85d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:04.548207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c02cdc8-99aa-4aa9-901f-b20b7b63e85d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:04.549000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c02cdc8-99aa-4aa9-901f-b20b7b63e85d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:04.549434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c02cdc8-99aa-4aa9-901f-b20b7b63e85d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:04.681930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1c02cdc8-99aa-4aa9-901f-b20b7b63e85d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:04.689652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1c02cdc8-99aa-4aa9-901f-b20b7b63e85d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1364 microversion: 2.1 time: 0.152758 Jul 28 20:26:04.690294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1376/2894] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:04 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:04.771358 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ea4a0a18-128d-41b3-a4c1-5de69afd8fad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:04.771980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ea4a0a18-128d-41b3-a4c1-5de69afd8fad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:04.778968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea4a0a18-128d-41b3-a4c1-5de69afd8fad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:04.779413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea4a0a18-128d-41b3-a4c1-5de69afd8fad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:04.780400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea4a0a18-128d-41b3-a4c1-5de69afd8fad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:04.780917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea4a0a18-128d-41b3-a4c1-5de69afd8fad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:04.942683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ea4a0a18-128d-41b3-a4c1-5de69afd8fad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:04.952864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ea4a0a18-128d-41b3-a4c1-5de69afd8fad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.184899 Jul 28 20:26:04.954473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1519/2895] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:04 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:04.973827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-8c5c6783-b359-4ef4-ad8e-54418a1dbe62 req-73162be8-107a-47a3-b8e5-efbbcd3f9025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f899c1b-9efc-4205-890d-5f314d6e4140", "tag": "a6e4bce3-715b-4e15-88bf-13024a68af24"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:26:04.974235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c01a06fd-85fc-44f8-84a8-0ba76bb69036 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:04.974914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c01a06fd-85fc-44f8-84a8-0ba76bb69036 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:04.984833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c01a06fd-85fc-44f8-84a8-0ba76bb69036 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:04.985200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c01a06fd-85fc-44f8-84a8-0ba76bb69036 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:04.986161 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c01a06fd-85fc-44f8-84a8-0ba76bb69036 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:04.986334 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-8c5c6783-b359-4ef4-ad8e-54418a1dbe62 req-73162be8-107a-47a3-b8e5-efbbcd3f9025 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:04.986735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c01a06fd-85fc-44f8-84a8-0ba76bb69036 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:04.987282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-8c5c6783-b359-4ef4-ad8e-54418a1dbe62 req-73162be8-107a-47a3-b8e5-efbbcd3f9025 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:05.000599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-8c5c6783-b359-4ef4-ad8e-54418a1dbe62 req-73162be8-107a-47a3-b8e5-efbbcd3f9025 service nova] Creating event network-changed:a6e4bce3-715b-4e15-88bf-13024a68af24 for instance 5f899c1b-9efc-4205-890d-5f314d6e4140 on hv-cinder-85144 Jul 28 20:26:05.006035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-8c5c6783-b359-4ef4-ad8e-54418a1dbe62 req-73162be8-107a-47a3-b8e5-efbbcd3f9025 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035716 Jul 28 20:26:05.007632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1520/2896] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:26:05.061305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c01a06fd-85fc-44f8-84a8-0ba76bb69036 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:05.071015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c01a06fd-85fc-44f8-84a8-0ba76bb69036 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.101069 Jul 28 20:26:05.071593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1377/2897] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:04 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:05.711655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-71363117-3d3f-4479-8057-7f416720e663 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:05.712344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-71363117-3d3f-4479-8057-7f416720e663 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:05.718567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71363117-3d3f-4479-8057-7f416720e663 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:05.719004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71363117-3d3f-4479-8057-7f416720e663 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:05.719739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71363117-3d3f-4479-8057-7f416720e663 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:05.720162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-71363117-3d3f-4479-8057-7f416720e663 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:05.857631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-71363117-3d3f-4479-8057-7f416720e663 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:05.864967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-71363117-3d3f-4479-8057-7f416720e663 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1364 microversion: 2.1 time: 0.157762 Jul 28 20:26:05.865521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1521/2898] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:05 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:05.975134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-12e271a1-58b3-4b0f-9e02-94f2b044fa55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:05.975666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-12e271a1-58b3-4b0f-9e02-94f2b044fa55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:05.982782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12e271a1-58b3-4b0f-9e02-94f2b044fa55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:05.983228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12e271a1-58b3-4b0f-9e02-94f2b044fa55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:05.983969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12e271a1-58b3-4b0f-9e02-94f2b044fa55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:05.984397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-12e271a1-58b3-4b0f-9e02-94f2b044fa55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:06.091971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-905ab537-95c6-4a25-8959-1206b291b56d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:06.092694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-905ab537-95c6-4a25-8959-1206b291b56d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:06.099199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-905ab537-95c6-4a25-8959-1206b291b56d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:06.099639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-905ab537-95c6-4a25-8959-1206b291b56d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:06.100386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-905ab537-95c6-4a25-8959-1206b291b56d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:06.100837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-905ab537-95c6-4a25-8959-1206b291b56d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:06.113431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-12e271a1-58b3-4b0f-9e02-94f2b044fa55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:06.122486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-12e271a1-58b3-4b0f-9e02-94f2b044fa55 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151291 Jul 28 20:26:06.123047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1378/2899] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:05 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:06.163894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-905ab537-95c6-4a25-8959-1206b291b56d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:06.171987 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-905ab537-95c6-4a25-8959-1206b291b56d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084053 Jul 28 20:26:06.172565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1522/2900] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:06 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:06.885953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f9fac7c2-f445-4a50-9b6c-09a682550cbf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:06.886755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f9fac7c2-f445-4a50-9b6c-09a682550cbf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:06.892918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9fac7c2-f445-4a50-9b6c-09a682550cbf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:06.893361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9fac7c2-f445-4a50-9b6c-09a682550cbf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:06.894114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9fac7c2-f445-4a50-9b6c-09a682550cbf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:06.894543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f9fac7c2-f445-4a50-9b6c-09a682550cbf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:07.041509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f9fac7c2-f445-4a50-9b6c-09a682550cbf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:07.050117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f9fac7c2-f445-4a50-9b6c-09a682550cbf tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1364 microversion: 2.1 time: 0.167931 Jul 28 20:26:07.050693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1379/2901] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:06 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:07.143959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-44a57e80-24e5-4748-bf5d-4ea2d533147a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:07.144631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-44a57e80-24e5-4748-bf5d-4ea2d533147a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:07.151489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44a57e80-24e5-4748-bf5d-4ea2d533147a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:07.152192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44a57e80-24e5-4748-bf5d-4ea2d533147a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:07.152969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44a57e80-24e5-4748-bf5d-4ea2d533147a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:07.153393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44a57e80-24e5-4748-bf5d-4ea2d533147a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:07.193263 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b73744f3-de7e-4ff8-816d-4b1b26358e66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:07.194038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b73744f3-de7e-4ff8-816d-4b1b26358e66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:07.200646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b73744f3-de7e-4ff8-816d-4b1b26358e66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:07.201247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b73744f3-de7e-4ff8-816d-4b1b26358e66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:07.202188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b73744f3-de7e-4ff8-816d-4b1b26358e66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:07.202752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b73744f3-de7e-4ff8-816d-4b1b26358e66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:07.275723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b73744f3-de7e-4ff8-816d-4b1b26358e66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:07.283872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b73744f3-de7e-4ff8-816d-4b1b26358e66 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.094403 Jul 28 20:26:07.284439 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1380/2902] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:07 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:07.304842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-44a57e80-24e5-4748-bf5d-4ea2d533147a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:07.313009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-44a57e80-24e5-4748-bf5d-4ea2d533147a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.172828 Jul 28 20:26:07.313566 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1523/2903] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:07 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:08.072171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a0830690-65d8-49c3-bb59-9c748f3ecbd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:08.072820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a0830690-65d8-49c3-bb59-9c748f3ecbd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:08.079358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0830690-65d8-49c3-bb59-9c748f3ecbd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:08.079807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0830690-65d8-49c3-bb59-9c748f3ecbd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:08.080580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0830690-65d8-49c3-bb59-9c748f3ecbd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:08.081019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0830690-65d8-49c3-bb59-9c748f3ecbd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:08.212522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a0830690-65d8-49c3-bb59-9c748f3ecbd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:08.219944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a0830690-65d8-49c3-bb59-9c748f3ecbd3 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1364 microversion: 2.1 time: 0.152608 Jul 28 20:26:08.220499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1381/2904] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:08 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:08.304512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4bd917cc-6d17-443f-8548-9241b2ad6de2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:08.306109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4bd917cc-6d17-443f-8548-9241b2ad6de2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:08.312459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4bd917cc-6d17-443f-8548-9241b2ad6de2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:08.312926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4bd917cc-6d17-443f-8548-9241b2ad6de2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:08.313696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4bd917cc-6d17-443f-8548-9241b2ad6de2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:08.314141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4bd917cc-6d17-443f-8548-9241b2ad6de2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:08.334336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f49b2a90-5e7e-42cc-824a-f03cd8b2441a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:08.334874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f49b2a90-5e7e-42cc-824a-f03cd8b2441a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:08.341015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f49b2a90-5e7e-42cc-824a-f03cd8b2441a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:08.341466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f49b2a90-5e7e-42cc-824a-f03cd8b2441a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:08.342220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f49b2a90-5e7e-42cc-824a-f03cd8b2441a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:08.342820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f49b2a90-5e7e-42cc-824a-f03cd8b2441a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:08.377002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4bd917cc-6d17-443f-8548-9241b2ad6de2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:08.386101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4bd917cc-6d17-443f-8548-9241b2ad6de2 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085311 Jul 28 20:26:08.386689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1524/2905] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:08 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:08.477354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f49b2a90-5e7e-42cc-824a-f03cd8b2441a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:08.485240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f49b2a90-5e7e-42cc-824a-f03cd8b2441a tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.154833 Jul 28 20:26:08.485793 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1382/2906] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:08 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:09.019702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-b0f1f325-7f45-47de-b936-438712a69589 req-30a818d8-b3fc-4f13-904c-49c0e2fa0c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f899c1b-9efc-4205-890d-5f314d6e4140", "name": "network-vif-plugged", "status": "completed", "tag": "a6e4bce3-715b-4e15-88bf-13024a68af24"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:26:09.031216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-b0f1f325-7f45-47de-b936-438712a69589 req-30a818d8-b3fc-4f13-904c-49c0e2fa0c30 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:09.031663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-b0f1f325-7f45-47de-b936-438712a69589 req-30a818d8-b3fc-4f13-904c-49c0e2fa0c30 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:09.043457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-b0f1f325-7f45-47de-b936-438712a69589 req-30a818d8-b3fc-4f13-904c-49c0e2fa0c30 service nova] Creating event network-vif-plugged:a6e4bce3-715b-4e15-88bf-13024a68af24 for instance 5f899c1b-9efc-4205-890d-5f314d6e4140 on hv-cinder-85144 Jul 28 20:26:09.048685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-b0f1f325-7f45-47de-b936-438712a69589 req-30a818d8-b3fc-4f13-904c-49c0e2fa0c30 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032584 Jul 28 20:26:09.049268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1525/2907] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:26:09.240388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-191221f5-8b32-4e2f-8c63-9a801e467589 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:09.241066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-191221f5-8b32-4e2f-8c63-9a801e467589 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:09.248095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-191221f5-8b32-4e2f-8c63-9a801e467589 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:09.248565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-191221f5-8b32-4e2f-8c63-9a801e467589 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:09.249350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-191221f5-8b32-4e2f-8c63-9a801e467589 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:09.249783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-191221f5-8b32-4e2f-8c63-9a801e467589 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:09.382518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-191221f5-8b32-4e2f-8c63-9a801e467589 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:09.390327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-191221f5-8b32-4e2f-8c63-9a801e467589 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1364 microversion: 2.1 time: 0.153841 Jul 28 20:26:09.390985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1383/2908] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:09 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:09.407748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-83dbb9a3-3aaa-4aa6-9214-2d4614be99c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:09.408434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-83dbb9a3-3aaa-4aa6-9214-2d4614be99c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:09.415978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83dbb9a3-3aaa-4aa6-9214-2d4614be99c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:09.416815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83dbb9a3-3aaa-4aa6-9214-2d4614be99c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:09.417609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83dbb9a3-3aaa-4aa6-9214-2d4614be99c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:09.418041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83dbb9a3-3aaa-4aa6-9214-2d4614be99c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:09.479308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-83dbb9a3-3aaa-4aa6-9214-2d4614be99c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:09.487117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-83dbb9a3-3aaa-4aa6-9214-2d4614be99c4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083445 Jul 28 20:26:09.487670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1526/2909] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:09 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:09.506850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b57f10b6-e95a-42ad-8f5a-5adfbfa33b88 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:09.507488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b57f10b6-e95a-42ad-8f5a-5adfbfa33b88 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:09.513534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b57f10b6-e95a-42ad-8f5a-5adfbfa33b88 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:09.513982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b57f10b6-e95a-42ad-8f5a-5adfbfa33b88 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:09.514735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b57f10b6-e95a-42ad-8f5a-5adfbfa33b88 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:09.515171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b57f10b6-e95a-42ad-8f5a-5adfbfa33b88 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:09.641484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b57f10b6-e95a-42ad-8f5a-5adfbfa33b88 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:09.649362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b57f10b6-e95a-42ad-8f5a-5adfbfa33b88 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.146436 Jul 28 20:26:09.650809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1384/2910] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:09 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:10.411640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e22dff54-9dca-4d43-855b-722d56dcbc22 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:10.412836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e22dff54-9dca-4d43-855b-722d56dcbc22 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:10.420240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e22dff54-9dca-4d43-855b-722d56dcbc22 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:10.420713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e22dff54-9dca-4d43-855b-722d56dcbc22 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:10.421465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e22dff54-9dca-4d43-855b-722d56dcbc22 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:10.421894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e22dff54-9dca-4d43-855b-722d56dcbc22 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:10.508523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-65095ec1-0104-4d66-99ac-e82c3915ea94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:10.509255 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-65095ec1-0104-4d66-99ac-e82c3915ea94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:10.516146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-65095ec1-0104-4d66-99ac-e82c3915ea94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:10.516607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-65095ec1-0104-4d66-99ac-e82c3915ea94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:10.517372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-65095ec1-0104-4d66-99ac-e82c3915ea94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:10.517908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-65095ec1-0104-4d66-99ac-e82c3915ea94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:10.522286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:10.572744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e22dff54-9dca-4d43-855b-722d56dcbc22 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:10.580358 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e22dff54-9dca-4d43-855b-722d56dcbc22 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1364 microversion: 2.1 time: 0.172697 Jul 28 20:26:10.581034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1527/2911] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:10 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:10.589768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-65095ec1-0104-4d66-99ac-e82c3915ea94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:10.597838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-65095ec1-0104-4d66-99ac-e82c3915ea94 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.093216 Jul 28 20:26:10.598975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1385/2912] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:10 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:10.672390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-422f1aba-b96c-4193-b172-44179f87f7e4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:10.672940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-422f1aba-b96c-4193-b172-44179f87f7e4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:10.678896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-422f1aba-b96c-4193-b172-44179f87f7e4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:10.679338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-422f1aba-b96c-4193-b172-44179f87f7e4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:10.680077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-422f1aba-b96c-4193-b172-44179f87f7e4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:10.680500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-422f1aba-b96c-4193-b172-44179f87f7e4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:10.808502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-422f1aba-b96c-4193-b172-44179f87f7e4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:10.816499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-422f1aba-b96c-4193-b172-44179f87f7e4 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147987 Jul 28 20:26:10.817078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1528/2913] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:10 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:11.603540 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7b7f1924-6a18-49ae-9894-09d2fabe55ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:11.604164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7b7f1924-6a18-49ae-9894-09d2fabe55ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:11.610652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b7f1924-6a18-49ae-9894-09d2fabe55ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:11.611100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b7f1924-6a18-49ae-9894-09d2fabe55ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:11.611849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b7f1924-6a18-49ae-9894-09d2fabe55ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:11.612277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7b7f1924-6a18-49ae-9894-09d2fabe55ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:11.620886 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ecfb0bf7-7b09-4b0a-9dbd-b640be4df240 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:11.621628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ecfb0bf7-7b09-4b0a-9dbd-b640be4df240 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:11.627980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ecfb0bf7-7b09-4b0a-9dbd-b640be4df240 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:11.628422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ecfb0bf7-7b09-4b0a-9dbd-b640be4df240 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:11.629199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ecfb0bf7-7b09-4b0a-9dbd-b640be4df240 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:11.629625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ecfb0bf7-7b09-4b0a-9dbd-b640be4df240 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:11.710203 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ecfb0bf7-7b09-4b0a-9dbd-b640be4df240 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:11.718547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ecfb0bf7-7b09-4b0a-9dbd-b640be4df240 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.102133 Jul 28 20:26:11.719109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1529/2914] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:11 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:11.766133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7b7f1924-6a18-49ae-9894-09d2fabe55ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:11.773522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7b7f1924-6a18-49ae-9894-09d2fabe55ae tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1554 microversion: 2.1 time: 0.174371 Jul 28 20:26:11.774074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1386/2915] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:11 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:11.795289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7419c74e-b917-4172-a864-87e0b353a192 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:11.795773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7419c74e-b917-4172-a864-87e0b353a192 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:11.801787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7419c74e-b917-4172-a864-87e0b353a192 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:11.802228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7419c74e-b917-4172-a864-87e0b353a192 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:11.802965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7419c74e-b917-4172-a864-87e0b353a192 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:11.803394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7419c74e-b917-4172-a864-87e0b353a192 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:11.837891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-37899b1d-fdd8-4766-9f6e-f1af313d6e4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:11.838496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-37899b1d-fdd8-4766-9f6e-f1af313d6e4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:11.844500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37899b1d-fdd8-4766-9f6e-f1af313d6e4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:11.844963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37899b1d-fdd8-4766-9f6e-f1af313d6e4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:11.845714 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37899b1d-fdd8-4766-9f6e-f1af313d6e4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:11.846144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-37899b1d-fdd8-4766-9f6e-f1af313d6e4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:11.879641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7419c74e-b917-4172-a864-87e0b353a192 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088757 Jul 28 20:26:11.880299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1530/2916] 10.222.0.67 () {58 vars in 1275 bytes} [Thu Jul 28 20:26:11 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:26:12.093291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-37899b1d-fdd8-4766-9f6e-f1af313d6e4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:12.101525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-37899b1d-fdd8-4766-9f6e-f1af313d6e4c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.267629 Jul 28 20:26:12.102149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1387/2917] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:11 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:12.736230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:12.737111 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=10 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:12.741856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-14da3d9c-50f8-4ba5-90cf-ec62ff01f94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:12.742453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-14da3d9c-50f8-4ba5-90cf-ec62ff01f94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:12.749479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14da3d9c-50f8-4ba5-90cf-ec62ff01f94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:12.749915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14da3d9c-50f8-4ba5-90cf-ec62ff01f94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:12.750664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14da3d9c-50f8-4ba5-90cf-ec62ff01f94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:12.751095 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-14da3d9c-50f8-4ba5-90cf-ec62ff01f94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:12.755022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:12.830039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-14da3d9c-50f8-4ba5-90cf-ec62ff01f94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:12.837997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-14da3d9c-50f8-4ba5-90cf-ec62ff01f94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.102555 Jul 28 20:26:12.838564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1531/2918] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:12 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:12.956652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-c2d8391f-78e4-4180-8e23-3731030507cd req-8b8c0312-35ee-4d2c-8d7f-7b4215400ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f899c1b-9efc-4205-890d-5f314d6e4140", "tag": "a6e4bce3-715b-4e15-88bf-13024a68af24"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:26:12.962158 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:12.968751 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-c2d8391f-78e4-4180-8e23-3731030507cd req-8b8c0312-35ee-4d2c-8d7f-7b4215400ba0 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:12.969196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-c2d8391f-78e4-4180-8e23-3731030507cd req-8b8c0312-35ee-4d2c-8d7f-7b4215400ba0 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:12.981470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-c2d8391f-78e4-4180-8e23-3731030507cd req-8b8c0312-35ee-4d2c-8d7f-7b4215400ba0 service nova] Creating event network-changed:a6e4bce3-715b-4e15-88bf-13024a68af24 for instance 5f899c1b-9efc-4205-890d-5f314d6e4140 on hv-cinder-85144 Jul 28 20:26:12.986697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-c2d8391f-78e4-4180-8e23-3731030507cd req-8b8c0312-35ee-4d2c-8d7f-7b4215400ba0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033830 Jul 28 20:26:12.987300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1388/2919] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:26:13.124438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3cba8497-902a-4174-8e37-19f9b0dcf576 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:13.125109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3cba8497-902a-4174-8e37-19f9b0dcf576 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:13.131301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cba8497-902a-4174-8e37-19f9b0dcf576 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:13.131754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cba8497-902a-4174-8e37-19f9b0dcf576 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:13.132565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cba8497-902a-4174-8e37-19f9b0dcf576 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:13.133179 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cba8497-902a-4174-8e37-19f9b0dcf576 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:13.283383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3cba8497-902a-4174-8e37-19f9b0dcf576 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:13.292459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3cba8497-902a-4174-8e37-19f9b0dcf576 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.172701 Jul 28 20:26:13.293147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1532/2920] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:13 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:13.860357 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-02af4c93-5917-4be5-9503-5896d450ca69 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:13.861895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-02af4c93-5917-4be5-9503-5896d450ca69 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:13.868156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02af4c93-5917-4be5-9503-5896d450ca69 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:13.868642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02af4c93-5917-4be5-9503-5896d450ca69 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:13.869398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02af4c93-5917-4be5-9503-5896d450ca69 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:13.869821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-02af4c93-5917-4be5-9503-5896d450ca69 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:13.933757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-02af4c93-5917-4be5-9503-5896d450ca69 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:13.944321 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-02af4c93-5917-4be5-9503-5896d450ca69 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.088769 Jul 28 20:26:13.944915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1389/2921] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:13 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:14.313510 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e0b69bc4-fe91-4aa2-850e-a7e92c0c9ff8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:14.314116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e0b69bc4-fe91-4aa2-850e-a7e92c0c9ff8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:14.320609 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0b69bc4-fe91-4aa2-850e-a7e92c0c9ff8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:14.321052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0b69bc4-fe91-4aa2-850e-a7e92c0c9ff8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:14.322462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0b69bc4-fe91-4aa2-850e-a7e92c0c9ff8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:14.322462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e0b69bc4-fe91-4aa2-850e-a7e92c0c9ff8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:14.660905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e0b69bc4-fe91-4aa2-850e-a7e92c0c9ff8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:14.669594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e0b69bc4-fe91-4aa2-850e-a7e92c0c9ff8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.359874 Jul 28 20:26:14.670124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1533/2922] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:14 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:14.966591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7adbd434-b8e3-4488-8438-1900953f2772 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:14.967110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7adbd434-b8e3-4488-8438-1900953f2772 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:14.973686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7adbd434-b8e3-4488-8438-1900953f2772 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:14.974132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7adbd434-b8e3-4488-8438-1900953f2772 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:14.974885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7adbd434-b8e3-4488-8438-1900953f2772 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:14.975320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7adbd434-b8e3-4488-8438-1900953f2772 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:15.035477 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7adbd434-b8e3-4488-8438-1900953f2772 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:15.044254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7adbd434-b8e3-4488-8438-1900953f2772 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082340 Jul 28 20:26:15.044849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1390/2923] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:14 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:15.691205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-33561988-951c-443c-8a05-dafef8390504 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:15.691809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-33561988-951c-443c-8a05-dafef8390504 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:15.699012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33561988-951c-443c-8a05-dafef8390504 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:15.699451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33561988-951c-443c-8a05-dafef8390504 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:15.700188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33561988-951c-443c-8a05-dafef8390504 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:15.700636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-33561988-951c-443c-8a05-dafef8390504 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:15.827519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-33561988-951c-443c-8a05-dafef8390504 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:15.835456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-33561988-951c-443c-8a05-dafef8390504 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148154 Jul 28 20:26:15.836020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1534/2924] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:15 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:16.065452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dccf6c9f-65f2-46c8-a4dc-c34cf83df94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:16.065993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dccf6c9f-65f2-46c8-a4dc-c34cf83df94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:16.073213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dccf6c9f-65f2-46c8-a4dc-c34cf83df94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:16.073667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dccf6c9f-65f2-46c8-a4dc-c34cf83df94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:16.074451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dccf6c9f-65f2-46c8-a4dc-c34cf83df94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:16.074892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dccf6c9f-65f2-46c8-a4dc-c34cf83df94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:16.139982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dccf6c9f-65f2-46c8-a4dc-c34cf83df94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:16.147883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dccf6c9f-65f2-46c8-a4dc-c34cf83df94c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086375 Jul 28 20:26:16.148436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1391/2925] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:16 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:16.857175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-336b8bb3-c977-41d1-886d-4cc0e7b736ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:16.857779 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-336b8bb3-c977-41d1-886d-4cc0e7b736ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:16.864202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-336b8bb3-c977-41d1-886d-4cc0e7b736ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:16.864670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-336b8bb3-c977-41d1-886d-4cc0e7b736ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:16.865415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-336b8bb3-c977-41d1-886d-4cc0e7b736ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:16.865844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-336b8bb3-c977-41d1-886d-4cc0e7b736ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:16.993221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-336b8bb3-c977-41d1-886d-4cc0e7b736ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:17.001211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-336b8bb3-c977-41d1-886d-4cc0e7b736ac tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148050 Jul 28 20:26:17.001759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1535/2926] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:16 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:17.169941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-00774b5e-c905-42dc-a95f-829b6f6c917c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:17.170587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-00774b5e-c905-42dc-a95f-829b6f6c917c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:17.177101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00774b5e-c905-42dc-a95f-829b6f6c917c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:17.177550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00774b5e-c905-42dc-a95f-829b6f6c917c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:17.178309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00774b5e-c905-42dc-a95f-829b6f6c917c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:17.178747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00774b5e-c905-42dc-a95f-829b6f6c917c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:17.240055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-00774b5e-c905-42dc-a95f-829b6f6c917c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:17.248436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-00774b5e-c905-42dc-a95f-829b6f6c917c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082428 Jul 28 20:26:17.249018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1392/2927] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:17 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:18.022714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a7624bcb-94ca-4feb-9cae-9deacb6ad2d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:18.023249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a7624bcb-94ca-4feb-9cae-9deacb6ad2d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:18.030665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a7624bcb-94ca-4feb-9cae-9deacb6ad2d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:18.031109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a7624bcb-94ca-4feb-9cae-9deacb6ad2d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:18.031861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a7624bcb-94ca-4feb-9cae-9deacb6ad2d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:18.032290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a7624bcb-94ca-4feb-9cae-9deacb6ad2d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:18.162130 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a7624bcb-94ca-4feb-9cae-9deacb6ad2d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:18.170741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a7624bcb-94ca-4feb-9cae-9deacb6ad2d0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151904 Jul 28 20:26:18.171297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1536/2928] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:18 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:18.270115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bf9bedc1-efb3-472e-b819-bd9326eed584 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:18.270724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bf9bedc1-efb3-472e-b819-bd9326eed584 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:18.277997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf9bedc1-efb3-472e-b819-bd9326eed584 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:18.278376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf9bedc1-efb3-472e-b819-bd9326eed584 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:18.279119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf9bedc1-efb3-472e-b819-bd9326eed584 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:18.279546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bf9bedc1-efb3-472e-b819-bd9326eed584 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:18.340657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bf9bedc1-efb3-472e-b819-bd9326eed584 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:18.348418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bf9bedc1-efb3-472e-b819-bd9326eed584 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082088 Jul 28 20:26:18.348997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1393/2929] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:18 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:19.191467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dbc93403-1a7b-4594-b83d-850c600e20ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:19.192107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dbc93403-1a7b-4594-b83d-850c600e20ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:19.198776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dbc93403-1a7b-4594-b83d-850c600e20ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:19.199218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dbc93403-1a7b-4594-b83d-850c600e20ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:19.199966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dbc93403-1a7b-4594-b83d-850c600e20ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:19.200396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dbc93403-1a7b-4594-b83d-850c600e20ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:19.324902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dbc93403-1a7b-4594-b83d-850c600e20ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:19.332796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dbc93403-1a7b-4594-b83d-850c600e20ad tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.145217 Jul 28 20:26:19.333352 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1537/2930] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:19 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:19.370517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d655038d-35a5-4c03-9903-b249e36498ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:19.371125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d655038d-35a5-4c03-9903-b249e36498ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:19.377465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d655038d-35a5-4c03-9903-b249e36498ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:19.377908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d655038d-35a5-4c03-9903-b249e36498ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:19.378652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d655038d-35a5-4c03-9903-b249e36498ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:19.379078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d655038d-35a5-4c03-9903-b249e36498ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:19.442425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d655038d-35a5-4c03-9903-b249e36498ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:19.450325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d655038d-35a5-4c03-9903-b249e36498ea tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084445 Jul 28 20:26:19.450880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1394/2931] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:19 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:20.355180 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6cf3959b-34dc-4b0f-8966-f4a3808fabf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:20.355804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6cf3959b-34dc-4b0f-8966-f4a3808fabf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:20.362250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cf3959b-34dc-4b0f-8966-f4a3808fabf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:20.362695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cf3959b-34dc-4b0f-8966-f4a3808fabf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:20.363440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cf3959b-34dc-4b0f-8966-f4a3808fabf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:20.363872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6cf3959b-34dc-4b0f-8966-f4a3808fabf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:20.471142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-195723aa-c8bf-496c-80b8-e80d982c2bd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:20.471753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-195723aa-c8bf-496c-80b8-e80d982c2bd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:20.478191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-195723aa-c8bf-496c-80b8-e80d982c2bd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:20.478633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-195723aa-c8bf-496c-80b8-e80d982c2bd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:20.479387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-195723aa-c8bf-496c-80b8-e80d982c2bd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:20.479811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-195723aa-c8bf-496c-80b8-e80d982c2bd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:20.507801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6cf3959b-34dc-4b0f-8966-f4a3808fabf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:20.516618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6cf3959b-34dc-4b0f-8966-f4a3808fabf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.166276 Jul 28 20:26:20.517190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1538/2932] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:20 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:20.541373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-195723aa-c8bf-496c-80b8-e80d982c2bd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:20.549594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-195723aa-c8bf-496c-80b8-e80d982c2bd7 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082311 Jul 28 20:26:20.550148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1395/2933] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:20 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:21.538936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-525b8c4f-f92d-4d3c-aa80-3bf3871494e8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:21.539513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-525b8c4f-f92d-4d3c-aa80-3bf3871494e8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:21.550796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-525b8c4f-f92d-4d3c-aa80-3bf3871494e8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:21.551234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-525b8c4f-f92d-4d3c-aa80-3bf3871494e8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:21.551976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-525b8c4f-f92d-4d3c-aa80-3bf3871494e8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:21.552399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-525b8c4f-f92d-4d3c-aa80-3bf3871494e8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:21.574565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7950bd20-5097-45ca-a4a8-abc2394a7360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:21.575176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7950bd20-5097-45ca-a4a8-abc2394a7360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:21.582216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7950bd20-5097-45ca-a4a8-abc2394a7360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:21.582667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7950bd20-5097-45ca-a4a8-abc2394a7360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:21.583418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7950bd20-5097-45ca-a4a8-abc2394a7360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:21.583854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7950bd20-5097-45ca-a4a8-abc2394a7360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:21.653923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7950bd20-5097-45ca-a4a8-abc2394a7360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:21.662076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7950bd20-5097-45ca-a4a8-abc2394a7360 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.092161 Jul 28 20:26:21.662639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1396/2934] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:21 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:21.709300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-525b8c4f-f92d-4d3c-aa80-3bf3871494e8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:21.717495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-525b8c4f-f92d-4d3c-aa80-3bf3871494e8 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.182545 Jul 28 20:26:21.718048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1539/2935] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:21 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:22.683400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b6ed8009-8d72-4514-bf28-c8078cd7cffd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:22.683959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b6ed8009-8d72-4514-bf28-c8078cd7cffd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:22.690345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6ed8009-8d72-4514-bf28-c8078cd7cffd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:22.690783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6ed8009-8d72-4514-bf28-c8078cd7cffd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:22.691524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6ed8009-8d72-4514-bf28-c8078cd7cffd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:22.691952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6ed8009-8d72-4514-bf28-c8078cd7cffd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:22.737323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-496bc16a-a2ff-4807-b76f-5a19023d5782 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:22.737918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-496bc16a-a2ff-4807-b76f-5a19023d5782 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:22.745104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-496bc16a-a2ff-4807-b76f-5a19023d5782 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:22.745553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-496bc16a-a2ff-4807-b76f-5a19023d5782 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:22.746311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-496bc16a-a2ff-4807-b76f-5a19023d5782 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:22.746742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-496bc16a-a2ff-4807-b76f-5a19023d5782 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:22.753905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b6ed8009-8d72-4514-bf28-c8078cd7cffd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:22.762471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b6ed8009-8d72-4514-bf28-c8078cd7cffd tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083567 Jul 28 20:26:22.763043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1397/2936] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:22 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:22.888022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-496bc16a-a2ff-4807-b76f-5a19023d5782 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:22.895810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-496bc16a-a2ff-4807-b76f-5a19023d5782 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.162314 Jul 28 20:26:22.896362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1540/2937] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:22 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:23.784237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-38f49e91-6185-485b-905d-976d08725cba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:23.784868 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-38f49e91-6185-485b-905d-976d08725cba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:23.791582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38f49e91-6185-485b-905d-976d08725cba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:23.792043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38f49e91-6185-485b-905d-976d08725cba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:23.792825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38f49e91-6185-485b-905d-976d08725cba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:23.793253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38f49e91-6185-485b-905d-976d08725cba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:23.853929 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-38f49e91-6185-485b-905d-976d08725cba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:23.862100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-38f49e91-6185-485b-905d-976d08725cba tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081650 Jul 28 20:26:23.862667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1398/2938] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:23 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:23.917375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-31f7fa0c-9a88-4c32-bcb0-8f1eac0fd08d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:23.918005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-31f7fa0c-9a88-4c32-bcb0-8f1eac0fd08d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:23.924384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31f7fa0c-9a88-4c32-bcb0-8f1eac0fd08d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:23.924853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31f7fa0c-9a88-4c32-bcb0-8f1eac0fd08d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:23.925591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31f7fa0c-9a88-4c32-bcb0-8f1eac0fd08d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:23.926015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31f7fa0c-9a88-4c32-bcb0-8f1eac0fd08d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:24.053185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-31f7fa0c-9a88-4c32-bcb0-8f1eac0fd08d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:24.062119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-31f7fa0c-9a88-4c32-bcb0-8f1eac0fd08d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148633 Jul 28 20:26:24.062713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1541/2939] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:23 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:24.883258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f5c4aa51-0a9c-482d-ae7d-6fd41c6b3082 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:24.884493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f5c4aa51-0a9c-482d-ae7d-6fd41c6b3082 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:24.890932 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f5c4aa51-0a9c-482d-ae7d-6fd41c6b3082 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:24.891374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f5c4aa51-0a9c-482d-ae7d-6fd41c6b3082 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:24.892116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f5c4aa51-0a9c-482d-ae7d-6fd41c6b3082 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:24.892556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f5c4aa51-0a9c-482d-ae7d-6fd41c6b3082 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:24.958007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f5c4aa51-0a9c-482d-ae7d-6fd41c6b3082 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:24.966088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f5c4aa51-0a9c-482d-ae7d-6fd41c6b3082 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086750 Jul 28 20:26:24.966636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1399/2940] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:24 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:25.083516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-94ffabb5-a374-41f9-b005-73c1ccb5d546 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:25.084153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-94ffabb5-a374-41f9-b005-73c1ccb5d546 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:25.090822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94ffabb5-a374-41f9-b005-73c1ccb5d546 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:25.091278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94ffabb5-a374-41f9-b005-73c1ccb5d546 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:25.092026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94ffabb5-a374-41f9-b005-73c1ccb5d546 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:25.092455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-94ffabb5-a374-41f9-b005-73c1ccb5d546 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:25.219279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-94ffabb5-a374-41f9-b005-73c1ccb5d546 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:25.227224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-94ffabb5-a374-41f9-b005-73c1ccb5d546 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147638 Jul 28 20:26:25.228373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1542/2941] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:25 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:25.987068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c73cc606-ea33-43f8-a5a1-ce4dde996357 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:25.987679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c73cc606-ea33-43f8-a5a1-ce4dde996357 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:25.990086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:25.996282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c73cc606-ea33-43f8-a5a1-ce4dde996357 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:25.996784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c73cc606-ea33-43f8-a5a1-ce4dde996357 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:25.997573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c73cc606-ea33-43f8-a5a1-ce4dde996357 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:25.998006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c73cc606-ea33-43f8-a5a1-ce4dde996357 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:26.060425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c73cc606-ea33-43f8-a5a1-ce4dde996357 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:26.068363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c73cc606-ea33-43f8-a5a1-ce4dde996357 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085099 Jul 28 20:26:26.068948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1400/2942] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:25 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:26.249593 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b2813928-2a16-471a-b577-f26914b5eb18 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:26.250157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b2813928-2a16-471a-b577-f26914b5eb18 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:26.256624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2813928-2a16-471a-b577-f26914b5eb18 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:26.257079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2813928-2a16-471a-b577-f26914b5eb18 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:26.257829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2813928-2a16-471a-b577-f26914b5eb18 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:26.258266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b2813928-2a16-471a-b577-f26914b5eb18 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:26.388884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b2813928-2a16-471a-b577-f26914b5eb18 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:26.396802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b2813928-2a16-471a-b577-f26914b5eb18 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151047 Jul 28 20:26:26.397360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1543/2943] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:26 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:27.090912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b6c633e-8dcd-477c-bf8e-b663b158a622 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:27.091556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b6c633e-8dcd-477c-bf8e-b663b158a622 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:27.098124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b6c633e-8dcd-477c-bf8e-b663b158a622 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:27.098596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b6c633e-8dcd-477c-bf8e-b663b158a622 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:27.099345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b6c633e-8dcd-477c-bf8e-b663b158a622 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:27.099778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b6c633e-8dcd-477c-bf8e-b663b158a622 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:27.161201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b6c633e-8dcd-477c-bf8e-b663b158a622 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:27.169939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b6c633e-8dcd-477c-bf8e-b663b158a622 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083943 Jul 28 20:26:27.170511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1401/2944] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:27 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:27.418727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fce15e2f-03b1-4297-b9ad-42b4c45182a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:27.419295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fce15e2f-03b1-4297-b9ad-42b4c45182a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:27.425727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fce15e2f-03b1-4297-b9ad-42b4c45182a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:27.426174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fce15e2f-03b1-4297-b9ad-42b4c45182a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:27.426926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fce15e2f-03b1-4297-b9ad-42b4c45182a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:27.427354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fce15e2f-03b1-4297-b9ad-42b4c45182a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:27.555392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fce15e2f-03b1-4297-b9ad-42b4c45182a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:27.564032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fce15e2f-03b1-4297-b9ad-42b4c45182a2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149781 Jul 28 20:26:27.564608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1544/2945] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:27 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:28.191061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-95556b8c-01f6-46fd-89d3-43ba7b94d293 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:28.191670 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-95556b8c-01f6-46fd-89d3-43ba7b94d293 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:28.199101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95556b8c-01f6-46fd-89d3-43ba7b94d293 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:28.199548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95556b8c-01f6-46fd-89d3-43ba7b94d293 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:28.200294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95556b8c-01f6-46fd-89d3-43ba7b94d293 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:28.200758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95556b8c-01f6-46fd-89d3-43ba7b94d293 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:28.219104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:28.264696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-95556b8c-01f6-46fd-89d3-43ba7b94d293 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:28.272581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-95556b8c-01f6-46fd-89d3-43ba7b94d293 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085332 Jul 28 20:26:28.273142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1402/2946] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:28 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:28.584849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f59c20f0-aa28-4320-9d40-38c805759e0d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:28.585458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f59c20f0-aa28-4320-9d40-38c805759e0d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:28.587826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:28.593844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f59c20f0-aa28-4320-9d40-38c805759e0d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:28.594296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f59c20f0-aa28-4320-9d40-38c805759e0d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:28.595051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f59c20f0-aa28-4320-9d40-38c805759e0d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:28.595483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f59c20f0-aa28-4320-9d40-38c805759e0d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:28.723369 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f59c20f0-aa28-4320-9d40-38c805759e0d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:28.731763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f59c20f0-aa28-4320-9d40-38c805759e0d tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150747 Jul 28 20:26:28.732332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1545/2947] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:28 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:29.294988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b86bfb70-0b63-4828-bfce-44151689e70a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:29.295638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b86bfb70-0b63-4828-bfce-44151689e70a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:29.302135 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b86bfb70-0b63-4828-bfce-44151689e70a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:29.302577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b86bfb70-0b63-4828-bfce-44151689e70a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:29.303323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b86bfb70-0b63-4828-bfce-44151689e70a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:29.303753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b86bfb70-0b63-4828-bfce-44151689e70a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:29.364898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b86bfb70-0b63-4828-bfce-44151689e70a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:29.372853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b86bfb70-0b63-4828-bfce-44151689e70a tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082284 Jul 28 20:26:29.373405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1403/2948] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:29 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:29.752530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e9181398-7caa-4091-9e36-57cff4914bf7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:29.753275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e9181398-7caa-4091-9e36-57cff4914bf7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:29.760011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9181398-7caa-4091-9e36-57cff4914bf7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:29.760455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9181398-7caa-4091-9e36-57cff4914bf7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:29.761230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9181398-7caa-4091-9e36-57cff4914bf7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:29.761652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9181398-7caa-4091-9e36-57cff4914bf7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:29.896094 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e9181398-7caa-4091-9e36-57cff4914bf7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:29.904966 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e9181398-7caa-4091-9e36-57cff4914bf7 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.156208 Jul 28 20:26:29.905508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1546/2949] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:29 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:30.396530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7492054f-ecbb-47b2-bfa6-9931269b5fca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:30.397156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7492054f-ecbb-47b2-bfa6-9931269b5fca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:30.403965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7492054f-ecbb-47b2-bfa6-9931269b5fca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:30.404408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7492054f-ecbb-47b2-bfa6-9931269b5fca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:30.405192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7492054f-ecbb-47b2-bfa6-9931269b5fca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:30.405623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7492054f-ecbb-47b2-bfa6-9931269b5fca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:30.473320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7492054f-ecbb-47b2-bfa6-9931269b5fca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:30.481886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7492054f-ecbb-47b2-bfa6-9931269b5fca tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.089229 Jul 28 20:26:30.482438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1404/2950] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:30 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:30.926040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cd26492f-1368-4d39-9cd1-b033271d6da6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:30.926651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cd26492f-1368-4d39-9cd1-b033271d6da6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:30.934104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd26492f-1368-4d39-9cd1-b033271d6da6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:30.934546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd26492f-1368-4d39-9cd1-b033271d6da6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:30.935292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd26492f-1368-4d39-9cd1-b033271d6da6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:30.935719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd26492f-1368-4d39-9cd1-b033271d6da6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:31.064388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cd26492f-1368-4d39-9cd1-b033271d6da6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:31.067764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:31.073744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cd26492f-1368-4d39-9cd1-b033271d6da6 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.151542 Jul 28 20:26:31.074299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1547/2951] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:30 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:31.502993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fa76a452-2034-42ec-978a-c8580e18ad64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:31.503605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fa76a452-2034-42ec-978a-c8580e18ad64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:31.509861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa76a452-2034-42ec-978a-c8580e18ad64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:31.510300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa76a452-2034-42ec-978a-c8580e18ad64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:31.511038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa76a452-2034-42ec-978a-c8580e18ad64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:31.511464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fa76a452-2034-42ec-978a-c8580e18ad64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:31.575265 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fa76a452-2034-42ec-978a-c8580e18ad64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:31.583100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fa76a452-2034-42ec-978a-c8580e18ad64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.083951 Jul 28 20:26:31.583647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1405/2952] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:31 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:32.096478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-18a6649c-18bb-43dc-bf09-334e109cef82 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:32.097113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-18a6649c-18bb-43dc-bf09-334e109cef82 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:32.104366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18a6649c-18bb-43dc-bf09-334e109cef82 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:32.104832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18a6649c-18bb-43dc-bf09-334e109cef82 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:32.105580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18a6649c-18bb-43dc-bf09-334e109cef82 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:32.106008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-18a6649c-18bb-43dc-bf09-334e109cef82 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:32.234560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-18a6649c-18bb-43dc-bf09-334e109cef82 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:32.242279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-18a6649c-18bb-43dc-bf09-334e109cef82 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149997 Jul 28 20:26:32.242834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1548/2953] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:32 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:32.604870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b25ab0d6-9c42-40ad-857d-793ef5db3d93 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:32.605512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b25ab0d6-9c42-40ad-857d-793ef5db3d93 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:32.611910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b25ab0d6-9c42-40ad-857d-793ef5db3d93 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:32.612356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b25ab0d6-9c42-40ad-857d-793ef5db3d93 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:32.613140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b25ab0d6-9c42-40ad-857d-793ef5db3d93 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:32.613573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b25ab0d6-9c42-40ad-857d-793ef5db3d93 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:32.677174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b25ab0d6-9c42-40ad-857d-793ef5db3d93 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:32.685121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b25ab0d6-9c42-40ad-857d-793ef5db3d93 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084715 Jul 28 20:26:32.685702 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1406/2954] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:32 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:33.263777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-084f31c7-7dd6-41f1-82b2-5d7c1bfc8afb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:33.264375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-084f31c7-7dd6-41f1-82b2-5d7c1bfc8afb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:33.270613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-084f31c7-7dd6-41f1-82b2-5d7c1bfc8afb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:33.271052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-084f31c7-7dd6-41f1-82b2-5d7c1bfc8afb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:33.271791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-084f31c7-7dd6-41f1-82b2-5d7c1bfc8afb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:33.272211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-084f31c7-7dd6-41f1-82b2-5d7c1bfc8afb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:33.403485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-084f31c7-7dd6-41f1-82b2-5d7c1bfc8afb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:33.411310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-084f31c7-7dd6-41f1-82b2-5d7c1bfc8afb tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152074 Jul 28 20:26:33.411862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1549/2955] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:33 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:33.707177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a26a3059-b9e3-4269-bb36-04d93f0e2e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:33.707764 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a26a3059-b9e3-4269-bb36-04d93f0e2e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:33.714525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a26a3059-b9e3-4269-bb36-04d93f0e2e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:33.714967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a26a3059-b9e3-4269-bb36-04d93f0e2e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:33.715721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a26a3059-b9e3-4269-bb36-04d93f0e2e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:33.716154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a26a3059-b9e3-4269-bb36-04d93f0e2e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:33.776089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a26a3059-b9e3-4269-bb36-04d93f0e2e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:33.784260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a26a3059-b9e3-4269-bb36-04d93f0e2e83 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081073 Jul 28 20:26:33.784854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1407/2956] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:33 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:34.433091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b9ffef07-ff59-440f-9f26-3c74d04c46ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:34.433705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b9ffef07-ff59-440f-9f26-3c74d04c46ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:34.440181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9ffef07-ff59-440f-9f26-3c74d04c46ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:34.440657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9ffef07-ff59-440f-9f26-3c74d04c46ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:34.441414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9ffef07-ff59-440f-9f26-3c74d04c46ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:34.441844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b9ffef07-ff59-440f-9f26-3c74d04c46ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:34.570796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b9ffef07-ff59-440f-9f26-3c74d04c46ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:34.578724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b9ffef07-ff59-440f-9f26-3c74d04c46ec tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150052 Jul 28 20:26:34.579276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1550/2957] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:34 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:34.805260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b65b4561-1a31-4033-a6d7-daa9c3c32aaf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:34.805805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b65b4561-1a31-4033-a6d7-daa9c3c32aaf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:34.812921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b65b4561-1a31-4033-a6d7-daa9c3c32aaf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:34.813364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b65b4561-1a31-4033-a6d7-daa9c3c32aaf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:34.814109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b65b4561-1a31-4033-a6d7-daa9c3c32aaf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:34.814543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b65b4561-1a31-4033-a6d7-daa9c3c32aaf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:34.877987 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b65b4561-1a31-4033-a6d7-daa9c3c32aaf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:34.885951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b65b4561-1a31-4033-a6d7-daa9c3c32aaf tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084592 Jul 28 20:26:34.886505 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1408/2958] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:34 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:35.599870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7df7bd1e-ec4e-4506-afab-9315cdac45a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:35.600466 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7df7bd1e-ec4e-4506-afab-9315cdac45a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:35.607018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7df7bd1e-ec4e-4506-afab-9315cdac45a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:35.607462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7df7bd1e-ec4e-4506-afab-9315cdac45a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:35.608208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7df7bd1e-ec4e-4506-afab-9315cdac45a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:35.608675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7df7bd1e-ec4e-4506-afab-9315cdac45a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:35.734487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7df7bd1e-ec4e-4506-afab-9315cdac45a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:35.742329 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7df7bd1e-ec4e-4506-afab-9315cdac45a0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.146421 Jul 28 20:26:35.742892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1551/2959] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:35 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:35.907246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c4f1b57f-542e-4676-b4fc-84fd73b44e18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:35.907790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c4f1b57f-542e-4676-b4fc-84fd73b44e18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:35.914252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4f1b57f-542e-4676-b4fc-84fd73b44e18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:35.914694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4f1b57f-542e-4676-b4fc-84fd73b44e18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:35.915596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4f1b57f-542e-4676-b4fc-84fd73b44e18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:35.916145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c4f1b57f-542e-4676-b4fc-84fd73b44e18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:35.980918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c4f1b57f-542e-4676-b4fc-84fd73b44e18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:35.988890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c4f1b57f-542e-4676-b4fc-84fd73b44e18 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.085541 Jul 28 20:26:35.989459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1409/2960] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:35 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:36.763247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a40969b6-592a-450c-8672-315e297662bc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:36.763804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a40969b6-592a-450c-8672-315e297662bc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:36.770223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a40969b6-592a-450c-8672-315e297662bc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:36.770666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a40969b6-592a-450c-8672-315e297662bc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:36.771414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a40969b6-592a-450c-8672-315e297662bc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:36.771842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a40969b6-592a-450c-8672-315e297662bc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:36.904138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a40969b6-592a-450c-8672-315e297662bc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:36.912000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a40969b6-592a-450c-8672-315e297662bc tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152716 Jul 28 20:26:36.912587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1552/2961] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:36 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:37.011004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-34d63f34-9736-40ab-afa8-a21cbe24665b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:37.011610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-34d63f34-9736-40ab-afa8-a21cbe24665b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:37.018067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34d63f34-9736-40ab-afa8-a21cbe24665b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:37.018454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34d63f34-9736-40ab-afa8-a21cbe24665b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:37.019195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34d63f34-9736-40ab-afa8-a21cbe24665b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:37.019621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34d63f34-9736-40ab-afa8-a21cbe24665b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:37.081193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-34d63f34-9736-40ab-afa8-a21cbe24665b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:37.089111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-34d63f34-9736-40ab-afa8-a21cbe24665b tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082658 Jul 28 20:26:37.089667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1410/2962] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:37 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:37.933706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3391b3bf-515a-436b-a930-8d352215ac1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:37.934264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3391b3bf-515a-436b-a930-8d352215ac1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:37.940787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3391b3bf-515a-436b-a930-8d352215ac1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:37.941237 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3391b3bf-515a-436b-a930-8d352215ac1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:37.941996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3391b3bf-515a-436b-a930-8d352215ac1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:37.942430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3391b3bf-515a-436b-a930-8d352215ac1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:38.068323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3391b3bf-515a-436b-a930-8d352215ac1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:38.076831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3391b3bf-515a-436b-a930-8d352215ac1c tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.147775 Jul 28 20:26:38.077395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1553/2963] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:37 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:38.109732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6fcbdabd-80ab-40d4-9dbb-75a49f3a812f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:38.110334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6fcbdabd-80ab-40d4-9dbb-75a49f3a812f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:38.116734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fcbdabd-80ab-40d4-9dbb-75a49f3a812f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:38.117178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fcbdabd-80ab-40d4-9dbb-75a49f3a812f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:38.117917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fcbdabd-80ab-40d4-9dbb-75a49f3a812f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:38.118561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6fcbdabd-80ab-40d4-9dbb-75a49f3a812f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:38.184140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6fcbdabd-80ab-40d4-9dbb-75a49f3a812f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:38.192047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6fcbdabd-80ab-40d4-9dbb-75a49f3a812f tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086138 Jul 28 20:26:38.192610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1411/2964] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:38 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:39.097764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-90caaa58-0738-4d06-a9a5-1be84c1a70d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:39.098360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-90caaa58-0738-4d06-a9a5-1be84c1a70d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:39.105680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90caaa58-0738-4d06-a9a5-1be84c1a70d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:39.106127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90caaa58-0738-4d06-a9a5-1be84c1a70d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:39.106877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90caaa58-0738-4d06-a9a5-1be84c1a70d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:39.107309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-90caaa58-0738-4d06-a9a5-1be84c1a70d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:39.214278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0f0f95ab-4aca-4d0e-8d55-9578bbf1d9a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:39.215054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0f0f95ab-4aca-4d0e-8d55-9578bbf1d9a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:39.222174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f0f95ab-4aca-4d0e-8d55-9578bbf1d9a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:39.222174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f0f95ab-4aca-4d0e-8d55-9578bbf1d9a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:39.222971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f0f95ab-4aca-4d0e-8d55-9578bbf1d9a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:39.223406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0f0f95ab-4aca-4d0e-8d55-9578bbf1d9a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:39.249764 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-90caaa58-0738-4d06-a9a5-1be84c1a70d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:39.257742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-90caaa58-0738-4d06-a9a5-1be84c1a70d9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.163936 Jul 28 20:26:39.258317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1554/2965] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:39 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:39.285671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0f0f95ab-4aca-4d0e-8d55-9578bbf1d9a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:39.293680 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0f0f95ab-4aca-4d0e-8d55-9578bbf1d9a4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084183 Jul 28 20:26:39.294240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1412/2966] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:39 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:40.279056 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-210e33c2-54db-45e4-81e4-42d19927ed86 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:40.279663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-210e33c2-54db-45e4-81e4-42d19927ed86 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:40.286156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-210e33c2-54db-45e4-81e4-42d19927ed86 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:40.286601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-210e33c2-54db-45e4-81e4-42d19927ed86 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:40.287345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-210e33c2-54db-45e4-81e4-42d19927ed86 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:40.287771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-210e33c2-54db-45e4-81e4-42d19927ed86 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:40.314387 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-979d25e7-b72b-4c79-ae57-12ce069fbdb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:40.314999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-979d25e7-b72b-4c79-ae57-12ce069fbdb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:40.321904 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-979d25e7-b72b-4c79-ae57-12ce069fbdb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:40.322470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-979d25e7-b72b-4c79-ae57-12ce069fbdb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:40.323654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-979d25e7-b72b-4c79-ae57-12ce069fbdb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:40.324379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-979d25e7-b72b-4c79-ae57-12ce069fbdb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:40.403914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-979d25e7-b72b-4c79-ae57-12ce069fbdb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:40.411762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-979d25e7-b72b-4c79-ae57-12ce069fbdb3 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.101210 Jul 28 20:26:40.412318 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1413/2967] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:40 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:40.440533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-210e33c2-54db-45e4-81e4-42d19927ed86 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:40.448497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-210e33c2-54db-45e4-81e4-42d19927ed86 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.173981 Jul 28 20:26:40.449079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1555/2968] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:40 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:41.433807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e5a66f87-107b-4c20-8c80-8027b1f0a7d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:41.434392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e5a66f87-107b-4c20-8c80-8027b1f0a7d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:41.441149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e5a66f87-107b-4c20-8c80-8027b1f0a7d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:41.441604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e5a66f87-107b-4c20-8c80-8027b1f0a7d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:41.442370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e5a66f87-107b-4c20-8c80-8027b1f0a7d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:41.442808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e5a66f87-107b-4c20-8c80-8027b1f0a7d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:41.469278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7fbad11d-b3c8-4ef4-a715-301bb5cdd8d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:41.469887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7fbad11d-b3c8-4ef4-a715-301bb5cdd8d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:41.476478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7fbad11d-b3c8-4ef4-a715-301bb5cdd8d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:41.476957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7fbad11d-b3c8-4ef4-a715-301bb5cdd8d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:41.477711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7fbad11d-b3c8-4ef4-a715-301bb5cdd8d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:41.478141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7fbad11d-b3c8-4ef4-a715-301bb5cdd8d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:41.503397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e5a66f87-107b-4c20-8c80-8027b1f0a7d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:41.512136 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e5a66f87-107b-4c20-8c80-8027b1f0a7d1 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082842 Jul 28 20:26:41.512747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1414/2969] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:41 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:41.607677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7fbad11d-b3c8-4ef4-a715-301bb5cdd8d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:41.615674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7fbad11d-b3c8-4ef4-a715-301bb5cdd8d3 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150237 Jul 28 20:26:41.616238 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1556/2970] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:41 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:26:42.533499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9d0dd431-3489-4340-a2b6-60f0048f4094 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:42.534104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9d0dd431-3489-4340-a2b6-60f0048f4094 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:42.540966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d0dd431-3489-4340-a2b6-60f0048f4094 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:42.541403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d0dd431-3489-4340-a2b6-60f0048f4094 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:42.542143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d0dd431-3489-4340-a2b6-60f0048f4094 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:42.542566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d0dd431-3489-4340-a2b6-60f0048f4094 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:42.604405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9d0dd431-3489-4340-a2b6-60f0048f4094 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:42.612284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9d0dd431-3489-4340-a2b6-60f0048f4094 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082723 Jul 28 20:26:42.612871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1415/2971] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:42 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:42.637398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6c50c7cc-0455-4592-828e-c7b70bfb639b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:42.638005 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6c50c7cc-0455-4592-828e-c7b70bfb639b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:42.644449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c50c7cc-0455-4592-828e-c7b70bfb639b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:42.644927 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c50c7cc-0455-4592-828e-c7b70bfb639b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:42.645675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c50c7cc-0455-4592-828e-c7b70bfb639b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:42.646105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6c50c7cc-0455-4592-828e-c7b70bfb639b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:42.772752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6c50c7cc-0455-4592-828e-c7b70bfb639b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:42.781655 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6c50c7cc-0455-4592-828e-c7b70bfb639b tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148187 Jul 28 20:26:42.782211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1557/2972] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:42 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:43.634859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5ae4df01-c57c-44e1-b341-9fa955abfa68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:43.635513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5ae4df01-c57c-44e1-b341-9fa955abfa68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:43.642043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ae4df01-c57c-44e1-b341-9fa955abfa68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:43.642495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ae4df01-c57c-44e1-b341-9fa955abfa68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:43.643252 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ae4df01-c57c-44e1-b341-9fa955abfa68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:43.643694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ae4df01-c57c-44e1-b341-9fa955abfa68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:43.703497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5ae4df01-c57c-44e1-b341-9fa955abfa68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:43.711510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5ae4df01-c57c-44e1-b341-9fa955abfa68 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081155 Jul 28 20:26:43.712181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1416/2973] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:43 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:43.803127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-814fe620-d0fc-4316-b8f9-90fe9b6eb159 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:43.803737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-814fe620-d0fc-4316-b8f9-90fe9b6eb159 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:43.811074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-814fe620-d0fc-4316-b8f9-90fe9b6eb159 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:43.811521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-814fe620-d0fc-4316-b8f9-90fe9b6eb159 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:43.812265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-814fe620-d0fc-4316-b8f9-90fe9b6eb159 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:43.812728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-814fe620-d0fc-4316-b8f9-90fe9b6eb159 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:43.944200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-814fe620-d0fc-4316-b8f9-90fe9b6eb159 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:43.952078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-814fe620-d0fc-4316-b8f9-90fe9b6eb159 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152754 Jul 28 20:26:43.952643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1558/2974] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:43 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:44.732797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d8fb0173-515d-4a84-ab53-14a2b8c5d729 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:44.733391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d8fb0173-515d-4a84-ab53-14a2b8c5d729 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:44.739708 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d8fb0173-515d-4a84-ab53-14a2b8c5d729 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:44.740147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d8fb0173-515d-4a84-ab53-14a2b8c5d729 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:44.740921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d8fb0173-515d-4a84-ab53-14a2b8c5d729 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:44.741346 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d8fb0173-515d-4a84-ab53-14a2b8c5d729 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:44.801193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d8fb0173-515d-4a84-ab53-14a2b8c5d729 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:44.808968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d8fb0173-515d-4a84-ab53-14a2b8c5d729 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080109 Jul 28 20:26:44.809519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1417/2975] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:44 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:44.973088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-efbda6b9-2a0a-43c6-a870-7ec91f9da3c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:44.973698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-efbda6b9-2a0a-43c6-a870-7ec91f9da3c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:44.980078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efbda6b9-2a0a-43c6-a870-7ec91f9da3c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:44.980518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efbda6b9-2a0a-43c6-a870-7ec91f9da3c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:44.981295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efbda6b9-2a0a-43c6-a870-7ec91f9da3c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:44.981723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efbda6b9-2a0a-43c6-a870-7ec91f9da3c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:45.110078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-efbda6b9-2a0a-43c6-a870-7ec91f9da3c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:45.117887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-efbda6b9-2a0a-43c6-a870-7ec91f9da3c0 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.148623 Jul 28 20:26:45.119241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1559/2976] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:44 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:45.830296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aa074264-8ef9-4429-b406-26cce3eb3c64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:45.830896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aa074264-8ef9-4429-b406-26cce3eb3c64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:45.838018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa074264-8ef9-4429-b406-26cce3eb3c64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:45.838455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa074264-8ef9-4429-b406-26cce3eb3c64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:45.839199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa074264-8ef9-4429-b406-26cce3eb3c64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:45.839625 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa074264-8ef9-4429-b406-26cce3eb3c64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:45.899147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aa074264-8ef9-4429-b406-26cce3eb3c64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:45.908011 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aa074264-8ef9-4429-b406-26cce3eb3c64 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081567 Jul 28 20:26:45.908577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1418/2977] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:45 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:46.139339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5f4c57f9-2c13-4214-a628-7b126dbeba07 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:46.139893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5f4c57f9-2c13-4214-a628-7b126dbeba07 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:46.146394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f4c57f9-2c13-4214-a628-7b126dbeba07 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:46.146840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f4c57f9-2c13-4214-a628-7b126dbeba07 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:46.147582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f4c57f9-2c13-4214-a628-7b126dbeba07 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:46.148025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5f4c57f9-2c13-4214-a628-7b126dbeba07 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:46.278256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5f4c57f9-2c13-4214-a628-7b126dbeba07 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:46.286103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5f4c57f9-2c13-4214-a628-7b126dbeba07 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.150698 Jul 28 20:26:46.286657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1560/2978] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:46 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:46.929803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5cdb2fba-53b2-4b10-90df-4598846adf02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:46.930424 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5cdb2fba-53b2-4b10-90df-4598846adf02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:46.937630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cdb2fba-53b2-4b10-90df-4598846adf02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:46.938085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cdb2fba-53b2-4b10-90df-4598846adf02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:46.938873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cdb2fba-53b2-4b10-90df-4598846adf02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:46.939279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5cdb2fba-53b2-4b10-90df-4598846adf02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:46.943326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:47.000294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5cdb2fba-53b2-4b10-90df-4598846adf02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:47.008178 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5cdb2fba-53b2-4b10-90df-4598846adf02 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082293 Jul 28 20:26:47.008836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1419/2979] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:46 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:47.307164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1050005d-3568-4fe1-b25e-b90d32c02e7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:47.307736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1050005d-3568-4fe1-b25e-b90d32c02e7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:47.314444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1050005d-3568-4fe1-b25e-b90d32c02e7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:47.314883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1050005d-3568-4fe1-b25e-b90d32c02e7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:47.315623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1050005d-3568-4fe1-b25e-b90d32c02e7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:47.316044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1050005d-3568-4fe1-b25e-b90d32c02e7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:47.445115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1050005d-3568-4fe1-b25e-b90d32c02e7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:47.453018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1050005d-3568-4fe1-b25e-b90d32c02e7e tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149748 Jul 28 20:26:47.453572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1561/2980] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:47 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:48.030177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-de43d985-b5b4-423f-8d60-e855cbb82f92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:48.030715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-de43d985-b5b4-423f-8d60-e855cbb82f92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:48.037221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de43d985-b5b4-423f-8d60-e855cbb82f92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:48.037662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de43d985-b5b4-423f-8d60-e855cbb82f92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:48.038405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de43d985-b5b4-423f-8d60-e855cbb82f92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:48.038827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de43d985-b5b4-423f-8d60-e855cbb82f92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:48.099286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-de43d985-b5b4-423f-8d60-e855cbb82f92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:48.107366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-de43d985-b5b4-423f-8d60-e855cbb82f92 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.082046 Jul 28 20:26:48.107918 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1420/2981] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:48 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:48.475032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0d5402e5-ee75-489a-916c-4942ec6e5c8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:48.475643 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0d5402e5-ee75-489a-916c-4942ec6e5c8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:48.482651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d5402e5-ee75-489a-916c-4942ec6e5c8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:48.483101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d5402e5-ee75-489a-916c-4942ec6e5c8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:48.483861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d5402e5-ee75-489a-916c-4942ec6e5c8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:48.484294 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0d5402e5-ee75-489a-916c-4942ec6e5c8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:48.612324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0d5402e5-ee75-489a-916c-4942ec6e5c8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:48.620986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0d5402e5-ee75-489a-916c-4942ec6e5c8f tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.149880 Jul 28 20:26:48.621563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1562/2982] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:48 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:49.064729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-64cfbc63-263e-4481-8f09-0c452948a792 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:49.065307 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-64cfbc63-263e-4481-8f09-0c452948a792 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:49.071779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64cfbc63-263e-4481-8f09-0c452948a792 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:49.072741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64cfbc63-263e-4481-8f09-0c452948a792 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:49.073495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64cfbc63-263e-4481-8f09-0c452948a792 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:49.073952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-64cfbc63-263e-4481-8f09-0c452948a792 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:49.097079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-64cfbc63-263e-4481-8f09-0c452948a792 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140/ips" status: 200 len: 149 microversion: 2.1 time: 0.036247 Jul 28 20:26:49.097628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1421/2983] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 20:26:49 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:26:49.128769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d54e1a91-7945-44ed-b163-74e0abd449b4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:49.129372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d54e1a91-7945-44ed-b163-74e0abd449b4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:49.135890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d54e1a91-7945-44ed-b163-74e0abd449b4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:49.136377 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d54e1a91-7945-44ed-b163-74e0abd449b4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:49.137146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d54e1a91-7945-44ed-b163-74e0abd449b4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:49.137570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d54e1a91-7945-44ed-b163-74e0abd449b4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:49.197968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d54e1a91-7945-44ed-b163-74e0abd449b4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:49.205794 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d54e1a91-7945-44ed-b163-74e0abd449b4 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.080855 Jul 28 20:26:49.206344 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1563/2984] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:49 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:49.642047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6520f547-5e0b-48ce-a24c-64f0e7e0acf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:49.642661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6520f547-5e0b-48ce-a24c-64f0e7e0acf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:49.648609 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6520f547-5e0b-48ce-a24c-64f0e7e0acf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:49.649053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6520f547-5e0b-48ce-a24c-64f0e7e0acf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:49.649789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6520f547-5e0b-48ce-a24c-64f0e7e0acf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:49.650216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6520f547-5e0b-48ce-a24c-64f0e7e0acf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:49.775695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6520f547-5e0b-48ce-a24c-64f0e7e0acf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:49.783859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6520f547-5e0b-48ce-a24c-64f0e7e0acf9 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.145683 Jul 28 20:26:49.784417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1422/2985] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:49 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:50.226361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-aefe0d14-9d05-468b-b2dd-ea0d421e1208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:50.227004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-aefe0d14-9d05-468b-b2dd-ea0d421e1208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:50.233239 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aefe0d14-9d05-468b-b2dd-ea0d421e1208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:50.233690 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aefe0d14-9d05-468b-b2dd-ea0d421e1208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:50.234442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aefe0d14-9d05-468b-b2dd-ea0d421e1208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:50.234877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-aefe0d14-9d05-468b-b2dd-ea0d421e1208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:50.253141 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=100 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:50.299754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-aefe0d14-9d05-468b-b2dd-ea0d421e1208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:50.308923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-aefe0d14-9d05-468b-b2dd-ea0d421e1208 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.086338 Jul 28 20:26:50.309486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1564/2986] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:50 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:50.805216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b40116d1-64c9-4feb-a451-d98dccbfcee2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:50.805952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b40116d1-64c9-4feb-a451-d98dccbfcee2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:50.812368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b40116d1-64c9-4feb-a451-d98dccbfcee2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:50.812933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b40116d1-64c9-4feb-a451-d98dccbfcee2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:50.813713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b40116d1-64c9-4feb-a451-d98dccbfcee2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:50.814142 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b40116d1-64c9-4feb-a451-d98dccbfcee2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:50.948676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b40116d1-64c9-4feb-a451-d98dccbfcee2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:50.956614 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b40116d1-64c9-4feb-a451-d98dccbfcee2 tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.155248 Jul 28 20:26:50.957176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1423/2987] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:50 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:51.329042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-72e9970d-acc4-43d7-b49c-9b5a6191b31d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:51.329656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-72e9970d-acc4-43d7-b49c-9b5a6191b31d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:51.336170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72e9970d-acc4-43d7-b49c-9b5a6191b31d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:51.336774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72e9970d-acc4-43d7-b49c-9b5a6191b31d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:51.337535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72e9970d-acc4-43d7-b49c-9b5a6191b31d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:51.337971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-72e9970d-acc4-43d7-b49c-9b5a6191b31d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:51.401347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-72e9970d-acc4-43d7-b49c-9b5a6191b31d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:51.409527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-72e9970d-acc4-43d7-b49c-9b5a6191b31d tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.084307 Jul 28 20:26:51.410119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1565/2988] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:51 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:51.980175 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5fa8991e-e61d-4604-8882-9e7b72f530cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:51.980767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5fa8991e-e61d-4604-8882-9e7b72f530cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] [instance: 768bb30f-60d9-4ad9-af77-64aadcfe531a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:51.987114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5fa8991e-e61d-4604-8882-9e7b72f530cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:51.987554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5fa8991e-e61d-4604-8882-9e7b72f530cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:51.988293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5fa8991e-e61d-4604-8882-9e7b72f530cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:51.988759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5fa8991e-e61d-4604-8882-9e7b72f530cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:52.117966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5fa8991e-e61d-4604-8882-9e7b72f530cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '316033501d684cc680770c4ccda85d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc82c1496470409ca70c8cc12023a91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:52.126330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5fa8991e-e61d-4604-8882-9e7b72f530cd tempest-VolumesSnapshotTestJSON-1367459192 tempest-VolumesSnapshotTestJSON-1367459192-project] 10.222.0.67 "GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a" status: 200 len: 1560 microversion: 2.1 time: 0.152115 Jul 28 20:26:52.126887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1424/2989] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:51 2022] GET /compute/v2.1/servers/768bb30f-60d9-4ad9-af77-64aadcfe531a => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:52.431059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-635817b5-e1f9-4170-b6d0-3d1a771c5527 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:52.432376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-635817b5-e1f9-4170-b6d0-3d1a771c5527 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] [instance: ed7c90e0-e87c-42b9-b14d-6c06761c1eef] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:52.438985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-635817b5-e1f9-4170-b6d0-3d1a771c5527 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:52.439498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-635817b5-e1f9-4170-b6d0-3d1a771c5527 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:52.440196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-635817b5-e1f9-4170-b6d0-3d1a771c5527 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:52.440687 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-635817b5-e1f9-4170-b6d0-3d1a771c5527 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:52.500910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-635817b5-e1f9-4170-b6d0-3d1a771c5527 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7d1d13bfb843df855bc4d57374a8ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a73bb1237bb4bcfa86aa6dc5bf413c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:52.508730 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-635817b5-e1f9-4170-b6d0-3d1a771c5527 tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef" status: 200 len: 1388 microversion: 2.1 time: 0.081556 Jul 28 20:26:52.509300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1566/2990] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:52 2022] GET /compute/v2.1/servers/ed7c90e0-e87c-42b9-b14d-6c06761c1eef => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:52.530884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f226f525-5658-427d-9131-121da2496b6c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] Calling method '.version_select at 0x7f5036febf70>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:52.550465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f226f525-5658-427d-9131-121da2496b6c tempest-TestMinimumBasicScenario-569454584 tempest-TestMinimumBasicScenario-569454584-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-274658827" status: 202 len: 0 microversion: 2.1 time: 0.023664 Jul 28 20:26:52.551036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1425/2991] 10.222.0.67 () {58 vars in 1269 bytes} [Thu Jul 28 20:26:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-274658827 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:26:53.894072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b65b57bc-4d3d-418b-b18a-142a6ce87221 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:53.895559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b65b57bc-4d3d-418b-b18a-142a6ce87221 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:53.904704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b65b57bc-4d3d-418b-b18a-142a6ce87221 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:53.905502 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b65b57bc-4d3d-418b-b18a-142a6ce87221 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:53.906371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b65b57bc-4d3d-418b-b18a-142a6ce87221 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:53.906861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b65b57bc-4d3d-418b-b18a-142a6ce87221 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:53.939248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b65b57bc-4d3d-418b-b18a-142a6ce87221 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Going to try to terminate instance {{(pid=117969) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:26:54.021910 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b65b57bc-4d3d-418b-b18a-142a6ce87221 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 204 len: 0 microversion: 2.1 time: 0.131582 Jul 28 20:26:54.022731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1567/2992] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:26:53 2022] DELETE /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:26:54.033289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e23cf101-8959-48b0-a7fd-7c0f8e0ebe36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:54.033886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e23cf101-8959-48b0-a7fd-7c0f8e0ebe36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:54.039962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e23cf101-8959-48b0-a7fd-7c0f8e0ebe36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:54.040438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e23cf101-8959-48b0-a7fd-7c0f8e0ebe36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:54.042012 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e23cf101-8959-48b0-a7fd-7c0f8e0ebe36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:54.042663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e23cf101-8959-48b0-a7fd-7c0f8e0ebe36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:54.233114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e23cf101-8959-48b0-a7fd-7c0f8e0ebe36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:54.241519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e23cf101-8959-48b0-a7fd-7c0f8e0ebe36 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.213762 Jul 28 20:26:54.242087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1426/2993] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:55.263924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-58cf24ed-2378-4c52-b220-0f0230807b6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:55.264781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-58cf24ed-2378-4c52-b220-0f0230807b6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:55.271580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58cf24ed-2378-4c52-b220-0f0230807b6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:55.272132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58cf24ed-2378-4c52-b220-0f0230807b6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:55.273037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58cf24ed-2378-4c52-b220-0f0230807b6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:55.273743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-58cf24ed-2378-4c52-b220-0f0230807b6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:55.480426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-58cf24ed-2378-4c52-b220-0f0230807b6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:55.490038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-58cf24ed-2378-4c52-b220-0f0230807b6d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.231222 Jul 28 20:26:55.500605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1568/2994] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:55 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:56.517706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2757f2b7-58af-4772-bccc-67e610368f48 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:56.518337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2757f2b7-58af-4772-bccc-67e610368f48 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:56.522023 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:26:56.531813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2757f2b7-58af-4772-bccc-67e610368f48 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:56.532490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2757f2b7-58af-4772-bccc-67e610368f48 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:56.533297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2757f2b7-58af-4772-bccc-67e610368f48 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:56.533916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2757f2b7-58af-4772-bccc-67e610368f48 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:56.719380 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2757f2b7-58af-4772-bccc-67e610368f48 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:56.728687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2757f2b7-58af-4772-bccc-67e610368f48 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.220563 Jul 28 20:26:56.730135 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1427/2995] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:57.751634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b1dce897-2522-446f-893c-d958d077ebb5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:57.752942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b1dce897-2522-446f-893c-d958d077ebb5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:57.759667 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b1dce897-2522-446f-893c-d958d077ebb5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:57.760947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b1dce897-2522-446f-893c-d958d077ebb5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:57.761873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b1dce897-2522-446f-893c-d958d077ebb5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:57.762454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b1dce897-2522-446f-893c-d958d077ebb5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:57.998012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b1dce897-2522-446f-893c-d958d077ebb5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:58.006465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b1dce897-2522-446f-893c-d958d077ebb5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.259006 Jul 28 20:26:58.006960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1569/2996] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:26:59.030126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7f64c274-befc-47ea-973e-b2ca38d49d55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:26:59.030815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7f64c274-befc-47ea-973e-b2ca38d49d55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:26:59.037288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f64c274-befc-47ea-973e-b2ca38d49d55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:59.037783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f64c274-befc-47ea-973e-b2ca38d49d55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:59.038550 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f64c274-befc-47ea-973e-b2ca38d49d55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:26:59.039004 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7f64c274-befc-47ea-973e-b2ca38d49d55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:26:59.176192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7f64c274-befc-47ea-973e-b2ca38d49d55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:26:59.185079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7f64c274-befc-47ea-973e-b2ca38d49d55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.160126 Jul 28 20:26:59.185649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1428/2997] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:26:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:00.207247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dc206868-201e-4b4c-8017-10e4c5d0d7ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:00.207855 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dc206868-201e-4b4c-8017-10e4c5d0d7ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:00.210360 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:27:00.216152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc206868-201e-4b4c-8017-10e4c5d0d7ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:00.216613 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc206868-201e-4b4c-8017-10e4c5d0d7ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:00.217367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc206868-201e-4b4c-8017-10e4c5d0d7ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:00.217787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dc206868-201e-4b4c-8017-10e4c5d0d7ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:00.404902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dc206868-201e-4b4c-8017-10e4c5d0d7ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:00.412887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dc206868-201e-4b4c-8017-10e4c5d0d7ef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.209390 Jul 28 20:27:00.413438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1570/2998] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:01.434504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0514aa32-b750-4d3f-8855-83b02b05b0e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:01.435105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0514aa32-b750-4d3f-8855-83b02b05b0e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:01.441295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0514aa32-b750-4d3f-8855-83b02b05b0e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:01.441738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0514aa32-b750-4d3f-8855-83b02b05b0e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:01.442485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0514aa32-b750-4d3f-8855-83b02b05b0e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:01.442916 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0514aa32-b750-4d3f-8855-83b02b05b0e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:01.575231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0514aa32-b750-4d3f-8855-83b02b05b0e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:01.583185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0514aa32-b750-4d3f-8855-83b02b05b0e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153086 Jul 28 20:27:01.583742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1429/2999] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:02.606296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d26b510c-e4bd-4b04-bfa9-dda4ccbbaa4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:02.606907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d26b510c-e4bd-4b04-bfa9-dda4ccbbaa4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:02.616858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d26b510c-e4bd-4b04-bfa9-dda4ccbbaa4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:02.617633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d26b510c-e4bd-4b04-bfa9-dda4ccbbaa4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:02.619260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d26b510c-e4bd-4b04-bfa9-dda4ccbbaa4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:02.620065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d26b510c-e4bd-4b04-bfa9-dda4ccbbaa4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:02.761825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d26b510c-e4bd-4b04-bfa9-dda4ccbbaa4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:02.770109 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d26b510c-e4bd-4b04-bfa9-dda4ccbbaa4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.168560 Jul 28 20:27:02.770680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1571/3000] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:02 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:03.792667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bd7865f5-24ed-45d6-a14b-08a1f93d5403 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:03.794262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bd7865f5-24ed-45d6-a14b-08a1f93d5403 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:03.802198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bd7865f5-24ed-45d6-a14b-08a1f93d5403 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:03.802742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bd7865f5-24ed-45d6-a14b-08a1f93d5403 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:03.803749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bd7865f5-24ed-45d6-a14b-08a1f93d5403 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:03.804176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bd7865f5-24ed-45d6-a14b-08a1f93d5403 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:03.950575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bd7865f5-24ed-45d6-a14b-08a1f93d5403 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:03.961651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bd7865f5-24ed-45d6-a14b-08a1f93d5403 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.173947 Jul 28 20:27:03.962481 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1430/3001] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:04.987719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9bf24633-f186-4863-a62c-f8da66e78611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:04.989705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9bf24633-f186-4863-a62c-f8da66e78611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:05.010206 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bf24633-f186-4863-a62c-f8da66e78611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:05.010964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bf24633-f186-4863-a62c-f8da66e78611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:05.012196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bf24633-f186-4863-a62c-f8da66e78611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:05.012762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9bf24633-f186-4863-a62c-f8da66e78611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:05.201376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9bf24633-f186-4863-a62c-f8da66e78611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:05.213851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9bf24633-f186-4863-a62c-f8da66e78611 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.232081 Jul 28 20:27:05.223920 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1572/3002] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:06.237109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-63e44cdc-22c1-4e88-9a50-cc0a017c18df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:06.237806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-63e44cdc-22c1-4e88-9a50-cc0a017c18df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:06.245202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63e44cdc-22c1-4e88-9a50-cc0a017c18df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:06.245714 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63e44cdc-22c1-4e88-9a50-cc0a017c18df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:06.246740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63e44cdc-22c1-4e88-9a50-cc0a017c18df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:06.247389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63e44cdc-22c1-4e88-9a50-cc0a017c18df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:06.452227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-63e44cdc-22c1-4e88-9a50-cc0a017c18df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:06.464398 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-63e44cdc-22c1-4e88-9a50-cc0a017c18df tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.230942 Jul 28 20:27:06.465632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1431/3003] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:07.486259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e40a6e66-538c-4eeb-80e8-9b05ab897978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:07.486876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e40a6e66-538c-4eeb-80e8-9b05ab897978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:07.494217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e40a6e66-538c-4eeb-80e8-9b05ab897978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:07.494217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e40a6e66-538c-4eeb-80e8-9b05ab897978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:07.495450 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e40a6e66-538c-4eeb-80e8-9b05ab897978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:07.495892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e40a6e66-538c-4eeb-80e8-9b05ab897978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:07.754756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e40a6e66-538c-4eeb-80e8-9b05ab897978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:07.765843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e40a6e66-538c-4eeb-80e8-9b05ab897978 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.283695 Jul 28 20:27:07.767181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1573/3004] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:08.793438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a0bc8beb-0072-483b-8e2a-807305d0a132 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:08.794849 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a0bc8beb-0072-483b-8e2a-807305d0a132 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:08.802247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0bc8beb-0072-483b-8e2a-807305d0a132 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:08.802963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0bc8beb-0072-483b-8e2a-807305d0a132 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:08.803906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0bc8beb-0072-483b-8e2a-807305d0a132 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:08.805483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a0bc8beb-0072-483b-8e2a-807305d0a132 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:09.063244 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a0bc8beb-0072-483b-8e2a-807305d0a132 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:09.073575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a0bc8beb-0072-483b-8e2a-807305d0a132 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.288644 Jul 28 20:27:09.092459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1432/3005] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:10.097421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d50055a1-a35e-4a48-afc4-54f663729540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:10.100902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d50055a1-a35e-4a48-afc4-54f663729540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:10.114576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d50055a1-a35e-4a48-afc4-54f663729540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:10.115416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d50055a1-a35e-4a48-afc4-54f663729540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:10.116594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d50055a1-a35e-4a48-afc4-54f663729540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:10.117233 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d50055a1-a35e-4a48-afc4-54f663729540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:10.396240 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d50055a1-a35e-4a48-afc4-54f663729540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:10.406436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d50055a1-a35e-4a48-afc4-54f663729540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.315326 Jul 28 20:27:10.407277 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1574/3006] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:11.429439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-96f00a5e-fb1c-43c0-a6ec-ffd383e58d45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:11.430116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-96f00a5e-fb1c-43c0-a6ec-ffd383e58d45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:11.439675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96f00a5e-fb1c-43c0-a6ec-ffd383e58d45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:11.440124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96f00a5e-fb1c-43c0-a6ec-ffd383e58d45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:11.440934 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96f00a5e-fb1c-43c0-a6ec-ffd383e58d45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:11.441741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-96f00a5e-fb1c-43c0-a6ec-ffd383e58d45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:11.574935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9f3675db-57c1-49eb-b3a2-233ab12c9880 tempest-TestVolumeBootPattern-335270863 tempest-TestVolumeBootPattern-335270863-project] Action: 'create', calling method: .version_select at 0x7f5036f7fdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1073186432", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7QpQNIzIvoDScYvTtxv9kKSnUlScN5oCiRA2V4p3m0+M4WjY2FSa22IFhapUGwQKaFR+6JSCl6RPY31shisIcHh/D+mwX7u7rI3futdqeB0Wg4NbIpbmqQOFvzMbWdXA=="}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:27:11.591134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-9f3675db-57c1-49eb-b3a2-233ab12c9880 tempest-TestVolumeBootPattern-335270863 tempest-TestVolumeBootPattern-335270863-project] Getting quotas for project 7d2492ba9cae40f083904fdbf20c20a4. Resources: {'key_pairs'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:27:11.595188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-9f3675db-57c1-49eb-b3a2-233ab12c9880 tempest-TestVolumeBootPattern-335270863 tempest-TestVolumeBootPattern-335270863-project] Getting quotas for user dab2b4579b204cc98f2cfbed5f082387 and project 7d2492ba9cae40f083904fdbf20c20a4. Resources: {'key_pairs'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:27:11.600266 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-96f00a5e-fb1c-43c0-a6ec-ffd383e58d45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:11.608992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-96f00a5e-fb1c-43c0-a6ec-ffd383e58d45 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.184493 Jul 28 20:27:11.609743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1575/3007] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:27:11.620888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9f3675db-57c1-49eb-b3a2-233ab12c9880 tempest-TestVolumeBootPattern-335270863 tempest-TestVolumeBootPattern-335270863-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.234190 Jul 28 20:27:11.621472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1433/3008] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:27:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:27:12.632600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3977decb-d440-4910-8c44-00dd8efc164d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:12.633391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3977decb-d440-4910-8c44-00dd8efc164d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:12.641397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3977decb-d440-4910-8c44-00dd8efc164d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:12.642205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3977decb-d440-4910-8c44-00dd8efc164d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:12.643292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3977decb-d440-4910-8c44-00dd8efc164d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:12.644107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3977decb-d440-4910-8c44-00dd8efc164d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:12.843418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3977decb-d440-4910-8c44-00dd8efc164d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:12.851912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3977decb-d440-4910-8c44-00dd8efc164d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.223250 Jul 28 20:27:12.852533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1576/3009] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:13.874256 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2dc1b5cc-80bb-458a-ab6a-960f0d20da58 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:13.874983 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2dc1b5cc-80bb-458a-ab6a-960f0d20da58 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:13.882218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2dc1b5cc-80bb-458a-ab6a-960f0d20da58 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:13.882676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2dc1b5cc-80bb-458a-ab6a-960f0d20da58 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:13.883440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2dc1b5cc-80bb-458a-ab6a-960f0d20da58 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:13.883879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2dc1b5cc-80bb-458a-ab6a-960f0d20da58 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:14.014094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2dc1b5cc-80bb-458a-ab6a-960f0d20da58 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:14.022463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2dc1b5cc-80bb-458a-ab6a-960f0d20da58 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152088 Jul 28 20:27:14.023122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1434/3010] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:15.045119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f6487a06-8b31-433a-bb7b-9676cbdd6976 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:15.045733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f6487a06-8b31-433a-bb7b-9676cbdd6976 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:15.052722 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6487a06-8b31-433a-bb7b-9676cbdd6976 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:15.053175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6487a06-8b31-433a-bb7b-9676cbdd6976 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:15.053942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6487a06-8b31-433a-bb7b-9676cbdd6976 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:15.054373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f6487a06-8b31-433a-bb7b-9676cbdd6976 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:15.191904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f6487a06-8b31-433a-bb7b-9676cbdd6976 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:15.200918 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f6487a06-8b31-433a-bb7b-9676cbdd6976 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.160076 Jul 28 20:27:15.204728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1577/3011] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:16.222275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e9cad5ac-6b5d-4890-9758-19ed01f21448 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:16.222906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e9cad5ac-6b5d-4890-9758-19ed01f21448 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:16.229749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9cad5ac-6b5d-4890-9758-19ed01f21448 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:16.230184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9cad5ac-6b5d-4890-9758-19ed01f21448 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:16.230928 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9cad5ac-6b5d-4890-9758-19ed01f21448 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:16.231356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9cad5ac-6b5d-4890-9758-19ed01f21448 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:16.367291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e9cad5ac-6b5d-4890-9758-19ed01f21448 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:16.377090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e9cad5ac-6b5d-4890-9758-19ed01f21448 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158754 Jul 28 20:27:16.377847 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1435/3012] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:17.398815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5acafef3-f977-40f9-9024-c8ec1b941025 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:17.399481 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5acafef3-f977-40f9-9024-c8ec1b941025 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:17.406840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5acafef3-f977-40f9-9024-c8ec1b941025 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:17.407287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5acafef3-f977-40f9-9024-c8ec1b941025 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:17.408042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5acafef3-f977-40f9-9024-c8ec1b941025 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:17.408507 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5acafef3-f977-40f9-9024-c8ec1b941025 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:17.542508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5acafef3-f977-40f9-9024-c8ec1b941025 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:17.550477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5acafef3-f977-40f9-9024-c8ec1b941025 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155557 Jul 28 20:27:17.551036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1578/3013] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:18.573489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-938a5520-af4b-4d7b-92e7-9f0d6fa30e6f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:18.574005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-938a5520-af4b-4d7b-92e7-9f0d6fa30e6f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:18.580436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-938a5520-af4b-4d7b-92e7-9f0d6fa30e6f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:18.580910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-938a5520-af4b-4d7b-92e7-9f0d6fa30e6f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:18.581656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-938a5520-af4b-4d7b-92e7-9f0d6fa30e6f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:18.582084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-938a5520-af4b-4d7b-92e7-9f0d6fa30e6f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:18.585905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=87 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:27:18.708576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-938a5520-af4b-4d7b-92e7-9f0d6fa30e6f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:18.717337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-938a5520-af4b-4d7b-92e7-9f0d6fa30e6f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148010 Jul 28 20:27:18.717893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1436/3014] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:19.739623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-63ad31b8-6e46-4dd1-a47c-c1098efda19e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:19.740265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-63ad31b8-6e46-4dd1-a47c-c1098efda19e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:19.747678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-63ad31b8-6e46-4dd1-a47c-c1098efda19e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:19.748125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-63ad31b8-6e46-4dd1-a47c-c1098efda19e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:19.748908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-63ad31b8-6e46-4dd1-a47c-c1098efda19e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:19.749337 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-63ad31b8-6e46-4dd1-a47c-c1098efda19e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:19.767976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:27:19.887060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-63ad31b8-6e46-4dd1-a47c-c1098efda19e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:19.894997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-63ad31b8-6e46-4dd1-a47c-c1098efda19e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.159236 Jul 28 20:27:19.895555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1579/3015] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:20.918922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d9fd0eb4-27ed-4b10-9909-4d0a5d604858 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:20.919562 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d9fd0eb4-27ed-4b10-9909-4d0a5d604858 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:20.926127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eb4-27ed-4b10-9909-4d0a5d604858 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:20.926563 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eb4-27ed-4b10-9909-4d0a5d604858 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:20.927306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eb4-27ed-4b10-9909-4d0a5d604858 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:20.927731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d9fd0eb4-27ed-4b10-9909-4d0a5d604858 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:21.054934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d9fd0eb4-27ed-4b10-9909-4d0a5d604858 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:21.064731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d9fd0eb4-27ed-4b10-9909-4d0a5d604858 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150581 Jul 28 20:27:21.065299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1437/3016] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:22.089013 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-12aa4077-9ecb-488c-97be-90e56d4560b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:22.089621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-12aa4077-9ecb-488c-97be-90e56d4560b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:22.096145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12aa4077-9ecb-488c-97be-90e56d4560b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:22.096626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12aa4077-9ecb-488c-97be-90e56d4560b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:22.097366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12aa4077-9ecb-488c-97be-90e56d4560b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:22.097792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12aa4077-9ecb-488c-97be-90e56d4560b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:22.227081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-12aa4077-9ecb-488c-97be-90e56d4560b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:22.235300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-12aa4077-9ecb-488c-97be-90e56d4560b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150773 Jul 28 20:27:22.235852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1580/3017] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:22 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:23.256729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6474d9f2-2fdf-46e9-a8b3-b8799384c3f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:23.257343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6474d9f2-2fdf-46e9-a8b3-b8799384c3f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:23.259206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:27:23.265026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6474d9f2-2fdf-46e9-a8b3-b8799384c3f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:23.265483 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6474d9f2-2fdf-46e9-a8b3-b8799384c3f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:23.266237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6474d9f2-2fdf-46e9-a8b3-b8799384c3f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:23.266671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6474d9f2-2fdf-46e9-a8b3-b8799384c3f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:23.395638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6474d9f2-2fdf-46e9-a8b3-b8799384c3f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:23.404308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6474d9f2-2fdf-46e9-a8b3-b8799384c3f4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151580 Jul 28 20:27:23.404894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1438/3018] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:24.426405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3719217a-ee75-4978-aee8-fd2af434e962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:24.426976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3719217a-ee75-4978-aee8-fd2af434e962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:24.434003 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3719217a-ee75-4978-aee8-fd2af434e962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:24.434442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3719217a-ee75-4978-aee8-fd2af434e962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:24.435185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3719217a-ee75-4978-aee8-fd2af434e962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:24.435603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3719217a-ee75-4978-aee8-fd2af434e962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:24.567606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3719217a-ee75-4978-aee8-fd2af434e962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:24.575908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3719217a-ee75-4978-aee8-fd2af434e962 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153462 Jul 28 20:27:24.576469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1581/3019] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:25.597814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0d43deb4-1d22-46c5-8fe9-1de6005c0c99 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:25.598425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0d43deb4-1d22-46c5-8fe9-1de6005c0c99 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:25.605082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d43deb4-1d22-46c5-8fe9-1de6005c0c99 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:25.605525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d43deb4-1d22-46c5-8fe9-1de6005c0c99 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:25.606270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d43deb4-1d22-46c5-8fe9-1de6005c0c99 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:25.606697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0d43deb4-1d22-46c5-8fe9-1de6005c0c99 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:25.745344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0d43deb4-1d22-46c5-8fe9-1de6005c0c99 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:25.753332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0d43deb4-1d22-46c5-8fe9-1de6005c0c99 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.159508 Jul 28 20:27:25.753891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1439/3020] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:26.774718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6d9f5fdb-eda2-4a6f-874a-177fb4a6d102 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:26.776310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6d9f5fdb-eda2-4a6f-874a-177fb4a6d102 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:26.783174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d9f5fdb-eda2-4a6f-874a-177fb4a6d102 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:26.783623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d9f5fdb-eda2-4a6f-874a-177fb4a6d102 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:26.784373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d9f5fdb-eda2-4a6f-874a-177fb4a6d102 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:26.784826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6d9f5fdb-eda2-4a6f-874a-177fb4a6d102 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:26.913996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6d9f5fdb-eda2-4a6f-874a-177fb4a6d102 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:26.922732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6d9f5fdb-eda2-4a6f-874a-177fb4a6d102 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151879 Jul 28 20:27:26.923304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1582/3021] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:27.945297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a8360ff8-6663-4509-b3d0-72fdd705baf2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:27.945944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a8360ff8-6663-4509-b3d0-72fdd705baf2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:27.948706 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:27:27.954681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8360ff8-6663-4509-b3d0-72fdd705baf2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:27.955337 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8360ff8-6663-4509-b3d0-72fdd705baf2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:27.956078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8360ff8-6663-4509-b3d0-72fdd705baf2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:27.956503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a8360ff8-6663-4509-b3d0-72fdd705baf2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:28.081606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a8360ff8-6663-4509-b3d0-72fdd705baf2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:28.090518 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a8360ff8-6663-4509-b3d0-72fdd705baf2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149113 Jul 28 20:27:28.091066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1440/3022] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:29.112273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9f6b01d9-68f1-4f32-9a4f-5a66040ac8e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:29.112891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9f6b01d9-68f1-4f32-9a4f-5a66040ac8e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:29.119357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f6b01d9-68f1-4f32-9a4f-5a66040ac8e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:29.119792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f6b01d9-68f1-4f32-9a4f-5a66040ac8e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:29.120549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f6b01d9-68f1-4f32-9a4f-5a66040ac8e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:29.120985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9f6b01d9-68f1-4f32-9a4f-5a66040ac8e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:29.252086 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9f6b01d9-68f1-4f32-9a4f-5a66040ac8e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:29.260289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9f6b01d9-68f1-4f32-9a4f-5a66040ac8e7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152052 Jul 28 20:27:29.260874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1583/3023] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:29 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:30.282087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dd1c1b58-9217-4e9b-92e5-b41199c97544 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:30.282701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dd1c1b58-9217-4e9b-92e5-b41199c97544 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:30.289211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd1c1b58-9217-4e9b-92e5-b41199c97544 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:30.289654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd1c1b58-9217-4e9b-92e5-b41199c97544 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:30.290401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd1c1b58-9217-4e9b-92e5-b41199c97544 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:30.290828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd1c1b58-9217-4e9b-92e5-b41199c97544 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:30.417464 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd1c1b58-9217-4e9b-92e5-b41199c97544 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:30.425241 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dd1c1b58-9217-4e9b-92e5-b41199c97544 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146997 Jul 28 20:27:30.425797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1441/3024] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:31.447412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3a9bdc90-df92-4a14-aa7d-703591dd0bb7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:31.448804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3a9bdc90-df92-4a14-aa7d-703591dd0bb7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:31.451078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=28 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:27:31.456576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a9bdc90-df92-4a14-aa7d-703591dd0bb7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:31.457018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a9bdc90-df92-4a14-aa7d-703591dd0bb7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:31.457774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a9bdc90-df92-4a14-aa7d-703591dd0bb7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:31.458205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3a9bdc90-df92-4a14-aa7d-703591dd0bb7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:31.592782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3a9bdc90-df92-4a14-aa7d-703591dd0bb7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:31.600749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3a9bdc90-df92-4a14-aa7d-703591dd0bb7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.157438 Jul 28 20:27:31.601303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1584/3025] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:32.622590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-47fb9a7f-7fa5-4eb0-a0be-d84ef1bf8c3c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:32.623205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-47fb9a7f-7fa5-4eb0-a0be-d84ef1bf8c3c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:32.629403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47fb9a7f-7fa5-4eb0-a0be-d84ef1bf8c3c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:32.629852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47fb9a7f-7fa5-4eb0-a0be-d84ef1bf8c3c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:32.630600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47fb9a7f-7fa5-4eb0-a0be-d84ef1bf8c3c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:32.631032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47fb9a7f-7fa5-4eb0-a0be-d84ef1bf8c3c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:32.759639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-47fb9a7f-7fa5-4eb0-a0be-d84ef1bf8c3c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:32.767674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-47fb9a7f-7fa5-4eb0-a0be-d84ef1bf8c3c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149668 Jul 28 20:27:32.768258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1442/3026] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:33.789554 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c0a0646-2cc3-4792-a4d0-fd570aed42ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:33.790161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1c0a0646-2cc3-4792-a4d0-fd570aed42ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:33.796932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c0a0646-2cc3-4792-a4d0-fd570aed42ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:33.797376 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c0a0646-2cc3-4792-a4d0-fd570aed42ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:33.798118 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c0a0646-2cc3-4792-a4d0-fd570aed42ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:33.798549 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1c0a0646-2cc3-4792-a4d0-fd570aed42ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:33.930385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1c0a0646-2cc3-4792-a4d0-fd570aed42ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:33.938778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1c0a0646-2cc3-4792-a4d0-fd570aed42ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153017 Jul 28 20:27:33.939349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1585/3027] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:34.960230 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-92649d4a-0ab2-40e9-a1a4-e2151b4212a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:34.960883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-92649d4a-0ab2-40e9-a1a4-e2151b4212a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:34.967628 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92649d4a-0ab2-40e9-a1a4-e2151b4212a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:34.968081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92649d4a-0ab2-40e9-a1a4-e2151b4212a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:34.968863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92649d4a-0ab2-40e9-a1a4-e2151b4212a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:34.969304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-92649d4a-0ab2-40e9-a1a4-e2151b4212a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:35.096958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-92649d4a-0ab2-40e9-a1a4-e2151b4212a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:35.106247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-92649d4a-0ab2-40e9-a1a4-e2151b4212a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149884 Jul 28 20:27:35.106818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1443/3028] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:36.127295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e96f345d-82de-4ab2-b835-35d57bed518c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:36.127905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e96f345d-82de-4ab2-b835-35d57bed518c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:36.134512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e96f345d-82de-4ab2-b835-35d57bed518c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:36.135660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e96f345d-82de-4ab2-b835-35d57bed518c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:36.136428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e96f345d-82de-4ab2-b835-35d57bed518c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:36.136890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e96f345d-82de-4ab2-b835-35d57bed518c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:36.263191 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e96f345d-82de-4ab2-b835-35d57bed518c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:36.271080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e96f345d-82de-4ab2-b835-35d57bed518c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147617 Jul 28 20:27:36.271638 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1586/3029] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:37.292917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f573ac1a-f761-43a6-a6a7-fdba6d917e50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:37.293473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f573ac1a-f761-43a6-a6a7-fdba6d917e50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:37.299984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f573ac1a-f761-43a6-a6a7-fdba6d917e50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:37.300428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f573ac1a-f761-43a6-a6a7-fdba6d917e50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:37.301212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f573ac1a-f761-43a6-a6a7-fdba6d917e50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:37.301646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f573ac1a-f761-43a6-a6a7-fdba6d917e50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:37.432943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f573ac1a-f761-43a6-a6a7-fdba6d917e50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:37.440993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f573ac1a-f761-43a6-a6a7-fdba6d917e50 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152067 Jul 28 20:27:37.441553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1444/3030] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:38.462671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e2abf837-9b66-460c-954d-21d803a593a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:38.463959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e2abf837-9b66-460c-954d-21d803a593a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:38.470536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2abf837-9b66-460c-954d-21d803a593a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:38.470980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2abf837-9b66-460c-954d-21d803a593a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:38.471738 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2abf837-9b66-460c-954d-21d803a593a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:38.472168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e2abf837-9b66-460c-954d-21d803a593a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:38.607348 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e2abf837-9b66-460c-954d-21d803a593a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:38.615289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e2abf837-9b66-460c-954d-21d803a593a0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156600 Jul 28 20:27:38.615845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1587/3031] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:39.637187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aa08fe0d-78ff-439e-8c85-6488e5232305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:39.637781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aa08fe0d-78ff-439e-8c85-6488e5232305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:39.644982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa08fe0d-78ff-439e-8c85-6488e5232305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:39.645442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa08fe0d-78ff-439e-8c85-6488e5232305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:39.646189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa08fe0d-78ff-439e-8c85-6488e5232305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:39.646616 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aa08fe0d-78ff-439e-8c85-6488e5232305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:39.776329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aa08fe0d-78ff-439e-8c85-6488e5232305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:39.784176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aa08fe0d-78ff-439e-8c85-6488e5232305 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151132 Jul 28 20:27:39.784759 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1445/3032] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:40.805824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c2c700bd-1519-40d7-8b02-da6d14d2b8f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:40.806397 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c2c700bd-1519-40d7-8b02-da6d14d2b8f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:40.813665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2c700bd-1519-40d7-8b02-da6d14d2b8f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:40.814117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2c700bd-1519-40d7-8b02-da6d14d2b8f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:40.814870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2c700bd-1519-40d7-8b02-da6d14d2b8f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:40.815303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2c700bd-1519-40d7-8b02-da6d14d2b8f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:40.942209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c2c700bd-1519-40d7-8b02-da6d14d2b8f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:40.950292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c2c700bd-1519-40d7-8b02-da6d14d2b8f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148356 Jul 28 20:27:40.950883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1588/3033] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:41.971186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-df24468c-4c78-4b6e-9ca7-6adb4d77ef38 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:41.971815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-df24468c-4c78-4b6e-9ca7-6adb4d77ef38 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:41.978299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df24468c-4c78-4b6e-9ca7-6adb4d77ef38 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:41.978749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df24468c-4c78-4b6e-9ca7-6adb4d77ef38 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:41.979496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df24468c-4c78-4b6e-9ca7-6adb4d77ef38 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:41.979922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-df24468c-4c78-4b6e-9ca7-6adb4d77ef38 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:42.109038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-df24468c-4c78-4b6e-9ca7-6adb4d77ef38 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:42.116874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-df24468c-4c78-4b6e-9ca7-6adb4d77ef38 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149544 Jul 28 20:27:42.117429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1446/3034] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:43.138691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1cd0eae7-0d17-46e9-958a-66bd4bb947bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:43.139313 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1cd0eae7-0d17-46e9-958a-66bd4bb947bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:43.145747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1cd0eae7-0d17-46e9-958a-66bd4bb947bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:43.146193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1cd0eae7-0d17-46e9-958a-66bd4bb947bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:43.146948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1cd0eae7-0d17-46e9-958a-66bd4bb947bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:43.147379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1cd0eae7-0d17-46e9-958a-66bd4bb947bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:43.277328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1cd0eae7-0d17-46e9-958a-66bd4bb947bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:43.285306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1cd0eae7-0d17-46e9-958a-66bd4bb947bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151033 Jul 28 20:27:43.285867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1589/3035] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:44.307137 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0c22780e-7374-4da1-a602-7280e8a979ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:44.307951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0c22780e-7374-4da1-a602-7280e8a979ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:44.314455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c22780e-7374-4da1-a602-7280e8a979ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:44.314915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c22780e-7374-4da1-a602-7280e8a979ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:44.315646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c22780e-7374-4da1-a602-7280e8a979ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:44.316070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0c22780e-7374-4da1-a602-7280e8a979ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:44.451909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0c22780e-7374-4da1-a602-7280e8a979ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:44.459819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0c22780e-7374-4da1-a602-7280e8a979ea tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156865 Jul 28 20:27:44.460374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1447/3036] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:45.481786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bd023c2d-5645-4731-ad6c-4cda1cb72168 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:45.482389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bd023c2d-5645-4731-ad6c-4cda1cb72168 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:45.489041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd023c2d-5645-4731-ad6c-4cda1cb72168 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:45.489487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd023c2d-5645-4731-ad6c-4cda1cb72168 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:45.490245 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd023c2d-5645-4731-ad6c-4cda1cb72168 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:45.490676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bd023c2d-5645-4731-ad6c-4cda1cb72168 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:45.623068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-bd023c2d-5645-4731-ad6c-4cda1cb72168 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:45.630906 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bd023c2d-5645-4731-ad6c-4cda1cb72168 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153562 Jul 28 20:27:45.631464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1590/3037] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:46.653390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-355c71da-7d06-4ae5-8278-6b11f0626cf3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:46.654028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-355c71da-7d06-4ae5-8278-6b11f0626cf3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:46.660569 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-355c71da-7d06-4ae5-8278-6b11f0626cf3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:46.661025 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-355c71da-7d06-4ae5-8278-6b11f0626cf3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:46.661768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-355c71da-7d06-4ae5-8278-6b11f0626cf3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:46.662199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-355c71da-7d06-4ae5-8278-6b11f0626cf3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:46.788823 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-355c71da-7d06-4ae5-8278-6b11f0626cf3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:46.797017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-355c71da-7d06-4ae5-8278-6b11f0626cf3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148424 Jul 28 20:27:46.797574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1448/3038] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:47.817780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-40058874-822b-49ff-82c7-3e94ad20de75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:47.818411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-40058874-822b-49ff-82c7-3e94ad20de75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:47.824852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40058874-822b-49ff-82c7-3e94ad20de75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:47.825292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40058874-822b-49ff-82c7-3e94ad20de75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:47.826036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40058874-822b-49ff-82c7-3e94ad20de75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:47.826489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40058874-822b-49ff-82c7-3e94ad20de75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:47.964726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-40058874-822b-49ff-82c7-3e94ad20de75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:47.972994 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-40058874-822b-49ff-82c7-3e94ad20de75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158892 Jul 28 20:27:47.973728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1591/3039] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:48.995973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b9b96d66-1718-4554-b097-7cdf6919f184 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:48.996611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b9b96d66-1718-4554-b097-7cdf6919f184 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:49.003093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b9b96d66-1718-4554-b097-7cdf6919f184 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:49.003539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b9b96d66-1718-4554-b097-7cdf6919f184 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:49.004288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b9b96d66-1718-4554-b097-7cdf6919f184 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:49.004749 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b9b96d66-1718-4554-b097-7cdf6919f184 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:49.008561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:27:49.131009 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b9b96d66-1718-4554-b097-7cdf6919f184 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:49.139431 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b9b96d66-1718-4554-b097-7cdf6919f184 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147988 Jul 28 20:27:49.139992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1449/3040] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:49.170705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e1303cd6-ea8c-4538-a6b9-b13ad532e413 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:49.171200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e1303cd6-ea8c-4538-a6b9-b13ad532e413 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:49.177748 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1303cd6-ea8c-4538-a6b9-b13ad532e413 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:49.178200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1303cd6-ea8c-4538-a6b9-b13ad532e413 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:49.178951 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1303cd6-ea8c-4538-a6b9-b13ad532e413 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:49.179384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e1303cd6-ea8c-4538-a6b9-b13ad532e413 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:49.204288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e1303cd6-ea8c-4538-a6b9-b13ad532e413 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Going to try to terminate instance {{(pid=117969) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:27:49.278259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e1303cd6-ea8c-4538-a6b9-b13ad532e413 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 204 len: 0 microversion: 2.1 time: 0.111048 Jul 28 20:27:49.278848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1592/3041] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:27:49 2022] DELETE /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:27:49.290982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4432c151-8f14-4839-8334-11ce2cba9767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:49.291695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4432c151-8f14-4839-8334-11ce2cba9767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:49.298457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4432c151-8f14-4839-8334-11ce2cba9767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:49.298976 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4432c151-8f14-4839-8334-11ce2cba9767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:49.299797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4432c151-8f14-4839-8334-11ce2cba9767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:49.300573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4432c151-8f14-4839-8334-11ce2cba9767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:49.425719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4432c151-8f14-4839-8334-11ce2cba9767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:49.433159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4432c151-8f14-4839-8334-11ce2cba9767 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1678 microversion: 2.1 time: 0.148112 Jul 28 20:27:49.434257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1450/3042] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:49 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:50.161917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c2f07a1e-c384-4482-a636-18472b6cbf6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:50.162611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c2f07a1e-c384-4482-a636-18472b6cbf6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:50.169361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2f07a1e-c384-4482-a636-18472b6cbf6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:50.169805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2f07a1e-c384-4482-a636-18472b6cbf6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:50.170557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2f07a1e-c384-4482-a636-18472b6cbf6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:50.170981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c2f07a1e-c384-4482-a636-18472b6cbf6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:50.173621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:27:50.302842 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c2f07a1e-c384-4482-a636-18472b6cbf6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:50.310939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c2f07a1e-c384-4482-a636-18472b6cbf6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153291 Jul 28 20:27:50.311492 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1593/3043] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:50.455355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f369a610-614a-427c-9c60-77d596e7489a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:50.455902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f369a610-614a-427c-9c60-77d596e7489a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:50.462473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f369a610-614a-427c-9c60-77d596e7489a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:50.462921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f369a610-614a-427c-9c60-77d596e7489a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:50.463681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f369a610-614a-427c-9c60-77d596e7489a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:50.464118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f369a610-614a-427c-9c60-77d596e7489a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:50.591673 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f369a610-614a-427c-9c60-77d596e7489a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:50.599148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f369a610-614a-427c-9c60-77d596e7489a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1678 microversion: 2.1 time: 0.147841 Jul 28 20:27:50.599711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1451/3044] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:50 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:51.331357 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-456f0f35-ea80-4799-ab93-5981fa266601 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:51.332071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-456f0f35-ea80-4799-ab93-5981fa266601 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:51.338474 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-456f0f35-ea80-4799-ab93-5981fa266601 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:51.338919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-456f0f35-ea80-4799-ab93-5981fa266601 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:51.339793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-456f0f35-ea80-4799-ab93-5981fa266601 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:51.341436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-456f0f35-ea80-4799-ab93-5981fa266601 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:51.477520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-456f0f35-ea80-4799-ab93-5981fa266601 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:51.485830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-456f0f35-ea80-4799-ab93-5981fa266601 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158358 Jul 28 20:27:51.486395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1594/3045] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:51.622133 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7602518a-dd9d-400a-9ef7-31d5d87bf309 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:51.622777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7602518a-dd9d-400a-9ef7-31d5d87bf309 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:51.629313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7602518a-dd9d-400a-9ef7-31d5d87bf309 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:51.629890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7602518a-dd9d-400a-9ef7-31d5d87bf309 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:51.631272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7602518a-dd9d-400a-9ef7-31d5d87bf309 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:51.631272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7602518a-dd9d-400a-9ef7-31d5d87bf309 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:51.765084 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7602518a-dd9d-400a-9ef7-31d5d87bf309 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:51.773776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7602518a-dd9d-400a-9ef7-31d5d87bf309 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1678 microversion: 2.1 time: 0.156156 Jul 28 20:27:51.774587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1452/3046] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:51 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:52.171099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-352ba3cf-290f-405e-9677-66eb77229f45 req-378809a8-a9b3-4fcd-b348-1978b53bae18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f899c1b-9efc-4205-890d-5f314d6e4140", "name": "network-vif-deleted", "tag": "a6e4bce3-715b-4e15-88bf-13024a68af24"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:27:52.179928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-352ba3cf-290f-405e-9677-66eb77229f45 req-378809a8-a9b3-4fcd-b348-1978b53bae18 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:52.180370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-352ba3cf-290f-405e-9677-66eb77229f45 req-378809a8-a9b3-4fcd-b348-1978b53bae18 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:52.191982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-352ba3cf-290f-405e-9677-66eb77229f45 req-378809a8-a9b3-4fcd-b348-1978b53bae18 service nova] Creating event network-vif-deleted:a6e4bce3-715b-4e15-88bf-13024a68af24 for instance 5f899c1b-9efc-4205-890d-5f314d6e4140 on hv-cinder-85144 Jul 28 20:27:52.196938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-352ba3cf-290f-405e-9677-66eb77229f45 req-378809a8-a9b3-4fcd-b348-1978b53bae18 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030753 Jul 28 20:27:52.197530 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1595/3047] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:27:52.507245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aef7e251-20f5-43a2-a4a3-4099242b952c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:52.508059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aef7e251-20f5-43a2-a4a3-4099242b952c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:52.514681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aef7e251-20f5-43a2-a4a3-4099242b952c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:52.515210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aef7e251-20f5-43a2-a4a3-4099242b952c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:52.516005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aef7e251-20f5-43a2-a4a3-4099242b952c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:52.516443 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aef7e251-20f5-43a2-a4a3-4099242b952c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:52.648901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aef7e251-20f5-43a2-a4a3-4099242b952c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:52.657642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aef7e251-20f5-43a2-a4a3-4099242b952c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154252 Jul 28 20:27:52.658219 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1453/3048] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:52.797383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:52.798813 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:52.805452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:52.806243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:52.807137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:52.807633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:52.846004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:52.846338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:52.846879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lazy-loading 'fault' on Instance uuid 5f899c1b-9efc-4205-890d-5f314d6e4140 {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:27:52.904426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd0b2bfa3d014222afd4e050ca8498f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6612a467ab54632a74cf113b4666eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:52.912338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-66c4cd0f-111c-4d8c-825c-ae03b847f74b tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 200 len: 1329 microversion: 2.1 time: 0.120536 Jul 28 20:27:52.912984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1596/3049] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:52 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 1329 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:53.679297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8da7ad64-15c0-470e-8fbd-16b3f5f16b4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:53.679922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8da7ad64-15c0-470e-8fbd-16b3f5f16b4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:53.687111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8da7ad64-15c0-470e-8fbd-16b3f5f16b4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:53.687553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8da7ad64-15c0-470e-8fbd-16b3f5f16b4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:53.688296 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8da7ad64-15c0-470e-8fbd-16b3f5f16b4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:53.688755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8da7ad64-15c0-470e-8fbd-16b3f5f16b4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:53.816143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8da7ad64-15c0-470e-8fbd-16b3f5f16b4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:53.824257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8da7ad64-15c0-470e-8fbd-16b3f5f16b4d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148671 Jul 28 20:27:53.824839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1454/3050] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:53.935085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:53.935691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:53.942308 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:53.942757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:53.943508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:53.943954 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:53.957816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 HTTP/1.1 Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:27:53.959451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:53.961298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '5f899c1b-9efc-4205-890d-5f314d6e4140'} Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:27:53.962335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:53.964055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:53.966372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:27:53.966372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-909b369c-ec74-4509-9bfd-de45958f9605 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 404 len: 111 microversion: 2.1 time: 0.030284 Jul 28 20:27:53.966372 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1597/3051] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:53 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:27:53.970495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fe10b5e7-eff6-4250-b1d8-aad0fea1190a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '.version_select at 0x7f503702a4c0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:53.992411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fe10b5e7-eff6-4250-b1d8-aad0fea1190a tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-210308177" status: 202 len: 0 microversion: 2.1 time: 0.025740 Jul 28 20:27:53.992996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1455/3052] 10.222.0.67 () {58 vars in 1218 bytes} [Thu Jul 28 20:27:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-210308177 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:27:54.616804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:54.617222 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:54.624038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.624485 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.625283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.625718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.641921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 HTTP/1.1 Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:27:54.643446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.645181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '5f899c1b-9efc-4205-890d-5f314d6e4140'} Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:27:54.646350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.647929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.649688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:27:54.649688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f2bb05b8-59f9-4470-9b60-93a96aa5950d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 404 len: 111 microversion: 2.1 time: 0.031995 Jul 28 20:27:54.649688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1598/3053] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:27:54 2022] DELETE /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:27:54.653767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:54.654386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 5f899c1b-9efc-4205-890d-5f314d6e4140] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:54.660669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.661143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.661902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.662336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.676989 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 HTTP/1.1 Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:27:54.678660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.680957 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': '5f899c1b-9efc-4205-890d-5f314d6e4140'} Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:27:54.682086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. Jul 28 20:27:54.684654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.686202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance 5f899c1b-9efc-4205-890d-5f314d6e4140 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:27:54.686202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-34095278-f177-4d65-84bb-128c24c115d1 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140" status: 404 len: 111 microversion: 2.1 time: 0.030606 Jul 28 20:27:54.686202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1456/3054] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:54 2022] GET /compute/v2.1/servers/5f899c1b-9efc-4205-890d-5f314d6e4140 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:27:54.688919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:54.689440 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:54.695506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.695959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.696746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.697183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.711081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 HTTP/1.1 Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:27:54.712639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.714371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'e331bb00-5b75-40e7-9658-3c691aee4e24'} Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:27:54.715560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.717213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.718829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:27:54.718829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-efbc5ad8-67cd-47b0-a90f-c40ddc7472d8 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 404 len: 111 microversion: 2.1 time: 0.028936 Jul 28 20:27:54.718829 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1599/3055] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:27:54 2022] DELETE /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:27:54.722389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:54.722992 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: e331bb00-5b75-40e7-9658-3c691aee4e24] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:54.729401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.729840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.730808 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.731236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.744193 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 HTTP/1.1 Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:27:54.745713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.747969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'e331bb00-5b75-40e7-9658-3c691aee4e24'} Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:27:54.749319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. Jul 28 20:27:54.750972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.752438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance e331bb00-5b75-40e7-9658-3c691aee4e24 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:27:54.752438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0ac3cd14-13e4-4745-a776-a8d0f5a27cda tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24" status: 404 len: 111 microversion: 2.1 time: 0.029229 Jul 28 20:27:54.752438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1457/3056] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:54 2022] GET /compute/v2.1/servers/e331bb00-5b75-40e7-9658-3c691aee4e24 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:27:54.756060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:54.756574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:54.763186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.763661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.764419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.764881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.778922 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 HTTP/1.1 Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:27:54.780509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.782381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': '38734333-d64b-4885-a501-8d6d573d1457'} Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:27:54.783300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.784892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.786412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:27:54.786412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c69b00dc-0bc6-44e3-9e6f-0522a2e5bb3d tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 404 len: 111 microversion: 2.1 time: 0.029702 Jul 28 20:27:54.786412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1600/3057] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:27:54 2022] DELETE /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:27:54.790385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:54.791002 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: 38734333-d64b-4885-a501-8d6d573d1457] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:54.797952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.798400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.799152 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.799594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.813076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 HTTP/1.1 Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:27:54.814585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.816238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': '38734333-d64b-4885-a501-8d6d573d1457'} Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:27:54.817144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. Jul 28 20:27:54.818514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:27:54.819721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance 38734333-d64b-4885-a501-8d6d573d1457 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:27:54.819721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-600f3663-210b-419c-a98e-be9791fc63bb tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457" status: 404 len: 111 microversion: 2.1 time: 0.029390 Jul 28 20:27:54.819721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1458/3058] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:54 2022] GET /compute/v2.1/servers/38734333-d64b-4885-a501-8d6d573d1457 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:27:54.845321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-834cccbc-e4d3-4228-88fc-f65dd0803937 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:54.845931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-834cccbc-e4d3-4228-88fc-f65dd0803937 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:54.851950 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-834cccbc-e4d3-4228-88fc-f65dd0803937 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.852403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-834cccbc-e4d3-4228-88fc-f65dd0803937 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.853194 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-834cccbc-e4d3-4228-88fc-f65dd0803937 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:54.853639 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-834cccbc-e4d3-4228-88fc-f65dd0803937 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:54.989125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-834cccbc-e4d3-4228-88fc-f65dd0803937 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:54.997400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-834cccbc-e4d3-4228-88fc-f65dd0803937 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155830 Jul 28 20:27:54.997952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1601/3059] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:27:56.020391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6d5ef590-497a-474c-8fe7-71e5da0957e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:56.021017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6d5ef590-497a-474c-8fe7-71e5da0957e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:56.028320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d5ef590-497a-474c-8fe7-71e5da0957e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:56.028870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d5ef590-497a-474c-8fe7-71e5da0957e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:56.029634 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d5ef590-497a-474c-8fe7-71e5da0957e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:56.030070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d5ef590-497a-474c-8fe7-71e5da0957e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:56.155765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6d5ef590-497a-474c-8fe7-71e5da0957e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:56.163684 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6d5ef590-497a-474c-8fe7-71e5da0957e0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147142 Jul 28 20:27:56.164473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1459/3060] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:57.185854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f54b4fa1-f609-4316-8e33-f4898885347f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:57.186460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f54b4fa1-f609-4316-8e33-f4898885347f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:57.193011 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f54b4fa1-f609-4316-8e33-f4898885347f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:57.193453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f54b4fa1-f609-4316-8e33-f4898885347f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:57.194195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f54b4fa1-f609-4316-8e33-f4898885347f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:57.194623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f54b4fa1-f609-4316-8e33-f4898885347f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:57.323820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f54b4fa1-f609-4316-8e33-f4898885347f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:57.331815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f54b4fa1-f609-4316-8e33-f4898885347f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150450 Jul 28 20:27:57.332346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1602/3061] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:27:58.352972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-edb090bb-c4c5-428c-b617-bde8dfbff95b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:58.353589 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-edb090bb-c4c5-428c-b617-bde8dfbff95b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:58.355936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:27:58.361396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edb090bb-c4c5-428c-b617-bde8dfbff95b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:58.361841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edb090bb-c4c5-428c-b617-bde8dfbff95b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:58.362604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edb090bb-c4c5-428c-b617-bde8dfbff95b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:58.363038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-edb090bb-c4c5-428c-b617-bde8dfbff95b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:58.493585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-edb090bb-c4c5-428c-b617-bde8dfbff95b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:58.502043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-edb090bb-c4c5-428c-b617-bde8dfbff95b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152922 Jul 28 20:27:58.502598 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1460/3062] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:58 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:27:59.523323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-744aa220-ca92-4469-8444-061f1759b144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:27:59.523888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-744aa220-ca92-4469-8444-061f1759b144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:27:59.531531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-744aa220-ca92-4469-8444-061f1759b144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:59.531983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-744aa220-ca92-4469-8444-061f1759b144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:59.532924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-744aa220-ca92-4469-8444-061f1759b144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:27:59.533388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-744aa220-ca92-4469-8444-061f1759b144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:27:59.659505 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-744aa220-ca92-4469-8444-061f1759b144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:27:59.667985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-744aa220-ca92-4469-8444-061f1759b144 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148063 Jul 28 20:27:59.668569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1603/3063] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:27:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:00.690141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-63c34d47-e523-493d-b506-22bc45f9d530 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:00.690780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-63c34d47-e523-493d-b506-22bc45f9d530 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:00.697510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63c34d47-e523-493d-b506-22bc45f9d530 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:00.697964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63c34d47-e523-493d-b506-22bc45f9d530 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:00.698761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63c34d47-e523-493d-b506-22bc45f9d530 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:00.699966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-63c34d47-e523-493d-b506-22bc45f9d530 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:00.830827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-63c34d47-e523-493d-b506-22bc45f9d530 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:00.838666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-63c34d47-e523-493d-b506-22bc45f9d530 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152554 Jul 28 20:28:00.839215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1461/3064] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:01.859259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3971800b-ea5d-47ec-9d20-27c0a62b3914 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:01.859860 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3971800b-ea5d-47ec-9d20-27c0a62b3914 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:01.862320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:28:01.867750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3971800b-ea5d-47ec-9d20-27c0a62b3914 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:01.868186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3971800b-ea5d-47ec-9d20-27c0a62b3914 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:01.868955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3971800b-ea5d-47ec-9d20-27c0a62b3914 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:01.869525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3971800b-ea5d-47ec-9d20-27c0a62b3914 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:01.997858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3971800b-ea5d-47ec-9d20-27c0a62b3914 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:02.006120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3971800b-ea5d-47ec-9d20-27c0a62b3914 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150571 Jul 28 20:28:02.006681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1604/3065] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:03.027678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-aea95dd7-723d-4e15-946a-3ffa5b47ae8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:03.028283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-aea95dd7-723d-4e15-946a-3ffa5b47ae8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:03.034792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aea95dd7-723d-4e15-946a-3ffa5b47ae8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:03.035219 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aea95dd7-723d-4e15-946a-3ffa5b47ae8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:03.035965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aea95dd7-723d-4e15-946a-3ffa5b47ae8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:03.036392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-aea95dd7-723d-4e15-946a-3ffa5b47ae8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:03.169818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-aea95dd7-723d-4e15-946a-3ffa5b47ae8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:03.177758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-aea95dd7-723d-4e15-946a-3ffa5b47ae8f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154163 Jul 28 20:28:03.178317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1462/3066] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:04.200173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1a997bba-0a66-4fe4-b6f6-06c961cecd5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:04.200793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1a997bba-0a66-4fe4-b6f6-06c961cecd5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:04.206754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a997bba-0a66-4fe4-b6f6-06c961cecd5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:04.207196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a997bba-0a66-4fe4-b6f6-06c961cecd5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:04.207932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a997bba-0a66-4fe4-b6f6-06c961cecd5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:04.208374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a997bba-0a66-4fe4-b6f6-06c961cecd5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:04.340606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1a997bba-0a66-4fe4-b6f6-06c961cecd5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:04.348382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1a997bba-0a66-4fe4-b6f6-06c961cecd5f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152707 Jul 28 20:28:04.348965 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1605/3067] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:05.368977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cd755e13-624f-40f6-95b9-85359e8ba70f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:05.369597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cd755e13-624f-40f6-95b9-85359e8ba70f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:05.376646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cd755e13-624f-40f6-95b9-85359e8ba70f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:05.377098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cd755e13-624f-40f6-95b9-85359e8ba70f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:05.377856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cd755e13-624f-40f6-95b9-85359e8ba70f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:05.378290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cd755e13-624f-40f6-95b9-85359e8ba70f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:05.522046 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cd755e13-624f-40f6-95b9-85359e8ba70f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:05.530630 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cd755e13-624f-40f6-95b9-85359e8ba70f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.165685 Jul 28 20:28:05.531200 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1463/3068] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:06.553782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b6142606-c532-43f3-ab00-04f228d7de11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:06.554403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b6142606-c532-43f3-ab00-04f228d7de11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:06.561230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6142606-c532-43f3-ab00-04f228d7de11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:06.561674 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6142606-c532-43f3-ab00-04f228d7de11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:06.562479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6142606-c532-43f3-ab00-04f228d7de11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:06.562904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b6142606-c532-43f3-ab00-04f228d7de11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:06.689742 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b6142606-c532-43f3-ab00-04f228d7de11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:06.697547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b6142606-c532-43f3-ab00-04f228d7de11 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147603 Jul 28 20:28:06.698116 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1606/3069] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:07.718736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-86e7a67b-102c-4acf-afdb-28b81250e1ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:07.719370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-86e7a67b-102c-4acf-afdb-28b81250e1ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:07.725853 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86e7a67b-102c-4acf-afdb-28b81250e1ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:07.726297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86e7a67b-102c-4acf-afdb-28b81250e1ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:07.727069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86e7a67b-102c-4acf-afdb-28b81250e1ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:07.727525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-86e7a67b-102c-4acf-afdb-28b81250e1ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:07.854295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-86e7a67b-102c-4acf-afdb-28b81250e1ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:07.862827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-86e7a67b-102c-4acf-afdb-28b81250e1ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148019 Jul 28 20:28:07.863392 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1464/3070] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:08.884711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e913d98a-b8f6-43d7-b740-9bc35eba2a04 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:08.885327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e913d98a-b8f6-43d7-b740-9bc35eba2a04 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:08.891870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e913d98a-b8f6-43d7-b740-9bc35eba2a04 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:08.892318 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e913d98a-b8f6-43d7-b740-9bc35eba2a04 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:08.893104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e913d98a-b8f6-43d7-b740-9bc35eba2a04 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:08.893536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e913d98a-b8f6-43d7-b740-9bc35eba2a04 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:09.026923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e913d98a-b8f6-43d7-b740-9bc35eba2a04 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:09.036169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e913d98a-b8f6-43d7-b740-9bc35eba2a04 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155405 Jul 28 20:28:09.036760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1607/3071] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:10.057475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-26591555-57da-42a0-acd9-eb32c3e37191 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:10.058086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-26591555-57da-42a0-acd9-eb32c3e37191 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:10.065677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26591555-57da-42a0-acd9-eb32c3e37191 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:10.066119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26591555-57da-42a0-acd9-eb32c3e37191 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:10.066872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26591555-57da-42a0-acd9-eb32c3e37191 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:10.067299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-26591555-57da-42a0-acd9-eb32c3e37191 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:10.194472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-26591555-57da-42a0-acd9-eb32c3e37191 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:10.203578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-26591555-57da-42a0-acd9-eb32c3e37191 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150042 Jul 28 20:28:10.204128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1465/3072] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:11.225611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9af9ba87-2558-442c-9b18-94abf5f1a7bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:11.226270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9af9ba87-2558-442c-9b18-94abf5f1a7bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:11.232982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9af9ba87-2558-442c-9b18-94abf5f1a7bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:11.233556 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9af9ba87-2558-442c-9b18-94abf5f1a7bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:11.234338 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9af9ba87-2558-442c-9b18-94abf5f1a7bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:11.234763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9af9ba87-2558-442c-9b18-94abf5f1a7bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:11.366641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9af9ba87-2558-442c-9b18-94abf5f1a7bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:11.374615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9af9ba87-2558-442c-9b18-94abf5f1a7bc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152868 Jul 28 20:28:11.375168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1608/3073] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:28:12.396584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-824e3eb8-8f46-4be8-9c66-e628b5e5ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:12.397189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-824e3eb8-8f46-4be8-9c66-e628b5e5ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:12.404294 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-824e3eb8-8f46-4be8-9c66-e628b5e5ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:12.404776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-824e3eb8-8f46-4be8-9c66-e628b5e5ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:12.405536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-824e3eb8-8f46-4be8-9c66-e628b5e5ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:12.405970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-824e3eb8-8f46-4be8-9c66-e628b5e5ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:12.535442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-824e3eb8-8f46-4be8-9c66-e628b5e5ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:12.543480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-824e3eb8-8f46-4be8-9c66-e628b5e5ecfc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150847 Jul 28 20:28:12.544821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1466/3074] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:12.999597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1b74586a-002f-4b9f-97ac-a70ae99dfaf3 tempest-TestVolumeBootPattern-335270863 tempest-TestVolumeBootPattern-335270863-project] Calling method '.version_select at 0x7f503606f0d0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:13.004723 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1b74586a-002f-4b9f-97ac-a70ae99dfaf3 tempest-TestVolumeBootPattern-335270863 tempest-TestVolumeBootPattern-335270863-project] [6867ed6b-5a6e-44db-b819-8aeabd0fe303] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 20:28:13.566044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-361479f1-a82c-4d7f-99c6-60fd16f06a89 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:13.566617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-361479f1-a82c-4d7f-99c6-60fd16f06a89 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:13.573376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-361479f1-a82c-4d7f-99c6-60fd16f06a89 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:13.573821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-361479f1-a82c-4d7f-99c6-60fd16f06a89 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:13.574583 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-361479f1-a82c-4d7f-99c6-60fd16f06a89 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:13.575016 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-361479f1-a82c-4d7f-99c6-60fd16f06a89 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:13.703414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-361479f1-a82c-4d7f-99c6-60fd16f06a89 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:13.711254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-361479f1-a82c-4d7f-99c6-60fd16f06a89 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149231 Jul 28 20:28:13.711809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1467/3075] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:28:14.014236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [None req-1b74586a-002f-4b9f-97ac-a70ae99dfaf3 tempest-TestVolumeBootPattern-335270863 tempest-TestVolumeBootPattern-335270863-project] [6867ed6b-5a6e-44db-b819-8aeabd0fe303] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 42792. Jul 28 20:28:14.034193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1b74586a-002f-4b9f-97ac-a70ae99dfaf3 tempest-TestVolumeBootPattern-335270863 tempest-TestVolumeBootPattern-335270863-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1073186432" status: 202 len: 0 microversion: 2.1 time: 1.039689 Jul 28 20:28:14.034771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1609/3076] 10.222.0.67 () {58 vars in 1263 bytes} [Thu Jul 28 20:28:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1073186432 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:28:14.733378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e9333462-4352-4c50-a501-6bce571a4036 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:14.734131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e9333462-4352-4c50-a501-6bce571a4036 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:14.740612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9333462-4352-4c50-a501-6bce571a4036 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:14.741058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9333462-4352-4c50-a501-6bce571a4036 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:14.741830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9333462-4352-4c50-a501-6bce571a4036 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:14.742245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e9333462-4352-4c50-a501-6bce571a4036 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:14.877358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e9333462-4352-4c50-a501-6bce571a4036 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:14.879579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=100 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:28:14.889546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e9333462-4352-4c50-a501-6bce571a4036 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.160695 Jul 28 20:28:14.890124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1468/3077] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:15.911796 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6de12e47-943e-4615-865d-c680c2200fa5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:15.912636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6de12e47-943e-4615-865d-c680c2200fa5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:15.921128 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6de12e47-943e-4615-865d-c680c2200fa5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:15.921736 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6de12e47-943e-4615-865d-c680c2200fa5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:15.922619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6de12e47-943e-4615-865d-c680c2200fa5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:15.923156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6de12e47-943e-4615-865d-c680c2200fa5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:16.068389 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6de12e47-943e-4615-865d-c680c2200fa5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:16.076957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6de12e47-943e-4615-865d-c680c2200fa5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.169544 Jul 28 20:28:16.077539 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1610/3078] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:17.099552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b37b7978-734d-4a25-be37-c4cc52596d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:17.100837 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b37b7978-734d-4a25-be37-c4cc52596d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:17.111416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b37b7978-734d-4a25-be37-c4cc52596d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:17.111881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b37b7978-734d-4a25-be37-c4cc52596d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:17.112734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b37b7978-734d-4a25-be37-c4cc52596d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:17.113498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b37b7978-734d-4a25-be37-c4cc52596d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:17.314863 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b37b7978-734d-4a25-be37-c4cc52596d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:17.323822 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b37b7978-734d-4a25-be37-c4cc52596d19 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.228836 Jul 28 20:28:17.324396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1469/3079] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:18.345670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-860c4c9f-5e2a-4c87-a1c4-64565c85bb72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:18.346242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-860c4c9f-5e2a-4c87-a1c4-64565c85bb72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:18.352698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-860c4c9f-5e2a-4c87-a1c4-64565c85bb72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:18.353148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-860c4c9f-5e2a-4c87-a1c4-64565c85bb72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:18.353902 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-860c4c9f-5e2a-4c87-a1c4-64565c85bb72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:18.354333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-860c4c9f-5e2a-4c87-a1c4-64565c85bb72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:18.487370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-860c4c9f-5e2a-4c87-a1c4-64565c85bb72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:18.498901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-860c4c9f-5e2a-4c87-a1c4-64565c85bb72 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.157066 Jul 28 20:28:18.499478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1611/3080] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:28:19.519996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c03800f8-14d4-4450-abc0-0f105bf62b00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:19.520640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c03800f8-14d4-4450-abc0-0f105bf62b00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:19.527531 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c03800f8-14d4-4450-abc0-0f105bf62b00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:19.528019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c03800f8-14d4-4450-abc0-0f105bf62b00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:19.528802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c03800f8-14d4-4450-abc0-0f105bf62b00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:19.529232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c03800f8-14d4-4450-abc0-0f105bf62b00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:19.666022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c03800f8-14d4-4450-abc0-0f105bf62b00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:19.674700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c03800f8-14d4-4450-abc0-0f105bf62b00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158560 Jul 28 20:28:19.675208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1470/3081] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:20.697059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7c36494e-f503-4f9a-9950-7cdaa9148e81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:20.697782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7c36494e-f503-4f9a-9950-7cdaa9148e81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:20.704497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c36494e-f503-4f9a-9950-7cdaa9148e81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:20.705048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c36494e-f503-4f9a-9950-7cdaa9148e81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:20.705900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c36494e-f503-4f9a-9950-7cdaa9148e81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:20.706400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c36494e-f503-4f9a-9950-7cdaa9148e81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:20.710412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=90 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:28:20.866156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7c36494e-f503-4f9a-9950-7cdaa9148e81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:20.877503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7c36494e-f503-4f9a-9950-7cdaa9148e81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.184239 Jul 28 20:28:20.878050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1612/3082] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:21.899001 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9c65e039-00ff-4e2b-b68b-1b34d080be2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:21.899611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9c65e039-00ff-4e2b-b68b-1b34d080be2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:21.906748 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9c65e039-00ff-4e2b-b68b-1b34d080be2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:21.907198 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9c65e039-00ff-4e2b-b68b-1b34d080be2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:21.907950 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9c65e039-00ff-4e2b-b68b-1b34d080be2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:21.908385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9c65e039-00ff-4e2b-b68b-1b34d080be2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:22.035896 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9c65e039-00ff-4e2b-b68b-1b34d080be2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:22.044319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9c65e039-00ff-4e2b-b68b-1b34d080be2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148629 Jul 28 20:28:22.044972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1471/3083] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:23.066405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ea6618f1-d1fa-4d78-83af-1214c4a7ece2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:23.066998 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ea6618f1-d1fa-4d78-83af-1214c4a7ece2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:23.073576 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea6618f1-d1fa-4d78-83af-1214c4a7ece2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:23.074025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea6618f1-d1fa-4d78-83af-1214c4a7ece2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:23.075416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea6618f1-d1fa-4d78-83af-1214c4a7ece2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:23.075870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ea6618f1-d1fa-4d78-83af-1214c4a7ece2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:23.208501 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ea6618f1-d1fa-4d78-83af-1214c4a7ece2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:23.216405 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ea6618f1-d1fa-4d78-83af-1214c4a7ece2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154165 Jul 28 20:28:23.216986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1613/3084] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:24.238074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fb504f77-8f76-4933-be0e-e72d92677bef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:24.238682 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fb504f77-8f76-4933-be0e-e72d92677bef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:24.245127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb504f77-8f76-4933-be0e-e72d92677bef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:24.245567 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb504f77-8f76-4933-be0e-e72d92677bef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:24.246305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb504f77-8f76-4933-be0e-e72d92677bef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:24.247419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb504f77-8f76-4933-be0e-e72d92677bef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:24.393126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fb504f77-8f76-4933-be0e-e72d92677bef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:24.401226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fb504f77-8f76-4933-be0e-e72d92677bef tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.167006 Jul 28 20:28:24.401778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1472/3085] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:25.423001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2659d2b3-2d12-40b7-af72-65ed90d19227 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:25.423565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2659d2b3-2d12-40b7-af72-65ed90d19227 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:25.430025 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2659d2b3-2d12-40b7-af72-65ed90d19227 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:25.430472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2659d2b3-2d12-40b7-af72-65ed90d19227 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:25.431220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2659d2b3-2d12-40b7-af72-65ed90d19227 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:25.431649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2659d2b3-2d12-40b7-af72-65ed90d19227 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:25.563583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2659d2b3-2d12-40b7-af72-65ed90d19227 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:25.571697 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2659d2b3-2d12-40b7-af72-65ed90d19227 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153732 Jul 28 20:28:25.572253 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1614/3086] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:26.600937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-de3bd9cf-0d58-40fc-87a8-bcdf352f2340 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:26.601540 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-de3bd9cf-0d58-40fc-87a8-bcdf352f2340 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:26.608649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de3bd9cf-0d58-40fc-87a8-bcdf352f2340 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:26.609089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de3bd9cf-0d58-40fc-87a8-bcdf352f2340 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:26.609827 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de3bd9cf-0d58-40fc-87a8-bcdf352f2340 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:26.610250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de3bd9cf-0d58-40fc-87a8-bcdf352f2340 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:26.739934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-de3bd9cf-0d58-40fc-87a8-bcdf352f2340 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:26.748508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-de3bd9cf-0d58-40fc-87a8-bcdf352f2340 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151399 Jul 28 20:28:26.749087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1473/3087] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:27.769733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-12805f84-763f-4e0d-bb97-cb2dd8b17624 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:27.770340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-12805f84-763f-4e0d-bb97-cb2dd8b17624 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:27.777023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12805f84-763f-4e0d-bb97-cb2dd8b17624 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:27.777464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12805f84-763f-4e0d-bb97-cb2dd8b17624 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:27.778271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12805f84-763f-4e0d-bb97-cb2dd8b17624 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:27.778847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-12805f84-763f-4e0d-bb97-cb2dd8b17624 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:27.904691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-12805f84-763f-4e0d-bb97-cb2dd8b17624 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:27.912582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-12805f84-763f-4e0d-bb97-cb2dd8b17624 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146726 Jul 28 20:28:27.913153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1615/3088] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:28.933787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3bc30bec-b662-47a2-8ed1-726591754f9a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:28.935041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3bc30bec-b662-47a2-8ed1-726591754f9a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:28.937450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=28 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:28:28.942952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3bc30bec-b662-47a2-8ed1-726591754f9a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:28.943401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3bc30bec-b662-47a2-8ed1-726591754f9a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:28.944158 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3bc30bec-b662-47a2-8ed1-726591754f9a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:28.944621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3bc30bec-b662-47a2-8ed1-726591754f9a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:29.070668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3bc30bec-b662-47a2-8ed1-726591754f9a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:29.079148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3bc30bec-b662-47a2-8ed1-726591754f9a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149220 Jul 28 20:28:29.079713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1474/3089] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:30.100873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8148b769-2f5c-4a9a-8f53-8c68cb577654 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:30.101478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8148b769-2f5c-4a9a-8f53-8c68cb577654 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:30.108871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8148b769-2f5c-4a9a-8f53-8c68cb577654 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:30.109311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8148b769-2f5c-4a9a-8f53-8c68cb577654 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:30.110051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8148b769-2f5c-4a9a-8f53-8c68cb577654 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:30.110475 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8148b769-2f5c-4a9a-8f53-8c68cb577654 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:30.238668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8148b769-2f5c-4a9a-8f53-8c68cb577654 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:30.246452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8148b769-2f5c-4a9a-8f53-8c68cb577654 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149405 Jul 28 20:28:30.247863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1616/3090] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:31.268497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e1f87d64-a738-475f-b7a0-546b18b88884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:31.269130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e1f87d64-a738-475f-b7a0-546b18b88884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:31.275607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e1f87d64-a738-475f-b7a0-546b18b88884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:31.276056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e1f87d64-a738-475f-b7a0-546b18b88884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:31.276829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e1f87d64-a738-475f-b7a0-546b18b88884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:31.277264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e1f87d64-a738-475f-b7a0-546b18b88884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:31.409617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e1f87d64-a738-475f-b7a0-546b18b88884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:31.417990 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e1f87d64-a738-475f-b7a0-546b18b88884 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153289 Jul 28 20:28:31.418595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1475/3091] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:32.055953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:28:32.056251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:28:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:28:32.439196 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9ff3b7b1-056d-4508-b06d-c32d35e8bb76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:32.439812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9ff3b7b1-056d-4508-b06d-c32d35e8bb76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:32.442142 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:28:32.447862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ff3b7b1-056d-4508-b06d-c32d35e8bb76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:32.448311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ff3b7b1-056d-4508-b06d-c32d35e8bb76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:32.449104 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ff3b7b1-056d-4508-b06d-c32d35e8bb76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:32.449538 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9ff3b7b1-056d-4508-b06d-c32d35e8bb76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:32.580888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9ff3b7b1-056d-4508-b06d-c32d35e8bb76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:32.588856 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9ff3b7b1-056d-4508-b06d-c32d35e8bb76 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153495 Jul 28 20:28:32.589420 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1617/3092] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:33.612124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-47c97e07-2a39-4bbe-b4d0-ebc5e8f41e56 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:33.612780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-47c97e07-2a39-4bbe-b4d0-ebc5e8f41e56 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:33.619361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47c97e07-2a39-4bbe-b4d0-ebc5e8f41e56 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:33.619810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47c97e07-2a39-4bbe-b4d0-ebc5e8f41e56 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:33.620581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47c97e07-2a39-4bbe-b4d0-ebc5e8f41e56 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:33.621017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47c97e07-2a39-4bbe-b4d0-ebc5e8f41e56 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:33.752181 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-47c97e07-2a39-4bbe-b4d0-ebc5e8f41e56 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:33.760108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-47c97e07-2a39-4bbe-b4d0-ebc5e8f41e56 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151876 Jul 28 20:28:33.760691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1476/3093] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:34.781515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f3f7d1f6-af2e-4e65-b9ba-26de980c202b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:34.782076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f3f7d1f6-af2e-4e65-b9ba-26de980c202b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:34.788590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3f7d1f6-af2e-4e65-b9ba-26de980c202b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:34.789039 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3f7d1f6-af2e-4e65-b9ba-26de980c202b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:34.789782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3f7d1f6-af2e-4e65-b9ba-26de980c202b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:34.790210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3f7d1f6-af2e-4e65-b9ba-26de980c202b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:34.920754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f3f7d1f6-af2e-4e65-b9ba-26de980c202b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:34.929801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f3f7d1f6-af2e-4e65-b9ba-26de980c202b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152430 Jul 28 20:28:34.930378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1618/3094] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:35.952495 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bb037780-1240-4104-b5af-e4bea30a8bbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:35.953144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bb037780-1240-4104-b5af-e4bea30a8bbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:35.959558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb037780-1240-4104-b5af-e4bea30a8bbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:35.960006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb037780-1240-4104-b5af-e4bea30a8bbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:35.960787 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb037780-1240-4104-b5af-e4bea30a8bbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:35.961223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb037780-1240-4104-b5af-e4bea30a8bbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:36.088852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bb037780-1240-4104-b5af-e4bea30a8bbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:36.097485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bb037780-1240-4104-b5af-e4bea30a8bbc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149360 Jul 28 20:28:36.098043 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1477/3095] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:37.118441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-268134a3-38d9-467b-9d78-83c92f2b4c84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:37.119049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-268134a3-38d9-467b-9d78-83c92f2b4c84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:37.126608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-268134a3-38d9-467b-9d78-83c92f2b4c84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:37.127052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-268134a3-38d9-467b-9d78-83c92f2b4c84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:37.127881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-268134a3-38d9-467b-9d78-83c92f2b4c84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:37.135433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-268134a3-38d9-467b-9d78-83c92f2b4c84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:37.266036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-268134a3-38d9-467b-9d78-83c92f2b4c84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:37.273907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-268134a3-38d9-467b-9d78-83c92f2b4c84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.159374 Jul 28 20:28:37.274463 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1619/3096] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:38.296451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cc1b2977-c9f0-4122-81aa-1efc0926b3e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:38.297097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cc1b2977-c9f0-4122-81aa-1efc0926b3e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:38.304568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc1b2977-c9f0-4122-81aa-1efc0926b3e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:38.305022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc1b2977-c9f0-4122-81aa-1efc0926b3e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:38.305775 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc1b2977-c9f0-4122-81aa-1efc0926b3e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:38.306208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cc1b2977-c9f0-4122-81aa-1efc0926b3e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:38.608410 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 28 20:28:38.609186 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:28:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:28:38.649915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cc1b2977-c9f0-4122-81aa-1efc0926b3e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:38.659179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cc1b2977-c9f0-4122-81aa-1efc0926b3e3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.367162 Jul 28 20:28:38.659731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1478/3097] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:39.680592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6aa23692-816a-4b24-a3ba-74f4a3d8432c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:39.681189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6aa23692-816a-4b24-a3ba-74f4a3d8432c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:39.688809 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6aa23692-816a-4b24-a3ba-74f4a3d8432c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:39.689256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6aa23692-816a-4b24-a3ba-74f4a3d8432c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:39.690007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6aa23692-816a-4b24-a3ba-74f4a3d8432c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:39.690435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6aa23692-816a-4b24-a3ba-74f4a3d8432c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:39.819508 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6aa23692-816a-4b24-a3ba-74f4a3d8432c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:39.827455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6aa23692-816a-4b24-a3ba-74f4a3d8432c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150719 Jul 28 20:28:39.828007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1620/3098] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:28:40.848693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e263d73-8671-4e1b-8cf6-e8c51f6b3578 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:40.849301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9e263d73-8671-4e1b-8cf6-e8c51f6b3578 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:40.855792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e263d73-8671-4e1b-8cf6-e8c51f6b3578 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:40.856236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e263d73-8671-4e1b-8cf6-e8c51f6b3578 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:40.858441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e263d73-8671-4e1b-8cf6-e8c51f6b3578 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:40.858882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e263d73-8671-4e1b-8cf6-e8c51f6b3578 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:41.001520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9e263d73-8671-4e1b-8cf6-e8c51f6b3578 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:41.009396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e263d73-8671-4e1b-8cf6-e8c51f6b3578 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.164613 Jul 28 20:28:41.009958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1479/3099] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:42.031228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a631ded7-e5d2-4872-99f9-734ccc708fdb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:42.031868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a631ded7-e5d2-4872-99f9-734ccc708fdb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:42.038297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a631ded7-e5d2-4872-99f9-734ccc708fdb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:42.038743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a631ded7-e5d2-4872-99f9-734ccc708fdb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:42.039499 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a631ded7-e5d2-4872-99f9-734ccc708fdb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:42.039930 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a631ded7-e5d2-4872-99f9-734ccc708fdb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:42.165212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a631ded7-e5d2-4872-99f9-734ccc708fdb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:42.173572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a631ded7-e5d2-4872-99f9-734ccc708fdb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146379 Jul 28 20:28:42.174133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1621/3100] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:43.195201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-db7b9760-e5b0-46aa-b737-e204adcb34f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:43.195820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-db7b9760-e5b0-46aa-b737-e204adcb34f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:43.203064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db7b9760-e5b0-46aa-b737-e204adcb34f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:43.203517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db7b9760-e5b0-46aa-b737-e204adcb34f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:43.204275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db7b9760-e5b0-46aa-b737-e204adcb34f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:43.204747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-db7b9760-e5b0-46aa-b737-e204adcb34f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:43.332800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-db7b9760-e5b0-46aa-b737-e204adcb34f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:43.340807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-db7b9760-e5b0-46aa-b737-e204adcb34f6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149346 Jul 28 20:28:43.341572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1480/3101] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:28:44.361575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-98c7c301-cd7f-40e6-bcbe-822fa1e67b9e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:44.362184 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-98c7c301-cd7f-40e6-bcbe-822fa1e67b9e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:44.368653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98c7c301-cd7f-40e6-bcbe-822fa1e67b9e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:44.369103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98c7c301-cd7f-40e6-bcbe-822fa1e67b9e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:44.369849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98c7c301-cd7f-40e6-bcbe-822fa1e67b9e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:44.370280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98c7c301-cd7f-40e6-bcbe-822fa1e67b9e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:44.495826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-98c7c301-cd7f-40e6-bcbe-822fa1e67b9e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:44.504415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-98c7c301-cd7f-40e6-bcbe-822fa1e67b9e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146663 Jul 28 20:28:44.505037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1622/3102] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:45.527803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5a657b82-e896-492d-a67e-5c12815e7e2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:45.529442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5a657b82-e896-492d-a67e-5c12815e7e2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:45.535942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a657b82-e896-492d-a67e-5c12815e7e2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:45.536391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a657b82-e896-492d-a67e-5c12815e7e2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:45.537180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a657b82-e896-492d-a67e-5c12815e7e2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:45.537610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a657b82-e896-492d-a67e-5c12815e7e2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:45.541465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=74 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:28:45.667393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5a657b82-e896-492d-a67e-5c12815e7e2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:45.676391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5a657b82-e896-492d-a67e-5c12815e7e2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152795 Jul 28 20:28:45.676980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1481/3103] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:46.697812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4fdceab3-2eb4-4cd7-be76-6a671b954ac1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:46.698449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4fdceab3-2eb4-4cd7-be76-6a671b954ac1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:46.705171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4fdceab3-2eb4-4cd7-be76-6a671b954ac1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:46.705610 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4fdceab3-2eb4-4cd7-be76-6a671b954ac1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:46.706354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4fdceab3-2eb4-4cd7-be76-6a671b954ac1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:46.706780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4fdceab3-2eb4-4cd7-be76-6a671b954ac1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:46.836603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4fdceab3-2eb4-4cd7-be76-6a671b954ac1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:46.844438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4fdceab3-2eb4-4cd7-be76-6a671b954ac1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150439 Jul 28 20:28:46.845108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1623/3104] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:47.866803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-25a579e8-b6e7-498f-8d5d-a032fd06f377 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:47.867420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-25a579e8-b6e7-498f-8d5d-a032fd06f377 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:47.874503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25a579e8-b6e7-498f-8d5d-a032fd06f377 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:47.874945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25a579e8-b6e7-498f-8d5d-a032fd06f377 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:47.875689 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25a579e8-b6e7-498f-8d5d-a032fd06f377 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:47.876116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-25a579e8-b6e7-498f-8d5d-a032fd06f377 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:48.002345 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-25a579e8-b6e7-498f-8d5d-a032fd06f377 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:48.010267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-25a579e8-b6e7-498f-8d5d-a032fd06f377 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147342 Jul 28 20:28:48.010825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1482/3105] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:49.033307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fc4486d3-df04-4c97-8dbf-dab33ebbf53a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:49.033950 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fc4486d3-df04-4c97-8dbf-dab33ebbf53a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:49.040391 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc4486d3-df04-4c97-8dbf-dab33ebbf53a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:49.040870 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc4486d3-df04-4c97-8dbf-dab33ebbf53a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:49.041619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc4486d3-df04-4c97-8dbf-dab33ebbf53a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:49.042051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fc4486d3-df04-4c97-8dbf-dab33ebbf53a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:49.173533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fc4486d3-df04-4c97-8dbf-dab33ebbf53a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:49.181354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fc4486d3-df04-4c97-8dbf-dab33ebbf53a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151896 Jul 28 20:28:49.181903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1624/3106] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:50.203231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9e678d1a-c29d-455c-a778-3a5a4c4cb26e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:50.203844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9e678d1a-c29d-455c-a778-3a5a4c4cb26e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:50.210342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e678d1a-c29d-455c-a778-3a5a4c4cb26e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:50.210790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e678d1a-c29d-455c-a778-3a5a4c4cb26e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:50.211547 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e678d1a-c29d-455c-a778-3a5a4c4cb26e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:50.211986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9e678d1a-c29d-455c-a778-3a5a4c4cb26e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:50.269493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:28:50.269737 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:28:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed (ip 10.222.0.67) !!! Jul 28 20:28:50.354385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9e678d1a-c29d-455c-a778-3a5a4c4cb26e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:50.363906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9e678d1a-c29d-455c-a778-3a5a4c4cb26e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.164495 Jul 28 20:28:50.364493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1483/3107] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:51.389054 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4c46a00b-9c47-4d21-b0f5-7e625d340a0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:51.389675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4c46a00b-9c47-4d21-b0f5-7e625d340a0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:51.396108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c46a00b-9c47-4d21-b0f5-7e625d340a0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:51.396592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c46a00b-9c47-4d21-b0f5-7e625d340a0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:51.397347 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c46a00b-9c47-4d21-b0f5-7e625d340a0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:51.397781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c46a00b-9c47-4d21-b0f5-7e625d340a0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:51.400614 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:28:51.528268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4c46a00b-9c47-4d21-b0f5-7e625d340a0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:51.536938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4c46a00b-9c47-4d21-b0f5-7e625d340a0a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151733 Jul 28 20:28:51.537497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1625/3108] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:52.558639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a34fac0c-0dc6-46c9-9ef3-c3f3e1c76fc1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:52.559246 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a34fac0c-0dc6-46c9-9ef3-c3f3e1c76fc1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:52.566373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a34fac0c-0dc6-46c9-9ef3-c3f3e1c76fc1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:52.566911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a34fac0c-0dc6-46c9-9ef3-c3f3e1c76fc1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:52.567740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a34fac0c-0dc6-46c9-9ef3-c3f3e1c76fc1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:52.568208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a34fac0c-0dc6-46c9-9ef3-c3f3e1c76fc1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:52.698262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a34fac0c-0dc6-46c9-9ef3-c3f3e1c76fc1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:52.706206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a34fac0c-0dc6-46c9-9ef3-c3f3e1c76fc1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151380 Jul 28 20:28:52.706762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1484/3109] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:53.727187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-23eab84e-d332-47e9-a473-8f6ed0c1b3b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:53.727800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-23eab84e-d332-47e9-a473-8f6ed0c1b3b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:53.735007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23eab84e-d332-47e9-a473-8f6ed0c1b3b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:53.735452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23eab84e-d332-47e9-a473-8f6ed0c1b3b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:53.736205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23eab84e-d332-47e9-a473-8f6ed0c1b3b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:53.736671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23eab84e-d332-47e9-a473-8f6ed0c1b3b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:53.865837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-23eab84e-d332-47e9-a473-8f6ed0c1b3b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:53.873984 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-23eab84e-d332-47e9-a473-8f6ed0c1b3b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150689 Jul 28 20:28:53.874542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1626/3110] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:54.895180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-a62cda3a-b283-428c-9cb3-89fe6b7b54ca tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:54.895726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-a62cda3a-b283-428c-9cb3-89fe6b7b54ca tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:54.902447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a62cda3a-b283-428c-9cb3-89fe6b7b54ca tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:54.902955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a62cda3a-b283-428c-9cb3-89fe6b7b54ca tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:54.903769 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a62cda3a-b283-428c-9cb3-89fe6b7b54ca tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:54.904290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-a62cda3a-b283-428c-9cb3-89fe6b7b54ca tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:55.043140 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-a62cda3a-b283-428c-9cb3-89fe6b7b54ca tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:55.053428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-a62cda3a-b283-428c-9cb3-89fe6b7b54ca tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.162034 Jul 28 20:28:55.054097 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1485/3111] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:56.075449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5a12ab6c-9252-4775-85ba-c5cbdbb62fce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:56.077326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5a12ab6c-9252-4775-85ba-c5cbdbb62fce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:56.083324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a12ab6c-9252-4775-85ba-c5cbdbb62fce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:56.083771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a12ab6c-9252-4775-85ba-c5cbdbb62fce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:56.084529 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a12ab6c-9252-4775-85ba-c5cbdbb62fce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:56.084988 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a12ab6c-9252-4775-85ba-c5cbdbb62fce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:56.214430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5a12ab6c-9252-4775-85ba-c5cbdbb62fce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:56.222520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5a12ab6c-9252-4775-85ba-c5cbdbb62fce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151013 Jul 28 20:28:56.223069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1627/3112] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:57.244275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9bd678eb-9490-4b2d-948f-2967924ddb71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:57.244986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9bd678eb-9490-4b2d-948f-2967924ddb71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:57.252453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9bd678eb-9490-4b2d-948f-2967924ddb71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:57.252937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9bd678eb-9490-4b2d-948f-2967924ddb71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:57.253697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9bd678eb-9490-4b2d-948f-2967924ddb71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:57.254135 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9bd678eb-9490-4b2d-948f-2967924ddb71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:57.390778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9bd678eb-9490-4b2d-948f-2967924ddb71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:57.398621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9bd678eb-9490-4b2d-948f-2967924ddb71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158295 Jul 28 20:28:57.399179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1486/3113] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:58.420912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1e614001-b179-4973-8364-a5327a27248f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:58.421501 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1e614001-b179-4973-8364-a5327a27248f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:58.428367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e614001-b179-4973-8364-a5327a27248f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:58.428878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e614001-b179-4973-8364-a5327a27248f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:58.429669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e614001-b179-4973-8364-a5327a27248f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:58.430132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1e614001-b179-4973-8364-a5327a27248f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:58.566021 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1e614001-b179-4973-8364-a5327a27248f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:58.574494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1e614001-b179-4973-8364-a5327a27248f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.157895 Jul 28 20:28:58.575064 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1628/3114] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:58 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:28:59.595867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-40d850ad-a76b-4595-a710-ee7c5a292f47 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:28:59.596582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-40d850ad-a76b-4595-a710-ee7c5a292f47 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:28:59.598901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=26 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:28:59.604115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40d850ad-a76b-4595-a710-ee7c5a292f47 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:59.604585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40d850ad-a76b-4595-a710-ee7c5a292f47 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:59.605351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40d850ad-a76b-4595-a710-ee7c5a292f47 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:28:59.605784 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40d850ad-a76b-4595-a710-ee7c5a292f47 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:28:59.738212 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-40d850ad-a76b-4595-a710-ee7c5a292f47 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:28:59.746010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-40d850ad-a76b-4595-a710-ee7c5a292f47 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154732 Jul 28 20:28:59.746660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1487/3115] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:28:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:00.767888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-85006c1e-9aaa-4a99-af4f-3adb36407716 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:00.768456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-85006c1e-9aaa-4a99-af4f-3adb36407716 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:00.775143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85006c1e-9aaa-4a99-af4f-3adb36407716 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:00.775600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85006c1e-9aaa-4a99-af4f-3adb36407716 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:00.776354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85006c1e-9aaa-4a99-af4f-3adb36407716 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:00.776816 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85006c1e-9aaa-4a99-af4f-3adb36407716 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:00.914632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-85006c1e-9aaa-4a99-af4f-3adb36407716 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:00.923133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-85006c1e-9aaa-4a99-af4f-3adb36407716 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.159736 Jul 28 20:29:00.923696 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1629/3116] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:01.944831 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0e7b06fe-8f4d-410e-8bf3-db8de6fca3e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:01.945440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0e7b06fe-8f4d-410e-8bf3-db8de6fca3e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:01.951560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e7b06fe-8f4d-410e-8bf3-db8de6fca3e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:01.952005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e7b06fe-8f4d-410e-8bf3-db8de6fca3e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:01.953543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e7b06fe-8f4d-410e-8bf3-db8de6fca3e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:01.953978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0e7b06fe-8f4d-410e-8bf3-db8de6fca3e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:02.308154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0e7b06fe-8f4d-410e-8bf3-db8de6fca3e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:02.317195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0e7b06fe-8f4d-410e-8bf3-db8de6fca3e9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.376369 Jul 28 20:29:02.317984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1488/3117] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:03.337528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5a4ae3f9-b0ba-497b-abc3-09ff4145007f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:03.338158 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5a4ae3f9-b0ba-497b-abc3-09ff4145007f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:03.339990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=26 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:29:03.346029 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a4ae3f9-b0ba-497b-abc3-09ff4145007f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:03.346473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a4ae3f9-b0ba-497b-abc3-09ff4145007f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:03.347231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a4ae3f9-b0ba-497b-abc3-09ff4145007f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:03.347661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a4ae3f9-b0ba-497b-abc3-09ff4145007f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:03.554785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5a4ae3f9-b0ba-497b-abc3-09ff4145007f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:03.562777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5a4ae3f9-b0ba-497b-abc3-09ff4145007f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.229234 Jul 28 20:29:03.563336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1630/3118] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:04.584199 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b6e492b6-78b3-4ff7-ab30-1991beb8ff71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:04.584825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b6e492b6-78b3-4ff7-ab30-1991beb8ff71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:04.591456 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6e492b6-78b3-4ff7-ab30-1991beb8ff71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:04.591897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6e492b6-78b3-4ff7-ab30-1991beb8ff71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:04.592811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6e492b6-78b3-4ff7-ab30-1991beb8ff71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:04.593395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6e492b6-78b3-4ff7-ab30-1991beb8ff71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:04.724039 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b6e492b6-78b3-4ff7-ab30-1991beb8ff71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:04.731851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b6e492b6-78b3-4ff7-ab30-1991beb8ff71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151512 Jul 28 20:29:04.732401 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1489/3119] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:05.891537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5178785f-471c-46e3-8f9c-1b36aa8f0fd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:05.892167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5178785f-471c-46e3-8f9c-1b36aa8f0fd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:05.898394 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5178785f-471c-46e3-8f9c-1b36aa8f0fd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:05.898834 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5178785f-471c-46e3-8f9c-1b36aa8f0fd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:05.899582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5178785f-471c-46e3-8f9c-1b36aa8f0fd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:05.900265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5178785f-471c-46e3-8f9c-1b36aa8f0fd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:06.033958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5178785f-471c-46e3-8f9c-1b36aa8f0fd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:06.041830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5178785f-471c-46e3-8f9c-1b36aa8f0fd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.292429 Jul 28 20:29:06.042382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1631/3120] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:07.063580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-971d5b8b-7f09-49e7-8ea3-4b3c597aabb9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:07.064183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-971d5b8b-7f09-49e7-8ea3-4b3c597aabb9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:07.073098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-971d5b8b-7f09-49e7-8ea3-4b3c597aabb9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:07.073540 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-971d5b8b-7f09-49e7-8ea3-4b3c597aabb9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:07.074286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-971d5b8b-7f09-49e7-8ea3-4b3c597aabb9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:07.074711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-971d5b8b-7f09-49e7-8ea3-4b3c597aabb9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:07.212362 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-971d5b8b-7f09-49e7-8ea3-4b3c597aabb9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:07.221210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-971d5b8b-7f09-49e7-8ea3-4b3c597aabb9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.161614 Jul 28 20:29:07.221776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1490/3121] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:08.242154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5014767c-df71-4275-a3d1-efa2584799cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:08.242758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5014767c-df71-4275-a3d1-efa2584799cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:08.249271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5014767c-df71-4275-a3d1-efa2584799cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:08.249709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5014767c-df71-4275-a3d1-efa2584799cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:08.250448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5014767c-df71-4275-a3d1-efa2584799cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:08.250875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5014767c-df71-4275-a3d1-efa2584799cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:08.378912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5014767c-df71-4275-a3d1-efa2584799cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:08.386767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5014767c-df71-4275-a3d1-efa2584799cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148428 Jul 28 20:29:08.387327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1632/3122] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:09.408785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c7a31263-a9e6-4bfb-a8d3-721475cefec6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:09.409395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c7a31263-a9e6-4bfb-a8d3-721475cefec6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:09.415843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c7a31263-a9e6-4bfb-a8d3-721475cefec6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:09.416286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c7a31263-a9e6-4bfb-a8d3-721475cefec6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:09.417112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c7a31263-a9e6-4bfb-a8d3-721475cefec6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:09.417485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c7a31263-a9e6-4bfb-a8d3-721475cefec6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:09.548108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c7a31263-a9e6-4bfb-a8d3-721475cefec6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:09.556596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c7a31263-a9e6-4bfb-a8d3-721475cefec6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152130 Jul 28 20:29:09.557153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1491/3123] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:09 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:10.576979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-982ec0c8-10a1-4552-a613-b91b34bece1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:10.577594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-982ec0c8-10a1-4552-a613-b91b34bece1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:10.584727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-982ec0c8-10a1-4552-a613-b91b34bece1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:10.585174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-982ec0c8-10a1-4552-a613-b91b34bece1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:10.585923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-982ec0c8-10a1-4552-a613-b91b34bece1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:10.586350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-982ec0c8-10a1-4552-a613-b91b34bece1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:10.717451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-982ec0c8-10a1-4552-a613-b91b34bece1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:10.726047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-982ec0c8-10a1-4552-a613-b91b34bece1a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152957 Jul 28 20:29:10.726612 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1633/3124] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:11.747826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-738e4110-aadb-4c63-b3bd-7a74d23c5fe9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:11.748447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-738e4110-aadb-4c63-b3bd-7a74d23c5fe9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:11.755003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-738e4110-aadb-4c63-b3bd-7a74d23c5fe9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:11.755452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-738e4110-aadb-4c63-b3bd-7a74d23c5fe9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:11.756195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-738e4110-aadb-4c63-b3bd-7a74d23c5fe9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:11.756649 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-738e4110-aadb-4c63-b3bd-7a74d23c5fe9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:11.885358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-738e4110-aadb-4c63-b3bd-7a74d23c5fe9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:11.893277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-738e4110-aadb-4c63-b3bd-7a74d23c5fe9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149352 Jul 28 20:29:11.893830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1492/3125] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:12.914981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9dfdb797-3d86-4ce8-b00b-042436a5e55c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:12.915633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9dfdb797-3d86-4ce8-b00b-042436a5e55c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:12.922232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9dfdb797-3d86-4ce8-b00b-042436a5e55c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:12.922852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9dfdb797-3d86-4ce8-b00b-042436a5e55c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:12.923603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9dfdb797-3d86-4ce8-b00b-042436a5e55c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:12.924034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9dfdb797-3d86-4ce8-b00b-042436a5e55c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:13.051219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9dfdb797-3d86-4ce8-b00b-042436a5e55c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:13.059057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9dfdb797-3d86-4ce8-b00b-042436a5e55c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147991 Jul 28 20:29:13.059603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1634/3126] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:14.081348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-133eceac-5ffe-404f-aa37-3356e24d7d3f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:14.081975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-133eceac-5ffe-404f-aa37-3356e24d7d3f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:14.089099 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-133eceac-5ffe-404f-aa37-3356e24d7d3f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:14.089542 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-133eceac-5ffe-404f-aa37-3356e24d7d3f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:14.090288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-133eceac-5ffe-404f-aa37-3356e24d7d3f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:14.090713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-133eceac-5ffe-404f-aa37-3356e24d7d3f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:14.217543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-133eceac-5ffe-404f-aa37-3356e24d7d3f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:14.225807 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-133eceac-5ffe-404f-aa37-3356e24d7d3f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148480 Jul 28 20:29:14.226372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1493/3127] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:15.247367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3b80430a-a583-48f8-b3e7-3e5887f1c632 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:15.247946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3b80430a-a583-48f8-b3e7-3e5887f1c632 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:15.255346 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b80430a-a583-48f8-b3e7-3e5887f1c632 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:15.255823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b80430a-a583-48f8-b3e7-3e5887f1c632 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:15.256591 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b80430a-a583-48f8-b3e7-3e5887f1c632 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:15.257022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b80430a-a583-48f8-b3e7-3e5887f1c632 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:15.401711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3b80430a-a583-48f8-b3e7-3e5887f1c632 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:15.411285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3b80430a-a583-48f8-b3e7-3e5887f1c632 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.167805 Jul 28 20:29:15.412806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1635/3128] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:16.434243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5ffe2581-7eb4-4b6f-b3b2-2f6fd105c135 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:16.434819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5ffe2581-7eb4-4b6f-b3b2-2f6fd105c135 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:16.442779 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ffe2581-7eb4-4b6f-b3b2-2f6fd105c135 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:16.443221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ffe2581-7eb4-4b6f-b3b2-2f6fd105c135 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:16.443977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ffe2581-7eb4-4b6f-b3b2-2f6fd105c135 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:16.444407 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5ffe2581-7eb4-4b6f-b3b2-2f6fd105c135 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:16.448341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:29:16.576000 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5ffe2581-7eb4-4b6f-b3b2-2f6fd105c135 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:16.584308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5ffe2581-7eb4-4b6f-b3b2-2f6fd105c135 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153981 Jul 28 20:29:16.584909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1494/3129] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:17.605637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-19b3e0a1-6a95-4c1f-9856-4caec8650cae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:17.606256 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-19b3e0a1-6a95-4c1f-9856-4caec8650cae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:17.612875 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19b3e0a1-6a95-4c1f-9856-4caec8650cae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:17.613326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19b3e0a1-6a95-4c1f-9856-4caec8650cae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:17.614082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19b3e0a1-6a95-4c1f-9856-4caec8650cae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:17.614516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19b3e0a1-6a95-4c1f-9856-4caec8650cae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:17.748370 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-19b3e0a1-6a95-4c1f-9856-4caec8650cae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:17.756942 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-19b3e0a1-6a95-4c1f-9856-4caec8650cae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155109 Jul 28 20:29:17.757506 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1636/3130] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:18.778826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3d000cab-9222-48db-9575-ca0973180744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:18.779376 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3d000cab-9222-48db-9575-ca0973180744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:18.786510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3d000cab-9222-48db-9575-ca0973180744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:18.786975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3d000cab-9222-48db-9575-ca0973180744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:18.787718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3d000cab-9222-48db-9575-ca0973180744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:18.788143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3d000cab-9222-48db-9575-ca0973180744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:18.914622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3d000cab-9222-48db-9575-ca0973180744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:18.922492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3d000cab-9222-48db-9575-ca0973180744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147830 Jul 28 20:29:18.923047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1495/3131] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:19.944154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-47a2264e-d3a3-4636-88e1-8be9a80be6b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:19.944777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-47a2264e-d3a3-4636-88e1-8be9a80be6b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:19.951272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47a2264e-d3a3-4636-88e1-8be9a80be6b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:19.951708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47a2264e-d3a3-4636-88e1-8be9a80be6b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:19.952443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47a2264e-d3a3-4636-88e1-8be9a80be6b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:19.953663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-47a2264e-d3a3-4636-88e1-8be9a80be6b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:20.080219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-47a2264e-d3a3-4636-88e1-8be9a80be6b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:20.088089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-47a2264e-d3a3-4636-88e1-8be9a80be6b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147726 Jul 28 20:29:20.088657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1637/3132] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:21.110328 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e7cb04f4-cc08-46f2-bf52-bcd6c8f0cd5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:21.110943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e7cb04f4-cc08-46f2-bf52-bcd6c8f0cd5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:21.117450 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7cb04f4-cc08-46f2-bf52-bcd6c8f0cd5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:21.117901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7cb04f4-cc08-46f2-bf52-bcd6c8f0cd5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:21.118685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7cb04f4-cc08-46f2-bf52-bcd6c8f0cd5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:21.119118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e7cb04f4-cc08-46f2-bf52-bcd6c8f0cd5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:21.254432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e7cb04f4-cc08-46f2-bf52-bcd6c8f0cd5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:21.262272 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e7cb04f4-cc08-46f2-bf52-bcd6c8f0cd5a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156869 Jul 28 20:29:21.262826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1496/3133] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:22.283703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4c62a73c-c9e9-40bd-9ef5-beb4fef2abf1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:22.284302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4c62a73c-c9e9-40bd-9ef5-beb4fef2abf1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:22.290884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c62a73c-c9e9-40bd-9ef5-beb4fef2abf1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:22.291327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c62a73c-c9e9-40bd-9ef5-beb4fef2abf1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:22.292074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c62a73c-c9e9-40bd-9ef5-beb4fef2abf1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:22.292498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4c62a73c-c9e9-40bd-9ef5-beb4fef2abf1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:22.296307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:29:22.418512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4c62a73c-c9e9-40bd-9ef5-beb4fef2abf1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:22.426579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4c62a73c-c9e9-40bd-9ef5-beb4fef2abf1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146894 Jul 28 20:29:22.427146 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1638/3134] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:22 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:23.448782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ec0374c8-e793-41b9-91f7-75af2ce6b8d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:23.449343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ec0374c8-e793-41b9-91f7-75af2ce6b8d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:23.455892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec0374c8-e793-41b9-91f7-75af2ce6b8d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:23.456335 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec0374c8-e793-41b9-91f7-75af2ce6b8d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:23.457120 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec0374c8-e793-41b9-91f7-75af2ce6b8d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:23.457551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ec0374c8-e793-41b9-91f7-75af2ce6b8d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:23.585783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ec0374c8-e793-41b9-91f7-75af2ce6b8d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:23.594172 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ec0374c8-e793-41b9-91f7-75af2ce6b8d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149236 Jul 28 20:29:23.594723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1497/3135] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:24.615602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-81dc03c2-ce1f-4cce-a372-a08b9bca4d84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:24.616349 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-81dc03c2-ce1f-4cce-a372-a08b9bca4d84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:24.622852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81dc03c2-ce1f-4cce-a372-a08b9bca4d84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:24.623323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81dc03c2-ce1f-4cce-a372-a08b9bca4d84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:24.624068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81dc03c2-ce1f-4cce-a372-a08b9bca4d84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:24.624495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-81dc03c2-ce1f-4cce-a372-a08b9bca4d84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:24.756341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-81dc03c2-ce1f-4cce-a372-a08b9bca4d84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:24.764276 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-81dc03c2-ce1f-4cce-a372-a08b9bca4d84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152601 Jul 28 20:29:24.764940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1639/3136] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:25.786190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3f597574-ed29-4f06-b904-c8af84739f18 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:25.786788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3f597574-ed29-4f06-b904-c8af84739f18 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:25.793238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3f597574-ed29-4f06-b904-c8af84739f18 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:25.793678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3f597574-ed29-4f06-b904-c8af84739f18 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:25.794430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3f597574-ed29-4f06-b904-c8af84739f18 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:25.794859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3f597574-ed29-4f06-b904-c8af84739f18 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:25.926602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3f597574-ed29-4f06-b904-c8af84739f18 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:25.934455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3f597574-ed29-4f06-b904-c8af84739f18 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152090 Jul 28 20:29:25.935007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1498/3137] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:26.956688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3ec65ee7-407f-4fd8-8a7d-3fdec5a9f747 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:26.957324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3ec65ee7-407f-4fd8-8a7d-3fdec5a9f747 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:26.963695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ec65ee7-407f-4fd8-8a7d-3fdec5a9f747 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:26.964177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ec65ee7-407f-4fd8-8a7d-3fdec5a9f747 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:26.964960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ec65ee7-407f-4fd8-8a7d-3fdec5a9f747 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:26.965392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3ec65ee7-407f-4fd8-8a7d-3fdec5a9f747 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:27.095982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3ec65ee7-407f-4fd8-8a7d-3fdec5a9f747 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:27.104254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3ec65ee7-407f-4fd8-8a7d-3fdec5a9f747 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152292 Jul 28 20:29:27.104849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1640/3138] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:28.125646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cfb757d2-9d05-4aaa-8b07-9ecb36d97f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:28.126999 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cfb757d2-9d05-4aaa-8b07-9ecb36d97f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:28.134078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfb757d2-9d05-4aaa-8b07-9ecb36d97f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:28.134528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfb757d2-9d05-4aaa-8b07-9ecb36d97f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:28.135297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfb757d2-9d05-4aaa-8b07-9ecb36d97f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:28.135736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cfb757d2-9d05-4aaa-8b07-9ecb36d97f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:28.262915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cfb757d2-9d05-4aaa-8b07-9ecb36d97f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:28.271461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cfb757d2-9d05-4aaa-8b07-9ecb36d97f33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149733 Jul 28 20:29:28.272014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1499/3139] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:29.292759 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-52c459e8-f187-4f26-9bdc-1a90507f688a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:29.293371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-52c459e8-f187-4f26-9bdc-1a90507f688a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:29.300462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-52c459e8-f187-4f26-9bdc-1a90507f688a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:29.300932 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-52c459e8-f187-4f26-9bdc-1a90507f688a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:29.301680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-52c459e8-f187-4f26-9bdc-1a90507f688a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:29.302110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-52c459e8-f187-4f26-9bdc-1a90507f688a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:29.433243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-52c459e8-f187-4f26-9bdc-1a90507f688a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:29.441768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-52c459e8-f187-4f26-9bdc-1a90507f688a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152994 Jul 28 20:29:29.442330 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1641/3140] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:29 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:30.462593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3b317ecc-593c-4188-b4d7-f3ac1ec0e0b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:30.463196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3b317ecc-593c-4188-b4d7-f3ac1ec0e0b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:30.465363 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=26 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:29:30.470658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b317ecc-593c-4188-b4d7-f3ac1ec0e0b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:30.471096 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b317ecc-593c-4188-b4d7-f3ac1ec0e0b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:30.471843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b317ecc-593c-4188-b4d7-f3ac1ec0e0b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:30.472265 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b317ecc-593c-4188-b4d7-f3ac1ec0e0b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:30.601421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3b317ecc-593c-4188-b4d7-f3ac1ec0e0b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:30.609420 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3b317ecc-593c-4188-b4d7-f3ac1ec0e0b4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150836 Jul 28 20:29:30.609981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1500/3141] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:31.630960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b05ea7d3-1f7c-40c3-9040-ba179cf1262f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:31.631578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b05ea7d3-1f7c-40c3-9040-ba179cf1262f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:31.637974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b05ea7d3-1f7c-40c3-9040-ba179cf1262f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:31.638414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b05ea7d3-1f7c-40c3-9040-ba179cf1262f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:31.639160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b05ea7d3-1f7c-40c3-9040-ba179cf1262f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:31.639586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b05ea7d3-1f7c-40c3-9040-ba179cf1262f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:31.769414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b05ea7d3-1f7c-40c3-9040-ba179cf1262f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:31.777574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b05ea7d3-1f7c-40c3-9040-ba179cf1262f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150480 Jul 28 20:29:31.778123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1642/3142] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:32.800703 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1d9b3689-9206-4156-b24f-b900d01700ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:32.801315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1d9b3689-9206-4156-b24f-b900d01700ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:32.808447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d9b3689-9206-4156-b24f-b900d01700ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:32.809257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d9b3689-9206-4156-b24f-b900d01700ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:32.810570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d9b3689-9206-4156-b24f-b900d01700ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:32.811325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1d9b3689-9206-4156-b24f-b900d01700ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:32.938974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1d9b3689-9206-4156-b24f-b900d01700ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:32.946850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1d9b3689-9206-4156-b24f-b900d01700ac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150910 Jul 28 20:29:32.947405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1501/3143] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:33.968704 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7c143286-0bf9-4254-a75a-18a0d8a73cd5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:33.969303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7c143286-0bf9-4254-a75a-18a0d8a73cd5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:33.971476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=26 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:29:33.976887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c143286-0bf9-4254-a75a-18a0d8a73cd5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:33.977332 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c143286-0bf9-4254-a75a-18a0d8a73cd5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:33.978085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c143286-0bf9-4254-a75a-18a0d8a73cd5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:33.978518 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7c143286-0bf9-4254-a75a-18a0d8a73cd5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:34.105401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7c143286-0bf9-4254-a75a-18a0d8a73cd5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:34.113752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7c143286-0bf9-4254-a75a-18a0d8a73cd5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149068 Jul 28 20:29:34.114311 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1643/3144] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:35.134810 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-35c2e882-1022-4db2-817f-abcf32673c06 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:35.135535 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-35c2e882-1022-4db2-817f-abcf32673c06 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:35.143290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35c2e882-1022-4db2-817f-abcf32673c06 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:35.143742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35c2e882-1022-4db2-817f-abcf32673c06 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:35.144500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35c2e882-1022-4db2-817f-abcf32673c06 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:35.144964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-35c2e882-1022-4db2-817f-abcf32673c06 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:35.281397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-35c2e882-1022-4db2-817f-abcf32673c06 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:35.290098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-35c2e882-1022-4db2-817f-abcf32673c06 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.159198 Jul 28 20:29:35.290666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1502/3145] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:36.311083 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-51cbf49e-a4dc-40b5-ac51-102d7ff1731c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:36.311714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-51cbf49e-a4dc-40b5-ac51-102d7ff1731c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:36.319062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51cbf49e-a4dc-40b5-ac51-102d7ff1731c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:36.319504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51cbf49e-a4dc-40b5-ac51-102d7ff1731c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:36.320242 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51cbf49e-a4dc-40b5-ac51-102d7ff1731c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:36.320706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-51cbf49e-a4dc-40b5-ac51-102d7ff1731c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:36.447395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-51cbf49e-a4dc-40b5-ac51-102d7ff1731c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:36.456137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-51cbf49e-a4dc-40b5-ac51-102d7ff1731c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148897 Jul 28 20:29:36.456709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1644/3146] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:37.477235 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-77ea1114-ff47-4603-b51b-68af4fee7a00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:37.477881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-77ea1114-ff47-4603-b51b-68af4fee7a00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:37.484287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77ea1114-ff47-4603-b51b-68af4fee7a00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:37.484773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77ea1114-ff47-4603-b51b-68af4fee7a00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:37.486374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77ea1114-ff47-4603-b51b-68af4fee7a00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:37.486809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77ea1114-ff47-4603-b51b-68af4fee7a00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:37.617350 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-77ea1114-ff47-4603-b51b-68af4fee7a00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:37.625354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-77ea1114-ff47-4603-b51b-68af4fee7a00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151930 Jul 28 20:29:37.626780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1503/3147] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:38.647356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cfece61a-b24c-48c7-9d55-767ed766fbd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:38.647963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cfece61a-b24c-48c7-9d55-767ed766fbd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:38.654744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfece61a-b24c-48c7-9d55-767ed766fbd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:38.655195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfece61a-b24c-48c7-9d55-767ed766fbd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:38.655949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfece61a-b24c-48c7-9d55-767ed766fbd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:38.656383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cfece61a-b24c-48c7-9d55-767ed766fbd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:38.781652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cfece61a-b24c-48c7-9d55-767ed766fbd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:38.790271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cfece61a-b24c-48c7-9d55-767ed766fbd9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146786 Jul 28 20:29:38.790832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1645/3148] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:39.811723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2843e492-6d88-4148-be85-d24f0dc5c8c4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:39.812325 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2843e492-6d88-4148-be85-d24f0dc5c8c4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:39.819409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2843e492-6d88-4148-be85-d24f0dc5c8c4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:39.819857 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2843e492-6d88-4148-be85-d24f0dc5c8c4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:39.820631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2843e492-6d88-4148-be85-d24f0dc5c8c4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:39.821066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2843e492-6d88-4148-be85-d24f0dc5c8c4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:39.952174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2843e492-6d88-4148-be85-d24f0dc5c8c4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:39.960259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2843e492-6d88-4148-be85-d24f0dc5c8c4 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152390 Jul 28 20:29:39.960843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1504/3149] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:40.981414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5fc6d7fd-d3d2-4094-b3dd-b71885fb9e8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:40.982035 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5fc6d7fd-d3d2-4094-b3dd-b71885fb9e8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:40.988684 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fc6d7fd-d3d2-4094-b3dd-b71885fb9e8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:40.989137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fc6d7fd-d3d2-4094-b3dd-b71885fb9e8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:40.989925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fc6d7fd-d3d2-4094-b3dd-b71885fb9e8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:40.990354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fc6d7fd-d3d2-4094-b3dd-b71885fb9e8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:41.116733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5fc6d7fd-d3d2-4094-b3dd-b71885fb9e8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:41.124489 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5fc6d7fd-d3d2-4094-b3dd-b71885fb9e8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147010 Jul 28 20:29:41.125065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1646/3150] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:42.147611 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-58adcef5-c1e8-442a-b76b-838c104fd728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:42.148245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-58adcef5-c1e8-442a-b76b-838c104fd728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:42.154965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58adcef5-c1e8-442a-b76b-838c104fd728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:42.155413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58adcef5-c1e8-442a-b76b-838c104fd728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:42.156167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58adcef5-c1e8-442a-b76b-838c104fd728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:42.156631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-58adcef5-c1e8-442a-b76b-838c104fd728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:42.284944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-58adcef5-c1e8-442a-b76b-838c104fd728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:42.292893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-58adcef5-c1e8-442a-b76b-838c104fd728 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149197 Jul 28 20:29:42.293457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1505/3151] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:43.314786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-874953e4-ea32-4098-9938-206e99b36095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:43.315380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-874953e4-ea32-4098-9938-206e99b36095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:43.321867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-874953e4-ea32-4098-9938-206e99b36095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:43.322309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-874953e4-ea32-4098-9938-206e99b36095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:43.323047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-874953e4-ea32-4098-9938-206e99b36095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:43.323473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-874953e4-ea32-4098-9938-206e99b36095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:43.452080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-874953e4-ea32-4098-9938-206e99b36095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:43.460702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-874953e4-ea32-4098-9938-206e99b36095 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150398 Jul 28 20:29:43.461280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1647/3152] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:44.482665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d0349dc5-78c0-4339-8e73-e13b83b9bc60 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:44.483226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d0349dc5-78c0-4339-8e73-e13b83b9bc60 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:44.489856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0349dc5-78c0-4339-8e73-e13b83b9bc60 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:44.490304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0349dc5-78c0-4339-8e73-e13b83b9bc60 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:44.491057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0349dc5-78c0-4339-8e73-e13b83b9bc60 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:44.491490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d0349dc5-78c0-4339-8e73-e13b83b9bc60 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:44.617888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d0349dc5-78c0-4339-8e73-e13b83b9bc60 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:44.626790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d0349dc5-78c0-4339-8e73-e13b83b9bc60 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146967 Jul 28 20:29:44.627358 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1506/3153] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:45.648171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-620f78a3-be42-4146-bfe2-8e0adc0f972b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:45.648814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-620f78a3-be42-4146-bfe2-8e0adc0f972b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:45.655817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-620f78a3-be42-4146-bfe2-8e0adc0f972b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:45.656283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-620f78a3-be42-4146-bfe2-8e0adc0f972b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:45.657078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-620f78a3-be42-4146-bfe2-8e0adc0f972b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:45.657511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-620f78a3-be42-4146-bfe2-8e0adc0f972b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:45.787596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-620f78a3-be42-4146-bfe2-8e0adc0f972b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:45.796076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-620f78a3-be42-4146-bfe2-8e0adc0f972b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151802 Jul 28 20:29:45.796843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1648/3154] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:46.818546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0cd2be0f-937a-4c2e-80ae-25487b2f2dab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:46.819196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0cd2be0f-937a-4c2e-80ae-25487b2f2dab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:46.825788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0cd2be0f-937a-4c2e-80ae-25487b2f2dab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:46.826266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0cd2be0f-937a-4c2e-80ae-25487b2f2dab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:46.827021 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0cd2be0f-937a-4c2e-80ae-25487b2f2dab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:46.827457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0cd2be0f-937a-4c2e-80ae-25487b2f2dab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:46.830786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:29:46.955833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0cd2be0f-937a-4c2e-80ae-25487b2f2dab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:46.963760 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0cd2be0f-937a-4c2e-80ae-25487b2f2dab tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149071 Jul 28 20:29:46.964314 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1507/3155] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:29:47.985356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8ecc3282-e2dc-4651-b2f4-7144936e2c07 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:47.986030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8ecc3282-e2dc-4651-b2f4-7144936e2c07 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:47.992672 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ecc3282-e2dc-4651-b2f4-7144936e2c07 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:47.993114 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ecc3282-e2dc-4651-b2f4-7144936e2c07 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:47.993861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ecc3282-e2dc-4651-b2f4-7144936e2c07 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:47.994296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8ecc3282-e2dc-4651-b2f4-7144936e2c07 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:48.119743 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8ecc3282-e2dc-4651-b2f4-7144936e2c07 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:48.127983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8ecc3282-e2dc-4651-b2f4-7144936e2c07 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146600 Jul 28 20:29:48.128563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1649/3156] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:49.150080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cdca66ba-c79a-4006-8f03-42ad48aa458e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:49.150773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cdca66ba-c79a-4006-8f03-42ad48aa458e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:49.157763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdca66ba-c79a-4006-8f03-42ad48aa458e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:49.158243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdca66ba-c79a-4006-8f03-42ad48aa458e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:49.158996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdca66ba-c79a-4006-8f03-42ad48aa458e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:49.159432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cdca66ba-c79a-4006-8f03-42ad48aa458e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:49.291870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cdca66ba-c79a-4006-8f03-42ad48aa458e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:49.300400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cdca66ba-c79a-4006-8f03-42ad48aa458e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154443 Jul 28 20:29:49.301015 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1508/3157] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:50.321195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-38432d1a-152f-4e04-96e4-094dadba1306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:50.321805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-38432d1a-152f-4e04-96e4-094dadba1306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:50.328305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38432d1a-152f-4e04-96e4-094dadba1306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:50.329271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38432d1a-152f-4e04-96e4-094dadba1306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:50.330027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38432d1a-152f-4e04-96e4-094dadba1306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:50.330458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-38432d1a-152f-4e04-96e4-094dadba1306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:50.457093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-38432d1a-152f-4e04-96e4-094dadba1306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:50.464959 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-38432d1a-152f-4e04-96e4-094dadba1306 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147607 Jul 28 20:29:50.465516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1650/3158] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:51.487364 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-181b07c6-9fcb-40b8-a61a-26b608b4db74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:51.487952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-181b07c6-9fcb-40b8-a61a-26b608b4db74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:51.494368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-181b07c6-9fcb-40b8-a61a-26b608b4db74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:51.494811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-181b07c6-9fcb-40b8-a61a-26b608b4db74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:51.495554 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-181b07c6-9fcb-40b8-a61a-26b608b4db74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:51.495986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-181b07c6-9fcb-40b8-a61a-26b608b4db74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:51.626275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-181b07c6-9fcb-40b8-a61a-26b608b4db74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:51.634875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-181b07c6-9fcb-40b8-a61a-26b608b4db74 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151590 Jul 28 20:29:51.635434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1509/3159] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:52.656307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e4a15c7c-bbad-4d91-876c-398a4322e8e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:52.656953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e4a15c7c-bbad-4d91-876c-398a4322e8e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:52.663840 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4a15c7c-bbad-4d91-876c-398a4322e8e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:52.664292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4a15c7c-bbad-4d91-876c-398a4322e8e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:52.665084 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4a15c7c-bbad-4d91-876c-398a4322e8e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:52.665517 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e4a15c7c-bbad-4d91-876c-398a4322e8e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:52.669423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:29:52.794565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e4a15c7c-bbad-4d91-876c-398a4322e8e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:52.802677 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e4a15c7c-bbad-4d91-876c-398a4322e8e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150312 Jul 28 20:29:52.803416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1651/3160] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:53.825418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-577edb9f-e120-4af8-99f4-a9e8660c463a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:53.826066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-577edb9f-e120-4af8-99f4-a9e8660c463a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:53.832722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-577edb9f-e120-4af8-99f4-a9e8660c463a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:53.833177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-577edb9f-e120-4af8-99f4-a9e8660c463a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:53.833943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-577edb9f-e120-4af8-99f4-a9e8660c463a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:53.834383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-577edb9f-e120-4af8-99f4-a9e8660c463a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:53.964966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-577edb9f-e120-4af8-99f4-a9e8660c463a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:53.974028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-577edb9f-e120-4af8-99f4-a9e8660c463a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152497 Jul 28 20:29:53.974588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1510/3161] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:54.995219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dfb7597b-c7df-457b-a7f0-87bb351e7c25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:54.995812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dfb7597b-c7df-457b-a7f0-87bb351e7c25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:55.003291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dfb7597b-c7df-457b-a7f0-87bb351e7c25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:55.003731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dfb7597b-c7df-457b-a7f0-87bb351e7c25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:55.004500 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dfb7597b-c7df-457b-a7f0-87bb351e7c25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:55.004957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dfb7597b-c7df-457b-a7f0-87bb351e7c25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:55.134264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dfb7597b-c7df-457b-a7f0-87bb351e7c25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:55.142087 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dfb7597b-c7df-457b-a7f0-87bb351e7c25 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150714 Jul 28 20:29:55.142633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1652/3162] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:56.163876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e14526b6-eb84-4bc9-9db5-59b600d85e37 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:56.164533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e14526b6-eb84-4bc9-9db5-59b600d85e37 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:56.170816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e14526b6-eb84-4bc9-9db5-59b600d85e37 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:56.171266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e14526b6-eb84-4bc9-9db5-59b600d85e37 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:56.172020 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e14526b6-eb84-4bc9-9db5-59b600d85e37 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:56.172457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e14526b6-eb84-4bc9-9db5-59b600d85e37 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:56.300080 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e14526b6-eb84-4bc9-9db5-59b600d85e37 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:56.308042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e14526b6-eb84-4bc9-9db5-59b600d85e37 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148051 Jul 28 20:29:56.308613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1511/3163] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:29:57.331731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2b74191f-48ae-443e-9aa0-a28fe2bc745c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:57.332976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2b74191f-48ae-443e-9aa0-a28fe2bc745c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:57.339657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b74191f-48ae-443e-9aa0-a28fe2bc745c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:57.340100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b74191f-48ae-443e-9aa0-a28fe2bc745c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:57.340880 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b74191f-48ae-443e-9aa0-a28fe2bc745c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:57.341306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2b74191f-48ae-443e-9aa0-a28fe2bc745c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:57.475453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2b74191f-48ae-443e-9aa0-a28fe2bc745c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:57.483403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2b74191f-48ae-443e-9aa0-a28fe2bc745c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155489 Jul 28 20:29:57.483956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1653/3164] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:58.505050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7d6f867d-2c27-46f4-b5c5-bd8e871284a5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:58.505608 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7d6f867d-2c27-46f4-b5c5-bd8e871284a5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:58.512859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7d6f867d-2c27-46f4-b5c5-bd8e871284a5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:58.513309 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7d6f867d-2c27-46f4-b5c5-bd8e871284a5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:58.514061 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7d6f867d-2c27-46f4-b5c5-bd8e871284a5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:58.514494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7d6f867d-2c27-46f4-b5c5-bd8e871284a5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:58.651227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7d6f867d-2c27-46f4-b5c5-bd8e871284a5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:58.659333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7d6f867d-2c27-46f4-b5c5-bd8e871284a5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158583 Jul 28 20:29:58.659894 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1512/3165] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:58 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:29:59.679657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fed49b2d-a56d-4458-877d-fe056a89de29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:29:59.680283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fed49b2d-a56d-4458-877d-fe056a89de29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:29:59.686762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fed49b2d-a56d-4458-877d-fe056a89de29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:59.687205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fed49b2d-a56d-4458-877d-fe056a89de29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:59.687946 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fed49b2d-a56d-4458-877d-fe056a89de29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:29:59.688969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fed49b2d-a56d-4458-877d-fe056a89de29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:29:59.817625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fed49b2d-a56d-4458-877d-fe056a89de29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:29:59.825634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fed49b2d-a56d-4458-877d-fe056a89de29 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149877 Jul 28 20:29:59.826193 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1654/3166] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:29:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:00.848107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f3edb55a-78ed-49df-88d1-97e1f989615f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:00.848757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f3edb55a-78ed-49df-88d1-97e1f989615f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:00.850557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=26 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:30:00.855793 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3edb55a-78ed-49df-88d1-97e1f989615f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:00.856238 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3edb55a-78ed-49df-88d1-97e1f989615f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:00.857024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3edb55a-78ed-49df-88d1-97e1f989615f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:00.857453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3edb55a-78ed-49df-88d1-97e1f989615f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:00.986370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f3edb55a-78ed-49df-88d1-97e1f989615f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:00.994310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f3edb55a-78ed-49df-88d1-97e1f989615f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151040 Jul 28 20:30:00.994869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1513/3167] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:02.016288 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-845dd5f7-9a4b-4d42-9c07-b0c2e32ad2c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:02.016983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-845dd5f7-9a4b-4d42-9c07-b0c2e32ad2c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:02.023393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-845dd5f7-9a4b-4d42-9c07-b0c2e32ad2c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:02.023833 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-845dd5f7-9a4b-4d42-9c07-b0c2e32ad2c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:02.024907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-845dd5f7-9a4b-4d42-9c07-b0c2e32ad2c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:02.025335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-845dd5f7-9a4b-4d42-9c07-b0c2e32ad2c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:02.154733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-845dd5f7-9a4b-4d42-9c07-b0c2e32ad2c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:02.163393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-845dd5f7-9a4b-4d42-9c07-b0c2e32ad2c1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150950 Jul 28 20:30:02.164164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1655/3168] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:02 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:03.184813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-abe35651-2455-4262-9f42-f0f1d81598ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:03.185429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-abe35651-2455-4262-9f42-f0f1d81598ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:03.192839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abe35651-2455-4262-9f42-f0f1d81598ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:03.193287 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abe35651-2455-4262-9f42-f0f1d81598ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:03.194038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abe35651-2455-4262-9f42-f0f1d81598ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:03.194469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-abe35651-2455-4262-9f42-f0f1d81598ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:03.326018 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-abe35651-2455-4262-9f42-f0f1d81598ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:03.334236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-abe35651-2455-4262-9f42-f0f1d81598ce tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153239 Jul 28 20:30:03.334818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1514/3169] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:04.356123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e9a52905-37a1-4ea8-a5ef-5f49158be220 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:04.356763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e9a52905-37a1-4ea8-a5ef-5f49158be220 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:04.358575 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=26 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:30:04.368741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9a52905-37a1-4ea8-a5ef-5f49158be220 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:04.369236 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9a52905-37a1-4ea8-a5ef-5f49158be220 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:04.369992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9a52905-37a1-4ea8-a5ef-5f49158be220 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:04.370416 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e9a52905-37a1-4ea8-a5ef-5f49158be220 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:04.496726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e9a52905-37a1-4ea8-a5ef-5f49158be220 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:04.504732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e9a52905-37a1-4ea8-a5ef-5f49158be220 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152539 Jul 28 20:30:04.505292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1656/3170] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:05.526559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bae073d4-ba06-433c-8629-c00f12d4759d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:05.527143 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bae073d4-ba06-433c-8629-c00f12d4759d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:05.533635 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bae073d4-ba06-433c-8629-c00f12d4759d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:05.534095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bae073d4-ba06-433c-8629-c00f12d4759d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:05.534836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bae073d4-ba06-433c-8629-c00f12d4759d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:05.535268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bae073d4-ba06-433c-8629-c00f12d4759d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:05.665753 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bae073d4-ba06-433c-8629-c00f12d4759d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:05.674778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bae073d4-ba06-433c-8629-c00f12d4759d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152349 Jul 28 20:30:05.675336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1515/3171] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:06.695470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d0814a4a-5d22-4a51-8b15-41c18610d0c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:06.696106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d0814a4a-5d22-4a51-8b15-41c18610d0c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:06.702544 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0814a4a-5d22-4a51-8b15-41c18610d0c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:06.702992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0814a4a-5d22-4a51-8b15-41c18610d0c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:06.703734 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0814a4a-5d22-4a51-8b15-41c18610d0c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:06.704163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d0814a4a-5d22-4a51-8b15-41c18610d0c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:06.837514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d0814a4a-5d22-4a51-8b15-41c18610d0c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:06.846162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d0814a4a-5d22-4a51-8b15-41c18610d0c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154468 Jul 28 20:30:06.846726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1657/3172] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:07.867007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8095aad5-a315-4e87-840f-bb80a688b47b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:07.867656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8095aad5-a315-4e87-840f-bb80a688b47b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:07.874233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8095aad5-a315-4e87-840f-bb80a688b47b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:07.874677 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8095aad5-a315-4e87-840f-bb80a688b47b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:07.875493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8095aad5-a315-4e87-840f-bb80a688b47b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:07.875898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8095aad5-a315-4e87-840f-bb80a688b47b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:08.006078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8095aad5-a315-4e87-840f-bb80a688b47b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:08.013991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8095aad5-a315-4e87-840f-bb80a688b47b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150817 Jul 28 20:30:08.014545 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1516/3173] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:09.035815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-715a9e0f-10fb-41f9-b413-4cabfbe41267 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:09.036423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-715a9e0f-10fb-41f9-b413-4cabfbe41267 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:09.043089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-715a9e0f-10fb-41f9-b413-4cabfbe41267 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:09.043537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-715a9e0f-10fb-41f9-b413-4cabfbe41267 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:09.044298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-715a9e0f-10fb-41f9-b413-4cabfbe41267 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:09.044760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-715a9e0f-10fb-41f9-b413-4cabfbe41267 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:09.170700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-715a9e0f-10fb-41f9-b413-4cabfbe41267 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:09.178621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-715a9e0f-10fb-41f9-b413-4cabfbe41267 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147396 Jul 28 20:30:09.179181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1658/3174] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:09 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:10.199157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6a6cfce3-9502-41b0-9a71-f557c5407827 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:10.199768 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6a6cfce3-9502-41b0-9a71-f557c5407827 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:10.206354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6a6cfce3-9502-41b0-9a71-f557c5407827 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:10.206794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6a6cfce3-9502-41b0-9a71-f557c5407827 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:10.207536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6a6cfce3-9502-41b0-9a71-f557c5407827 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:10.207962 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6a6cfce3-9502-41b0-9a71-f557c5407827 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:10.334028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6a6cfce3-9502-41b0-9a71-f557c5407827 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:10.341978 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6a6cfce3-9502-41b0-9a71-f557c5407827 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146665 Jul 28 20:30:10.342530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1517/3175] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:11.363822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-85c2c089-74f1-4223-86b2-b2fd7ba73833 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:11.364418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-85c2c089-74f1-4223-86b2-b2fd7ba73833 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:11.371073 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85c2c089-74f1-4223-86b2-b2fd7ba73833 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:11.371521 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85c2c089-74f1-4223-86b2-b2fd7ba73833 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:11.372279 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85c2c089-74f1-4223-86b2-b2fd7ba73833 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:11.372749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85c2c089-74f1-4223-86b2-b2fd7ba73833 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:11.504958 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-85c2c089-74f1-4223-86b2-b2fd7ba73833 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:11.512845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-85c2c089-74f1-4223-86b2-b2fd7ba73833 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152946 Jul 28 20:30:11.513437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1659/3176] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:12.535218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9a0d2f42-de25-4ec7-ad7c-dad035e57e1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:12.535782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9a0d2f42-de25-4ec7-ad7c-dad035e57e1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:12.542201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a0d2f42-de25-4ec7-ad7c-dad035e57e1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:12.542943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a0d2f42-de25-4ec7-ad7c-dad035e57e1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:12.543371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a0d2f42-de25-4ec7-ad7c-dad035e57e1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:12.543799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9a0d2f42-de25-4ec7-ad7c-dad035e57e1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:12.671254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9a0d2f42-de25-4ec7-ad7c-dad035e57e1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:12.679675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9a0d2f42-de25-4ec7-ad7c-dad035e57e1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148682 Jul 28 20:30:12.680229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1518/3177] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:13.700509 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3219000b-1309-4df9-b6a8-4f583c92d417 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:13.701260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3219000b-1309-4df9-b6a8-4f583c92d417 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:13.707718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3219000b-1309-4df9-b6a8-4f583c92d417 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:13.708187 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3219000b-1309-4df9-b6a8-4f583c92d417 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:13.708972 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3219000b-1309-4df9-b6a8-4f583c92d417 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:13.709393 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3219000b-1309-4df9-b6a8-4f583c92d417 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:13.839464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3219000b-1309-4df9-b6a8-4f583c92d417 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:13.847990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3219000b-1309-4df9-b6a8-4f583c92d417 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151335 Jul 28 20:30:13.848565 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1660/3178] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:14.869735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8fac29a2-d902-43bd-813e-51b78f904c21 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:14.870349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8fac29a2-d902-43bd-813e-51b78f904c21 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:14.877390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fac29a2-d902-43bd-813e-51b78f904c21 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:14.877839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fac29a2-d902-43bd-813e-51b78f904c21 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:14.878594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fac29a2-d902-43bd-813e-51b78f904c21 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:14.879027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8fac29a2-d902-43bd-813e-51b78f904c21 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:15.007384 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8fac29a2-d902-43bd-813e-51b78f904c21 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:15.015139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8fac29a2-d902-43bd-813e-51b78f904c21 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149612 Jul 28 20:30:15.016223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1519/3179] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:16.037574 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-20c431d3-63b1-49a4-8120-d454706bea00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:16.038188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-20c431d3-63b1-49a4-8120-d454706bea00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:16.045169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20c431d3-63b1-49a4-8120-d454706bea00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:16.045611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20c431d3-63b1-49a4-8120-d454706bea00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:16.046362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20c431d3-63b1-49a4-8120-d454706bea00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:16.046995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20c431d3-63b1-49a4-8120-d454706bea00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:16.184134 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-20c431d3-63b1-49a4-8120-d454706bea00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:16.193656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-20c431d3-63b1-49a4-8120-d454706bea00 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.160146 Jul 28 20:30:16.194355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1661/3180] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:16 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:17.217225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1162ee29-af7d-44d6-8905-3675f39899ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:17.217833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1162ee29-af7d-44d6-8905-3675f39899ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:17.224372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1162ee29-af7d-44d6-8905-3675f39899ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:17.224841 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1162ee29-af7d-44d6-8905-3675f39899ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:17.225584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1162ee29-af7d-44d6-8905-3675f39899ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:17.226010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1162ee29-af7d-44d6-8905-3675f39899ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:17.228474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:30:17.358247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1162ee29-af7d-44d6-8905-3675f39899ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:17.366716 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1162ee29-af7d-44d6-8905-3675f39899ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153381 Jul 28 20:30:17.367270 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1520/3181] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:18.388599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8347483b-f5b6-4cdf-b254-b488dad3a54e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:18.389221 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8347483b-f5b6-4cdf-b254-b488dad3a54e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:18.396476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8347483b-f5b6-4cdf-b254-b488dad3a54e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:18.396957 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8347483b-f5b6-4cdf-b254-b488dad3a54e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:18.397711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8347483b-f5b6-4cdf-b254-b488dad3a54e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:18.398145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8347483b-f5b6-4cdf-b254-b488dad3a54e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:18.522889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8347483b-f5b6-4cdf-b254-b488dad3a54e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:18.530985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8347483b-f5b6-4cdf-b254-b488dad3a54e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146290 Jul 28 20:30:18.531592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1662/3182] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:19.552626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5bae2560-43a3-43c1-a1fa-c59475f67f22 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:19.553214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5bae2560-43a3-43c1-a1fa-c59475f67f22 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:19.559834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bae2560-43a3-43c1-a1fa-c59475f67f22 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:19.560288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bae2560-43a3-43c1-a1fa-c59475f67f22 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:19.561085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bae2560-43a3-43c1-a1fa-c59475f67f22 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:19.561522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5bae2560-43a3-43c1-a1fa-c59475f67f22 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:19.691388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5bae2560-43a3-43c1-a1fa-c59475f67f22 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:19.699383 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5bae2560-43a3-43c1-a1fa-c59475f67f22 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150743 Jul 28 20:30:19.699939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1521/3183] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:20.721939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a6afed17-9c35-46ab-9a0a-ffac168dd256 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:20.722546 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a6afed17-9c35-46ab-9a0a-ffac168dd256 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:20.729107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6afed17-9c35-46ab-9a0a-ffac168dd256 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:20.729553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6afed17-9c35-46ab-9a0a-ffac168dd256 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:20.730301 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6afed17-9c35-46ab-9a0a-ffac168dd256 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:20.730728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a6afed17-9c35-46ab-9a0a-ffac168dd256 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:20.858846 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a6afed17-9c35-46ab-9a0a-ffac168dd256 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:20.867284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a6afed17-9c35-46ab-9a0a-ffac168dd256 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150109 Jul 28 20:30:20.867853 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1663/3184] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:21.888254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b1438309-1ebe-44ce-ada5-8e5f807db744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:21.888923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b1438309-1ebe-44ce-ada5-8e5f807db744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:21.895903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1438309-1ebe-44ce-ada5-8e5f807db744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:21.896349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1438309-1ebe-44ce-ada5-8e5f807db744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:21.897141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1438309-1ebe-44ce-ada5-8e5f807db744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:21.897574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1438309-1ebe-44ce-ada5-8e5f807db744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:22.026472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b1438309-1ebe-44ce-ada5-8e5f807db744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:22.035341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b1438309-1ebe-44ce-ada5-8e5f807db744 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150858 Jul 28 20:30:22.035816 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1522/3185] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:23.056792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5fdff6e5-06cf-445a-b028-9592d200a172 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:23.057413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5fdff6e5-06cf-445a-b028-9592d200a172 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:23.064444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fdff6e5-06cf-445a-b028-9592d200a172 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:23.064911 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fdff6e5-06cf-445a-b028-9592d200a172 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:23.065657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fdff6e5-06cf-445a-b028-9592d200a172 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:23.066080 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5fdff6e5-06cf-445a-b028-9592d200a172 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:23.068525 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:30:23.194583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5fdff6e5-06cf-445a-b028-9592d200a172 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:23.202483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5fdff6e5-06cf-445a-b028-9592d200a172 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149551 Jul 28 20:30:23.203578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1664/3186] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:24.224237 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7621d1b6-1e1a-482d-ad42-4bc998a4ee6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:24.224905 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7621d1b6-1e1a-482d-ad42-4bc998a4ee6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:24.231379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7621d1b6-1e1a-482d-ad42-4bc998a4ee6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:24.231828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7621d1b6-1e1a-482d-ad42-4bc998a4ee6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:24.232605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7621d1b6-1e1a-482d-ad42-4bc998a4ee6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:24.233041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7621d1b6-1e1a-482d-ad42-4bc998a4ee6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:24.366654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7621d1b6-1e1a-482d-ad42-4bc998a4ee6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:24.377829 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7621d1b6-1e1a-482d-ad42-4bc998a4ee6e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.157434 Jul 28 20:30:24.378389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1523/3187] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:25.399403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f56780dc-8aa8-4a34-aab4-afaf6acefafc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:25.400040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f56780dc-8aa8-4a34-aab4-afaf6acefafc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:25.406536 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f56780dc-8aa8-4a34-aab4-afaf6acefafc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:25.406983 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f56780dc-8aa8-4a34-aab4-afaf6acefafc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:25.407732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f56780dc-8aa8-4a34-aab4-afaf6acefafc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:25.408165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f56780dc-8aa8-4a34-aab4-afaf6acefafc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:25.543068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f56780dc-8aa8-4a34-aab4-afaf6acefafc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:25.551752 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f56780dc-8aa8-4a34-aab4-afaf6acefafc tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156394 Jul 28 20:30:25.552326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1665/3188] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:26.573187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eae963cd-38b1-4568-8427-46831761e9bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:26.573805 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eae963cd-38b1-4568-8427-46831761e9bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:26.582268 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eae963cd-38b1-4568-8427-46831761e9bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:26.582727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eae963cd-38b1-4568-8427-46831761e9bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:26.583508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eae963cd-38b1-4568-8427-46831761e9bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:26.583944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eae963cd-38b1-4568-8427-46831761e9bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:26.717220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-eae963cd-38b1-4568-8427-46831761e9bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:26.725888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eae963cd-38b1-4568-8427-46831761e9bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156569 Jul 28 20:30:26.726443 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1524/3189] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:30:27.749283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d3bade50-fab8-48d3-bad3-28363a042190 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:27.750563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d3bade50-fab8-48d3-bad3-28363a042190 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:27.757243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3bade50-fab8-48d3-bad3-28363a042190 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:27.757686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3bade50-fab8-48d3-bad3-28363a042190 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:27.758433 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3bade50-fab8-48d3-bad3-28363a042190 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:27.758858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3bade50-fab8-48d3-bad3-28363a042190 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:27.891941 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d3bade50-fab8-48d3-bad3-28363a042190 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:27.900291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d3bade50-fab8-48d3-bad3-28363a042190 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154788 Jul 28 20:30:27.900894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1666/3190] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:28.922993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-da38fd2d-9273-4177-86d9-8e31bc82372f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:28.923580 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-da38fd2d-9273-4177-86d9-8e31bc82372f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:28.930014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da38fd2d-9273-4177-86d9-8e31bc82372f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:28.930454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da38fd2d-9273-4177-86d9-8e31bc82372f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:28.931197 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da38fd2d-9273-4177-86d9-8e31bc82372f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:28.931619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-da38fd2d-9273-4177-86d9-8e31bc82372f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:29.064556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-da38fd2d-9273-4177-86d9-8e31bc82372f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:29.072524 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-da38fd2d-9273-4177-86d9-8e31bc82372f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154360 Jul 28 20:30:29.073104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1525/3191] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:30.094195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7635ab82-f247-4743-a713-102d01b5b23d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:30.094814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7635ab82-f247-4743-a713-102d01b5b23d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:30.101198 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7635ab82-f247-4743-a713-102d01b5b23d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:30.101654 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7635ab82-f247-4743-a713-102d01b5b23d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:30.102402 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7635ab82-f247-4743-a713-102d01b5b23d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:30.102831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7635ab82-f247-4743-a713-102d01b5b23d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:30.230120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7635ab82-f247-4743-a713-102d01b5b23d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:30.237991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7635ab82-f247-4743-a713-102d01b5b23d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148246 Jul 28 20:30:30.238552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1667/3192] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:31.259434 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e04834d1-6340-4672-a0ed-729455fbda1c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:31.260118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e04834d1-6340-4672-a0ed-729455fbda1c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:31.262207 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=26 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:30:31.268421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e04834d1-6340-4672-a0ed-729455fbda1c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:31.268899 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e04834d1-6340-4672-a0ed-729455fbda1c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:31.269660 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e04834d1-6340-4672-a0ed-729455fbda1c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:31.270127 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e04834d1-6340-4672-a0ed-729455fbda1c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:31.410765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e04834d1-6340-4672-a0ed-729455fbda1c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:31.419106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e04834d1-6340-4672-a0ed-729455fbda1c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.163443 Jul 28 20:30:31.419613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1526/3193] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:32.441031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4d1daa44-c6b4-41b4-9f94-40d2e1965f75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:32.441571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4d1daa44-c6b4-41b4-9f94-40d2e1965f75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:32.448244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d1daa44-c6b4-41b4-9f94-40d2e1965f75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:32.448705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d1daa44-c6b4-41b4-9f94-40d2e1965f75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:32.449459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d1daa44-c6b4-41b4-9f94-40d2e1965f75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:32.449897 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d1daa44-c6b4-41b4-9f94-40d2e1965f75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:32.584163 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4d1daa44-c6b4-41b4-9f94-40d2e1965f75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:32.592018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4d1daa44-c6b4-41b4-9f94-40d2e1965f75 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154961 Jul 28 20:30:32.592787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1668/3194] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:33.614453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-91e457b9-6eb7-410f-aed1-06ac802885d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:33.615049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-91e457b9-6eb7-410f-aed1-06ac802885d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:33.621528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91e457b9-6eb7-410f-aed1-06ac802885d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:33.621979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91e457b9-6eb7-410f-aed1-06ac802885d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:33.622723 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91e457b9-6eb7-410f-aed1-06ac802885d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:33.623148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-91e457b9-6eb7-410f-aed1-06ac802885d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:33.959711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-91e457b9-6eb7-410f-aed1-06ac802885d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:33.967620 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-91e457b9-6eb7-410f-aed1-06ac802885d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.356999 Jul 28 20:30:33.968833 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1527/3195] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:30:34.988037 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1eb63e18-92c1-43d2-884b-2298cb0ba775 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:34.988693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1eb63e18-92c1-43d2-884b-2298cb0ba775 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:34.990999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=26 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:30:34.996419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1eb63e18-92c1-43d2-884b-2298cb0ba775 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:34.996895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1eb63e18-92c1-43d2-884b-2298cb0ba775 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:34.997651 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1eb63e18-92c1-43d2-884b-2298cb0ba775 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:34.998085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1eb63e18-92c1-43d2-884b-2298cb0ba775 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:35.126494 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-1eb63e18-92c1-43d2-884b-2298cb0ba775 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:35.134564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1eb63e18-92c1-43d2-884b-2298cb0ba775 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150359 Jul 28 20:30:35.135119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1669/3196] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:36.156752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-87fdb31f-8eeb-46d3-a480-a61db1932475 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:36.157369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-87fdb31f-8eeb-46d3-a480-a61db1932475 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:36.163911 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87fdb31f-8eeb-46d3-a480-a61db1932475 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:36.164360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87fdb31f-8eeb-46d3-a480-a61db1932475 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:36.165525 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87fdb31f-8eeb-46d3-a480-a61db1932475 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:36.165639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-87fdb31f-8eeb-46d3-a480-a61db1932475 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:36.296388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-87fdb31f-8eeb-46d3-a480-a61db1932475 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:36.304297 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-87fdb31f-8eeb-46d3-a480-a61db1932475 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152559 Jul 28 20:30:36.304890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1528/3197] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:37.325712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6afbd833-6a87-4514-a62a-0a2b28d178ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:37.326324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6afbd833-6a87-4514-a62a-0a2b28d178ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:37.333534 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6afbd833-6a87-4514-a62a-0a2b28d178ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:37.333976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6afbd833-6a87-4514-a62a-0a2b28d178ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:37.334719 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6afbd833-6a87-4514-a62a-0a2b28d178ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:37.335145 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6afbd833-6a87-4514-a62a-0a2b28d178ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:37.465252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6afbd833-6a87-4514-a62a-0a2b28d178ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:37.473442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6afbd833-6a87-4514-a62a-0a2b28d178ec tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151547 Jul 28 20:30:37.474002 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1670/3198] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:38.495736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-359edabd-65d3-43d4-ba6d-556865c06143 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:38.496288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-359edabd-65d3-43d4-ba6d-556865c06143 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:38.503441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-359edabd-65d3-43d4-ba6d-556865c06143 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:38.503889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-359edabd-65d3-43d4-ba6d-556865c06143 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:38.504676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-359edabd-65d3-43d4-ba6d-556865c06143 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:38.505113 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-359edabd-65d3-43d4-ba6d-556865c06143 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:38.635433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-359edabd-65d3-43d4-ba6d-556865c06143 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:38.644005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-359edabd-65d3-43d4-ba6d-556865c06143 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152320 Jul 28 20:30:38.644585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1529/3199] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:39.665303 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-316bab2b-27d7-4e44-884c-a11a9eb8f465 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:39.665926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-316bab2b-27d7-4e44-884c-a11a9eb8f465 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:39.673097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-316bab2b-27d7-4e44-884c-a11a9eb8f465 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:39.673547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-316bab2b-27d7-4e44-884c-a11a9eb8f465 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:39.674305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-316bab2b-27d7-4e44-884c-a11a9eb8f465 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:39.674753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-316bab2b-27d7-4e44-884c-a11a9eb8f465 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:39.800496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-316bab2b-27d7-4e44-884c-a11a9eb8f465 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:39.808380 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-316bab2b-27d7-4e44-884c-a11a9eb8f465 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146895 Jul 28 20:30:39.808967 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1671/3200] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:40.829794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-50b3bcac-f92f-4a64-a65a-6050ed6e3070 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:40.830440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-50b3bcac-f92f-4a64-a65a-6050ed6e3070 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:40.836958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50b3bcac-f92f-4a64-a65a-6050ed6e3070 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:40.837409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50b3bcac-f92f-4a64-a65a-6050ed6e3070 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:40.838162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50b3bcac-f92f-4a64-a65a-6050ed6e3070 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:40.838593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-50b3bcac-f92f-4a64-a65a-6050ed6e3070 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:40.967134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-50b3bcac-f92f-4a64-a65a-6050ed6e3070 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:40.975186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-50b3bcac-f92f-4a64-a65a-6050ed6e3070 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150398 Jul 28 20:30:40.975743 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1530/3201] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:41.996248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-047b9f50-d32f-4263-bddb-0bad80721b1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:41.996884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-047b9f50-d32f-4263-bddb-0bad80721b1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:42.003607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-047b9f50-d32f-4263-bddb-0bad80721b1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:42.004050 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-047b9f50-d32f-4263-bddb-0bad80721b1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:42.004839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-047b9f50-d32f-4263-bddb-0bad80721b1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:42.005267 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-047b9f50-d32f-4263-bddb-0bad80721b1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:42.137878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-047b9f50-d32f-4263-bddb-0bad80721b1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:42.146617 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-047b9f50-d32f-4263-bddb-0bad80721b1b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154152 Jul 28 20:30:42.147174 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1672/3202] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:43.175412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e8dc4dd6-599c-4dce-9a89-1a9a5f2bf60d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:43.176022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e8dc4dd6-599c-4dce-9a89-1a9a5f2bf60d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:43.182513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e8dc4dd6-599c-4dce-9a89-1a9a5f2bf60d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:43.182953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e8dc4dd6-599c-4dce-9a89-1a9a5f2bf60d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:43.183694 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e8dc4dd6-599c-4dce-9a89-1a9a5f2bf60d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:43.184123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e8dc4dd6-599c-4dce-9a89-1a9a5f2bf60d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:43.312086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e8dc4dd6-599c-4dce-9a89-1a9a5f2bf60d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:43.319935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e8dc4dd6-599c-4dce-9a89-1a9a5f2bf60d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148378 Jul 28 20:30:43.320488 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1531/3203] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:44.341689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8f3047cb-5ffd-41dc-aff6-0f443d0f75bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:44.342295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8f3047cb-5ffd-41dc-aff6-0f443d0f75bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:44.349417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f3047cb-5ffd-41dc-aff6-0f443d0f75bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:44.349867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f3047cb-5ffd-41dc-aff6-0f443d0f75bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:44.350621 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f3047cb-5ffd-41dc-aff6-0f443d0f75bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:44.351060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f3047cb-5ffd-41dc-aff6-0f443d0f75bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:44.486469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8f3047cb-5ffd-41dc-aff6-0f443d0f75bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:44.494317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8f3047cb-5ffd-41dc-aff6-0f443d0f75bd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156740 Jul 28 20:30:44.494865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1673/3204] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:45.517925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6f55e83b-9b1b-447a-90e4-ba5ce21039c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:45.518494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6f55e83b-9b1b-447a-90e4-ba5ce21039c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:45.525167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f55e83b-9b1b-447a-90e4-ba5ce21039c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:45.525610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f55e83b-9b1b-447a-90e4-ba5ce21039c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:45.526353 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f55e83b-9b1b-447a-90e4-ba5ce21039c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:45.526777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6f55e83b-9b1b-447a-90e4-ba5ce21039c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:45.655941 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6f55e83b-9b1b-447a-90e4-ba5ce21039c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:45.663891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6f55e83b-9b1b-447a-90e4-ba5ce21039c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150517 Jul 28 20:30:45.664453 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1532/3205] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:46.685343 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-16dfb4fd-84dd-42f4-8532-93d0da506e33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:46.686108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-16dfb4fd-84dd-42f4-8532-93d0da506e33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:46.693328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16dfb4fd-84dd-42f4-8532-93d0da506e33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:46.693769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16dfb4fd-84dd-42f4-8532-93d0da506e33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:46.694514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16dfb4fd-84dd-42f4-8532-93d0da506e33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:46.694938 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16dfb4fd-84dd-42f4-8532-93d0da506e33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:46.822034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-16dfb4fd-84dd-42f4-8532-93d0da506e33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:46.830190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-16dfb4fd-84dd-42f4-8532-93d0da506e33 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148681 Jul 28 20:30:46.830754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1674/3206] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:47.851341 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2d990dd9-8972-446d-94b6-1db1141525e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:47.851955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2d990dd9-8972-446d-94b6-1db1141525e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:47.860155 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d990dd9-8972-446d-94b6-1db1141525e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:47.860700 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d990dd9-8972-446d-94b6-1db1141525e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:47.861469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d990dd9-8972-446d-94b6-1db1141525e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:47.862126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2d990dd9-8972-446d-94b6-1db1141525e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:47.864902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:30:47.999765 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2d990dd9-8972-446d-94b6-1db1141525e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:48.007937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2d990dd9-8972-446d-94b6-1db1141525e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.160470 Jul 28 20:30:48.008496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1533/3207] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:49.030079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ef111ca2-e84a-47ce-8522-608dca4e7d1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:49.030732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ef111ca2-e84a-47ce-8522-608dca4e7d1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:49.037661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef111ca2-e84a-47ce-8522-608dca4e7d1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:49.038106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef111ca2-e84a-47ce-8522-608dca4e7d1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:49.038862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef111ca2-e84a-47ce-8522-608dca4e7d1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:49.039295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ef111ca2-e84a-47ce-8522-608dca4e7d1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:49.175823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ef111ca2-e84a-47ce-8522-608dca4e7d1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:49.183991 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ef111ca2-e84a-47ce-8522-608dca4e7d1f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.157745 Jul 28 20:30:49.188682 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1675/3208] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:50.206758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b6c67188-7fed-4235-823c-15d0466e715d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:50.207455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b6c67188-7fed-4235-823c-15d0466e715d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:50.214202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6c67188-7fed-4235-823c-15d0466e715d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:50.214688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6c67188-7fed-4235-823c-15d0466e715d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:50.215448 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6c67188-7fed-4235-823c-15d0466e715d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:50.215881 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6c67188-7fed-4235-823c-15d0466e715d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:50.354404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b6c67188-7fed-4235-823c-15d0466e715d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:50.363733 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b6c67188-7fed-4235-823c-15d0466e715d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.162133 Jul 28 20:30:50.364305 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1534/3209] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:30:51.385624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6bd30af2-f2cc-40b3-8de7-4c43b7260f16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:51.386260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6bd30af2-f2cc-40b3-8de7-4c43b7260f16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:51.396136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6bd30af2-f2cc-40b3-8de7-4c43b7260f16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:51.396848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6bd30af2-f2cc-40b3-8de7-4c43b7260f16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:51.398192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6bd30af2-f2cc-40b3-8de7-4c43b7260f16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:51.398192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6bd30af2-f2cc-40b3-8de7-4c43b7260f16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:51.544892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6bd30af2-f2cc-40b3-8de7-4c43b7260f16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:51.552185 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6bd30af2-f2cc-40b3-8de7-4c43b7260f16 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.170382 Jul 28 20:30:51.552824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1676/3210] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:52.574417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3946c739-bf66-4509-b9cc-8bb947484474 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:52.575064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3946c739-bf66-4509-b9cc-8bb947484474 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:52.583017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3946c739-bf66-4509-b9cc-8bb947484474 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:52.583459 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3946c739-bf66-4509-b9cc-8bb947484474 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:52.584217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3946c739-bf66-4509-b9cc-8bb947484474 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:52.584735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3946c739-bf66-4509-b9cc-8bb947484474 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:52.725726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3946c739-bf66-4509-b9cc-8bb947484474 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:52.734824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3946c739-bf66-4509-b9cc-8bb947484474 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.164419 Jul 28 20:30:52.735473 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1535/3211] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:53.757541 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8349c506-c56c-46c7-bda7-965465ca3977 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:53.758426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8349c506-c56c-46c7-bda7-965465ca3977 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:53.765172 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8349c506-c56c-46c7-bda7-965465ca3977 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:53.765623 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8349c506-c56c-46c7-bda7-965465ca3977 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:53.766378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8349c506-c56c-46c7-bda7-965465ca3977 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:53.766814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8349c506-c56c-46c7-bda7-965465ca3977 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:53.770181 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:30:53.907166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8349c506-c56c-46c7-bda7-965465ca3977 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:53.915098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8349c506-c56c-46c7-bda7-965465ca3977 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.161619 Jul 28 20:30:53.915707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1677/3212] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:54.936499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-975dc132-b3b2-4a8e-8b06-ba55f9acc453 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:54.937179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-975dc132-b3b2-4a8e-8b06-ba55f9acc453 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:54.944163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-975dc132-b3b2-4a8e-8b06-ba55f9acc453 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:54.945087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-975dc132-b3b2-4a8e-8b06-ba55f9acc453 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:54.945852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-975dc132-b3b2-4a8e-8b06-ba55f9acc453 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:54.946284 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-975dc132-b3b2-4a8e-8b06-ba55f9acc453 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:55.073541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-975dc132-b3b2-4a8e-8b06-ba55f9acc453 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:55.081966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-975dc132-b3b2-4a8e-8b06-ba55f9acc453 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149300 Jul 28 20:30:55.082530 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1536/3213] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:56.105488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-190da5b2-e3d7-4f85-94ff-1568e2dcf09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:56.106307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-190da5b2-e3d7-4f85-94ff-1568e2dcf09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:56.114899 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-190da5b2-e3d7-4f85-94ff-1568e2dcf09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:56.115351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-190da5b2-e3d7-4f85-94ff-1568e2dcf09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:56.116108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-190da5b2-e3d7-4f85-94ff-1568e2dcf09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:56.116533 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-190da5b2-e3d7-4f85-94ff-1568e2dcf09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:56.252445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-190da5b2-e3d7-4f85-94ff-1568e2dcf09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:56.260535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-190da5b2-e3d7-4f85-94ff-1568e2dcf09c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.160245 Jul 28 20:30:56.261125 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1678/3214] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:56 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:57.283811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-98a7c509-a56a-475d-89a4-d6dc890d12f0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:57.284372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-98a7c509-a56a-475d-89a4-d6dc890d12f0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:57.290517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98a7c509-a56a-475d-89a4-d6dc890d12f0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:57.290968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98a7c509-a56a-475d-89a4-d6dc890d12f0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:57.291727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98a7c509-a56a-475d-89a4-d6dc890d12f0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:57.292163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98a7c509-a56a-475d-89a4-d6dc890d12f0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:57.421895 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-98a7c509-a56a-475d-89a4-d6dc890d12f0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:57.430072 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-98a7c509-a56a-475d-89a4-d6dc890d12f0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151173 Jul 28 20:30:57.430623 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1537/3215] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:58.451342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ff3c0466-f358-4b4e-8205-20d3d5c910d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:58.451892 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ff3c0466-f358-4b4e-8205-20d3d5c910d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:58.458642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff3c0466-f358-4b4e-8205-20d3d5c910d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:58.459089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff3c0466-f358-4b4e-8205-20d3d5c910d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:58.459841 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff3c0466-f358-4b4e-8205-20d3d5c910d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:58.460275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ff3c0466-f358-4b4e-8205-20d3d5c910d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:58.594948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ff3c0466-f358-4b4e-8205-20d3d5c910d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:58.603339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ff3c0466-f358-4b4e-8205-20d3d5c910d8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155921 Jul 28 20:30:58.603900 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1679/3216] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:58 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:30:59.625433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-985d0596-2f5a-4ff2-bf73-4a4a0828db46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:30:59.626050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-985d0596-2f5a-4ff2-bf73-4a4a0828db46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:30:59.633311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-985d0596-2f5a-4ff2-bf73-4a4a0828db46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:59.633755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-985d0596-2f5a-4ff2-bf73-4a4a0828db46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:59.634497 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-985d0596-2f5a-4ff2-bf73-4a4a0828db46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:30:59.634926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-985d0596-2f5a-4ff2-bf73-4a4a0828db46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:30:59.768826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-985d0596-2f5a-4ff2-bf73-4a4a0828db46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:30:59.776897 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-985d0596-2f5a-4ff2-bf73-4a4a0828db46 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155168 Jul 28 20:30:59.777472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1538/3217] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:30:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:00.798678 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f0d26f4-2f8c-4667-9366-6c3a14cd483d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:00.799292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f0d26f4-2f8c-4667-9366-6c3a14cd483d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:00.805783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f0d26f4-2f8c-4667-9366-6c3a14cd483d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:00.806228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f0d26f4-2f8c-4667-9366-6c3a14cd483d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:00.806974 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f0d26f4-2f8c-4667-9366-6c3a14cd483d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:00.807403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f0d26f4-2f8c-4667-9366-6c3a14cd483d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:00.937795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2f0d26f4-2f8c-4667-9366-6c3a14cd483d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:00.946740 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f0d26f4-2f8c-4667-9366-6c3a14cd483d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151950 Jul 28 20:31:00.947302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1680/3218] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:01.967686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-00f11c3c-65f0-44e5-a6dd-bd6efbd983c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:01.968302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-00f11c3c-65f0-44e5-a6dd-bd6efbd983c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:01.970308 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=26 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:31:01.976709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00f11c3c-65f0-44e5-a6dd-bd6efbd983c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:01.977419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00f11c3c-65f0-44e5-a6dd-bd6efbd983c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:01.978184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00f11c3c-65f0-44e5-a6dd-bd6efbd983c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:01.978621 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-00f11c3c-65f0-44e5-a6dd-bd6efbd983c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:02.110982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-00f11c3c-65f0-44e5-a6dd-bd6efbd983c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:02.119125 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-00f11c3c-65f0-44e5-a6dd-bd6efbd983c7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155269 Jul 28 20:31:02.119676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1539/3219] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:03.140802 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-20178b9c-a335-421e-9c57-9eae25b09d7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:03.141390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-20178b9c-a335-421e-9c57-9eae25b09d7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:03.148285 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20178b9c-a335-421e-9c57-9eae25b09d7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:03.149020 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20178b9c-a335-421e-9c57-9eae25b09d7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:03.149745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20178b9c-a335-421e-9c57-9eae25b09d7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:03.150169 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-20178b9c-a335-421e-9c57-9eae25b09d7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:03.276686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-20178b9c-a335-421e-9c57-9eae25b09d7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:03.285200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-20178b9c-a335-421e-9c57-9eae25b09d7b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147527 Jul 28 20:31:03.285691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1681/3220] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:04.306683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-144cd339-306f-4fea-8538-a3c9f0f0cbae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:04.307303 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-144cd339-306f-4fea-8538-a3c9f0f0cbae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:04.313724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-144cd339-306f-4fea-8538-a3c9f0f0cbae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:04.314171 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-144cd339-306f-4fea-8538-a3c9f0f0cbae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:04.314920 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-144cd339-306f-4fea-8538-a3c9f0f0cbae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:04.315354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-144cd339-306f-4fea-8538-a3c9f0f0cbae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:04.447910 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-144cd339-306f-4fea-8538-a3c9f0f0cbae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:04.455890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-144cd339-306f-4fea-8538-a3c9f0f0cbae tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153049 Jul 28 20:31:04.456602 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1540/3221] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:05.477688 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-375824b1-4e2e-4717-a0df-b3dbdecd9393 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:05.478246 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-375824b1-4e2e-4717-a0df-b3dbdecd9393 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:05.481557 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=26 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:31:05.485333 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-375824b1-4e2e-4717-a0df-b3dbdecd9393 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:05.485772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-375824b1-4e2e-4717-a0df-b3dbdecd9393 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:05.486526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-375824b1-4e2e-4717-a0df-b3dbdecd9393 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:05.486956 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-375824b1-4e2e-4717-a0df-b3dbdecd9393 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:05.616815 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-375824b1-4e2e-4717-a0df-b3dbdecd9393 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:05.626599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-375824b1-4e2e-4717-a0df-b3dbdecd9393 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152974 Jul 28 20:31:05.627162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1682/3222] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:06.650605 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-53fc843b-86aa-4ba3-acee-7a2a2e22fede tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:06.651206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-53fc843b-86aa-4ba3-acee-7a2a2e22fede tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:06.657713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53fc843b-86aa-4ba3-acee-7a2a2e22fede tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:06.658163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53fc843b-86aa-4ba3-acee-7a2a2e22fede tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:06.658926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53fc843b-86aa-4ba3-acee-7a2a2e22fede tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:06.659365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-53fc843b-86aa-4ba3-acee-7a2a2e22fede tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:06.787838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-53fc843b-86aa-4ba3-acee-7a2a2e22fede tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:06.795713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-53fc843b-86aa-4ba3-acee-7a2a2e22fede tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149240 Jul 28 20:31:06.796274 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1541/3223] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:07.816905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d1c68af5-6aba-4ff8-b57f-b94dcb894edf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:07.817587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d1c68af5-6aba-4ff8-b57f-b94dcb894edf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:07.824004 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d1c68af5-6aba-4ff8-b57f-b94dcb894edf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:07.824445 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d1c68af5-6aba-4ff8-b57f-b94dcb894edf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:07.825217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d1c68af5-6aba-4ff8-b57f-b94dcb894edf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:07.825641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d1c68af5-6aba-4ff8-b57f-b94dcb894edf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:07.953092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d1c68af5-6aba-4ff8-b57f-b94dcb894edf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:07.961598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d1c68af5-6aba-4ff8-b57f-b94dcb894edf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148734 Jul 28 20:31:07.962166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1683/3224] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:08.983221 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c2cf1ece-f926-4acc-965e-cf1e22f89369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:08.983770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c2cf1ece-f926-4acc-965e-cf1e22f89369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:08.990931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c2cf1ece-f926-4acc-965e-cf1e22f89369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:08.991378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c2cf1ece-f926-4acc-965e-cf1e22f89369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:08.992126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c2cf1ece-f926-4acc-965e-cf1e22f89369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:08.992571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c2cf1ece-f926-4acc-965e-cf1e22f89369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:09.119451 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c2cf1ece-f926-4acc-965e-cf1e22f89369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:09.127220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c2cf1ece-f926-4acc-965e-cf1e22f89369 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147932 Jul 28 20:31:09.127778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1542/3225] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:10.148830 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-abd9db0b-503b-4bf8-a6f8-d06e4d0f37b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:10.149451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-abd9db0b-503b-4bf8-a6f8-d06e4d0f37b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:10.155949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-abd9db0b-503b-4bf8-a6f8-d06e4d0f37b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:10.156418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-abd9db0b-503b-4bf8-a6f8-d06e4d0f37b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:10.157200 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-abd9db0b-503b-4bf8-a6f8-d06e4d0f37b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:10.157633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-abd9db0b-503b-4bf8-a6f8-d06e4d0f37b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:10.291015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-abd9db0b-503b-4bf8-a6f8-d06e4d0f37b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:10.299017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-abd9db0b-503b-4bf8-a6f8-d06e4d0f37b9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154396 Jul 28 20:31:10.299564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1684/3226] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:11.320349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-38962ff0-143c-4a2a-980f-439ea22f67fb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:11.320985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-38962ff0-143c-4a2a-980f-439ea22f67fb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:11.327508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38962ff0-143c-4a2a-980f-439ea22f67fb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:11.327961 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38962ff0-143c-4a2a-980f-439ea22f67fb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:11.328742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38962ff0-143c-4a2a-980f-439ea22f67fb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:11.329168 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-38962ff0-143c-4a2a-980f-439ea22f67fb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:11.456969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-38962ff0-143c-4a2a-980f-439ea22f67fb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:11.464809 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-38962ff0-143c-4a2a-980f-439ea22f67fb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148234 Jul 28 20:31:11.465344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1543/3227] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:12.484817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-985f21d6-7f6b-4633-ab02-4fa4aaa37d5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:12.485373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-985f21d6-7f6b-4633-ab02-4fa4aaa37d5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:12.491924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-985f21d6-7f6b-4633-ab02-4fa4aaa37d5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:12.492378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-985f21d6-7f6b-4633-ab02-4fa4aaa37d5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:12.493167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-985f21d6-7f6b-4633-ab02-4fa4aaa37d5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:12.493603 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-985f21d6-7f6b-4633-ab02-4fa4aaa37d5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:12.623758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-985f21d6-7f6b-4633-ab02-4fa4aaa37d5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:12.632280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-985f21d6-7f6b-4633-ab02-4fa4aaa37d5e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151387 Jul 28 20:31:12.632878 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1685/3228] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:13.654185 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1b2ccd9d-0879-430c-80a3-9795a5bfd2f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:13.654821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1b2ccd9d-0879-430c-80a3-9795a5bfd2f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:13.661523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b2ccd9d-0879-430c-80a3-9795a5bfd2f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:13.661972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b2ccd9d-0879-430c-80a3-9795a5bfd2f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:13.662730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b2ccd9d-0879-430c-80a3-9795a5bfd2f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:13.663167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b2ccd9d-0879-430c-80a3-9795a5bfd2f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:13.790320 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1b2ccd9d-0879-430c-80a3-9795a5bfd2f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:13.798225 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1b2ccd9d-0879-430c-80a3-9795a5bfd2f1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147951 Jul 28 20:31:13.798788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1544/3229] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:14.819939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eac2b246-e0be-4c5e-902c-3fd8fa80cbf7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:14.820590 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eac2b246-e0be-4c5e-902c-3fd8fa80cbf7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:14.827422 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eac2b246-e0be-4c5e-902c-3fd8fa80cbf7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:14.827868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eac2b246-e0be-4c5e-902c-3fd8fa80cbf7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:14.828703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eac2b246-e0be-4c5e-902c-3fd8fa80cbf7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:14.829079 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eac2b246-e0be-4c5e-902c-3fd8fa80cbf7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:14.958792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eac2b246-e0be-4c5e-902c-3fd8fa80cbf7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:14.966634 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eac2b246-e0be-4c5e-902c-3fd8fa80cbf7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151130 Jul 28 20:31:14.967190 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1686/3230] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:15.987892 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6da84fd4-4118-4bf7-ac46-f328bae23600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:15.988501 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6da84fd4-4118-4bf7-ac46-f328bae23600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:15.994997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6da84fd4-4118-4bf7-ac46-f328bae23600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:15.995471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6da84fd4-4118-4bf7-ac46-f328bae23600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:15.996223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6da84fd4-4118-4bf7-ac46-f328bae23600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:15.996691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6da84fd4-4118-4bf7-ac46-f328bae23600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:16.131151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6da84fd4-4118-4bf7-ac46-f328bae23600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:16.139303 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6da84fd4-4118-4bf7-ac46-f328bae23600 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155366 Jul 28 20:31:16.139866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1545/3231] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:17.161385 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d3ec0388-785a-4c78-8339-9d674363b6f3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:17.162028 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d3ec0388-785a-4c78-8339-9d674363b6f3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:17.169103 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3ec0388-785a-4c78-8339-9d674363b6f3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:17.169744 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3ec0388-785a-4c78-8339-9d674363b6f3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:17.170458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3ec0388-785a-4c78-8339-9d674363b6f3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:17.170883 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d3ec0388-785a-4c78-8339-9d674363b6f3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:17.310017 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d3ec0388-785a-4c78-8339-9d674363b6f3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:17.319251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d3ec0388-785a-4c78-8339-9d674363b6f3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.162271 Jul 28 20:31:17.319810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1687/3232] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:18.346402 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-74ae09f2-0ab0-417d-9cc0-3cc1f86e63c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:18.347570 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-74ae09f2-0ab0-417d-9cc0-3cc1f86e63c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:18.354064 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74ae09f2-0ab0-417d-9cc0-3cc1f86e63c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:18.354507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74ae09f2-0ab0-417d-9cc0-3cc1f86e63c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:18.355253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74ae09f2-0ab0-417d-9cc0-3cc1f86e63c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:18.355686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74ae09f2-0ab0-417d-9cc0-3cc1f86e63c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:18.358165 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:31:18.486509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-74ae09f2-0ab0-417d-9cc0-3cc1f86e63c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:18.494663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-74ae09f2-0ab0-417d-9cc0-3cc1f86e63c2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152114 Jul 28 20:31:18.495227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1546/3233] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:19.516339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9dda295f-00f8-4ca1-9d09-63b98283e3f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:19.517052 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9dda295f-00f8-4ca1-9d09-63b98283e3f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:19.524625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9dda295f-00f8-4ca1-9d09-63b98283e3f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:19.525075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9dda295f-00f8-4ca1-9d09-63b98283e3f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:19.525825 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9dda295f-00f8-4ca1-9d09-63b98283e3f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:19.526255 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9dda295f-00f8-4ca1-9d09-63b98283e3f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:19.655388 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9dda295f-00f8-4ca1-9d09-63b98283e3f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:19.664350 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9dda295f-00f8-4ca1-9d09-63b98283e3f8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151960 Jul 28 20:31:19.664940 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1688/3234] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:20.686128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f635b057-510d-4363-b6de-8aa6673cda14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:20.686721 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f635b057-510d-4363-b6de-8aa6673cda14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:20.693742 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f635b057-510d-4363-b6de-8aa6673cda14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:20.694186 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f635b057-510d-4363-b6de-8aa6673cda14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:20.694933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f635b057-510d-4363-b6de-8aa6673cda14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:20.695361 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f635b057-510d-4363-b6de-8aa6673cda14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:20.832101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f635b057-510d-4363-b6de-8aa6673cda14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:20.840409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f635b057-510d-4363-b6de-8aa6673cda14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.157993 Jul 28 20:31:20.840980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1547/3235] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:21.861550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e28ab971-c36f-4aa1-ad5d-5b48f0802f3a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:21.862166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e28ab971-c36f-4aa1-ad5d-5b48f0802f3a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:21.869503 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e28ab971-c36f-4aa1-ad5d-5b48f0802f3a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:21.869953 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e28ab971-c36f-4aa1-ad5d-5b48f0802f3a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:21.870703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e28ab971-c36f-4aa1-ad5d-5b48f0802f3a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:21.871140 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e28ab971-c36f-4aa1-ad5d-5b48f0802f3a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:21.998384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e28ab971-c36f-4aa1-ad5d-5b48f0802f3a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:22.006872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e28ab971-c36f-4aa1-ad5d-5b48f0802f3a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149166 Jul 28 20:31:22.007430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1689/3236] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:23.028343 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-98b8e431-89b4-40cc-8ffa-a66642f9b0b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:23.028953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-98b8e431-89b4-40cc-8ffa-a66642f9b0b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:23.036095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98b8e431-89b4-40cc-8ffa-a66642f9b0b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:23.036552 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98b8e431-89b4-40cc-8ffa-a66642f9b0b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:23.037306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98b8e431-89b4-40cc-8ffa-a66642f9b0b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:23.037732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-98b8e431-89b4-40cc-8ffa-a66642f9b0b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:23.164098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-98b8e431-89b4-40cc-8ffa-a66642f9b0b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:23.172825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-98b8e431-89b4-40cc-8ffa-a66642f9b0b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148365 Jul 28 20:31:23.173393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1548/3237] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:23 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:24.195082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0c9c9c67-06ec-4a4b-b46f-601790e0feaf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:24.195693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0c9c9c67-06ec-4a4b-b46f-601790e0feaf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:24.203149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c9c9c67-06ec-4a4b-b46f-601790e0feaf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:24.203597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c9c9c67-06ec-4a4b-b46f-601790e0feaf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:24.204341 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c9c9c67-06ec-4a4b-b46f-601790e0feaf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:24.204798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c9c9c67-06ec-4a4b-b46f-601790e0feaf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:24.207291 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:31:24.337713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0c9c9c67-06ec-4a4b-b46f-601790e0feaf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:24.345658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0c9c9c67-06ec-4a4b-b46f-601790e0feaf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155288 Jul 28 20:31:24.346216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1690/3238] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:25.369134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-57da5225-b51f-472c-aad9-208e9173a540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:25.369747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-57da5225-b51f-472c-aad9-208e9173a540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:25.376275 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57da5225-b51f-472c-aad9-208e9173a540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:25.376758 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57da5225-b51f-472c-aad9-208e9173a540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:25.377502 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57da5225-b51f-472c-aad9-208e9173a540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:25.377931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57da5225-b51f-472c-aad9-208e9173a540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:25.506449 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-57da5225-b51f-472c-aad9-208e9173a540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:25.514496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-57da5225-b51f-472c-aad9-208e9173a540 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149215 Jul 28 20:31:25.515056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1549/3239] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:26.535287 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-40e7232d-8c47-477a-bd02-557d53f76b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:26.536023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-40e7232d-8c47-477a-bd02-557d53f76b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:26.542537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40e7232d-8c47-477a-bd02-557d53f76b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:26.542979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40e7232d-8c47-477a-bd02-557d53f76b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:26.543726 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40e7232d-8c47-477a-bd02-557d53f76b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:26.544152 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-40e7232d-8c47-477a-bd02-557d53f76b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:26.673977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-40e7232d-8c47-477a-bd02-557d53f76b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:26.682413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-40e7232d-8c47-477a-bd02-557d53f76b81 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151062 Jul 28 20:31:26.682977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1691/3240] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:27.704057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f674fe10-c931-4545-99fa-af5dd50a830b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:27.704695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f674fe10-c931-4545-99fa-af5dd50a830b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:27.711713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f674fe10-c931-4545-99fa-af5dd50a830b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:27.712201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f674fe10-c931-4545-99fa-af5dd50a830b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:27.712993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f674fe10-c931-4545-99fa-af5dd50a830b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:27.713435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f674fe10-c931-4545-99fa-af5dd50a830b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:27.841985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f674fe10-c931-4545-99fa-af5dd50a830b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:27.850722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f674fe10-c931-4545-99fa-af5dd50a830b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150467 Jul 28 20:31:27.851266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1550/3241] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:28.872386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-75b6522c-3c89-48e7-8c11-2a19c6ad0ada tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:28.872976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-75b6522c-3c89-48e7-8c11-2a19c6ad0ada tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:28.879493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75b6522c-3c89-48e7-8c11-2a19c6ad0ada tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:28.880511 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75b6522c-3c89-48e7-8c11-2a19c6ad0ada tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:28.881399 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75b6522c-3c89-48e7-8c11-2a19c6ad0ada tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:28.881832 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-75b6522c-3c89-48e7-8c11-2a19c6ad0ada tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:29.016872 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-75b6522c-3c89-48e7-8c11-2a19c6ad0ada tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:29.025244 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-75b6522c-3c89-48e7-8c11-2a19c6ad0ada tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156765 Jul 28 20:31:29.025811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1692/3242] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:30.046951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-784bb0c7-a773-4a68-acf8-0d49c3424de0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:30.047556 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-784bb0c7-a773-4a68-acf8-0d49c3424de0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:30.054123 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-784bb0c7-a773-4a68-acf8-0d49c3424de0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:30.054577 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-784bb0c7-a773-4a68-acf8-0d49c3424de0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:30.055336 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-784bb0c7-a773-4a68-acf8-0d49c3424de0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:30.055773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-784bb0c7-a773-4a68-acf8-0d49c3424de0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:30.186369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-784bb0c7-a773-4a68-acf8-0d49c3424de0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:30.195382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-784bb0c7-a773-4a68-acf8-0d49c3424de0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152383 Jul 28 20:31:30.195946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1551/3243] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:31.216733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f3d541f1-eebe-4f14-8835-001e3755b5d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:31.217326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f3d541f1-eebe-4f14-8835-001e3755b5d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:31.224584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3d541f1-eebe-4f14-8835-001e3755b5d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:31.225030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3d541f1-eebe-4f14-8835-001e3755b5d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:31.225786 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3d541f1-eebe-4f14-8835-001e3755b5d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:31.226212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f3d541f1-eebe-4f14-8835-001e3755b5d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:31.505495 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f3d541f1-eebe-4f14-8835-001e3755b5d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:31.513599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f3d541f1-eebe-4f14-8835-001e3755b5d1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.300722 Jul 28 20:31:31.514150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1693/3244] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:32.536179 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3af8e044-d0bc-4a83-8971-5e6c079b4ec2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:32.536923 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3af8e044-d0bc-4a83-8971-5e6c079b4ec2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:32.538865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=26 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:31:32.544026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3af8e044-d0bc-4a83-8971-5e6c079b4ec2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:32.544470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3af8e044-d0bc-4a83-8971-5e6c079b4ec2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:32.545250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3af8e044-d0bc-4a83-8971-5e6c079b4ec2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:32.545681 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3af8e044-d0bc-4a83-8971-5e6c079b4ec2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:32.679646 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3af8e044-d0bc-4a83-8971-5e6c079b4ec2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:32.688085 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3af8e044-d0bc-4a83-8971-5e6c079b4ec2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156424 Jul 28 20:31:32.688665 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1552/3245] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:33.709926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-023938f2-7642-46dd-a1f6-1b97806e5406 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:33.710527 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-023938f2-7642-46dd-a1f6-1b97806e5406 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:33.717212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-023938f2-7642-46dd-a1f6-1b97806e5406 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:33.717652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-023938f2-7642-46dd-a1f6-1b97806e5406 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:33.718401 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-023938f2-7642-46dd-a1f6-1b97806e5406 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:33.718827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-023938f2-7642-46dd-a1f6-1b97806e5406 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:33.846228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-023938f2-7642-46dd-a1f6-1b97806e5406 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:33.854627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-023938f2-7642-46dd-a1f6-1b97806e5406 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149011 Jul 28 20:31:33.855166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1694/3246] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:34.875928 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1c246e5f-243a-4546-bd38-76566da8cf0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:34.876494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1c246e5f-243a-4546-bd38-76566da8cf0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:34.883971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c246e5f-243a-4546-bd38-76566da8cf0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:34.884418 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c246e5f-243a-4546-bd38-76566da8cf0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:34.885571 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c246e5f-243a-4546-bd38-76566da8cf0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:34.886008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c246e5f-243a-4546-bd38-76566da8cf0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:35.016093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1c246e5f-243a-4546-bd38-76566da8cf0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:35.025047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1c246e5f-243a-4546-bd38-76566da8cf0b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153016 Jul 28 20:31:35.025606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1553/3247] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:36.046437 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8c760e15-eb2f-47d5-bf9d-46bd5389c57f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:36.047034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8c760e15-eb2f-47d5-bf9d-46bd5389c57f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:36.049340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=26 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:31:36.055528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8c760e15-eb2f-47d5-bf9d-46bd5389c57f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:36.055971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8c760e15-eb2f-47d5-bf9d-46bd5389c57f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:36.056787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8c760e15-eb2f-47d5-bf9d-46bd5389c57f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:36.057213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8c760e15-eb2f-47d5-bf9d-46bd5389c57f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:36.184666 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8c760e15-eb2f-47d5-bf9d-46bd5389c57f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:36.192791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8c760e15-eb2f-47d5-bf9d-46bd5389c57f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150196 Jul 28 20:31:36.193342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1695/3248] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:36 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:37.213886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b78b8ce6-a53a-42b3-947f-f1c9df60ad71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:37.214522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b78b8ce6-a53a-42b3-947f-f1c9df60ad71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:37.221052 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b78b8ce6-a53a-42b3-947f-f1c9df60ad71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:37.221494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b78b8ce6-a53a-42b3-947f-f1c9df60ad71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:37.222243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b78b8ce6-a53a-42b3-947f-f1c9df60ad71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:37.222664 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b78b8ce6-a53a-42b3-947f-f1c9df60ad71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:37.350382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b78b8ce6-a53a-42b3-947f-f1c9df60ad71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:37.358183 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b78b8ce6-a53a-42b3-947f-f1c9df60ad71 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148283 Jul 28 20:31:37.358736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1554/3249] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:38.379220 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5d91df32-8703-4463-b949-8ab03a507888 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:38.380522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5d91df32-8703-4463-b949-8ab03a507888 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:38.387018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5d91df32-8703-4463-b949-8ab03a507888 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:38.387462 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5d91df32-8703-4463-b949-8ab03a507888 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:38.388204 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5d91df32-8703-4463-b949-8ab03a507888 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:38.388661 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5d91df32-8703-4463-b949-8ab03a507888 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:38.520496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5d91df32-8703-4463-b949-8ab03a507888 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:38.528600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5d91df32-8703-4463-b949-8ab03a507888 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153248 Jul 28 20:31:38.529149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1696/3250] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:39.549512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9742a37e-271e-454a-8706-4829cc189182 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:39.550103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9742a37e-271e-454a-8706-4829cc189182 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:39.556839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9742a37e-271e-454a-8706-4829cc189182 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:39.557298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9742a37e-271e-454a-8706-4829cc189182 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:39.558050 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9742a37e-271e-454a-8706-4829cc189182 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:39.558485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9742a37e-271e-454a-8706-4829cc189182 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:39.689047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9742a37e-271e-454a-8706-4829cc189182 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:39.697890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9742a37e-271e-454a-8706-4829cc189182 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152221 Jul 28 20:31:39.700486 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1555/3251] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:40.721522 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-78d681ae-52c1-4f31-a5d9-c8754d92715a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:40.722124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-78d681ae-52c1-4f31-a5d9-c8754d92715a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:40.729251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78d681ae-52c1-4f31-a5d9-c8754d92715a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:40.729691 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78d681ae-52c1-4f31-a5d9-c8754d92715a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:40.730435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78d681ae-52c1-4f31-a5d9-c8754d92715a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:40.730860 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-78d681ae-52c1-4f31-a5d9-c8754d92715a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:40.859362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-78d681ae-52c1-4f31-a5d9-c8754d92715a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:40.867413 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-78d681ae-52c1-4f31-a5d9-c8754d92715a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149670 Jul 28 20:31:40.867948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1697/3252] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:31:41.888927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-243d6e27-52c5-4b82-9dc2-f895651264cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:41.889534 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-243d6e27-52c5-4b82-9dc2-f895651264cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:41.896718 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-243d6e27-52c5-4b82-9dc2-f895651264cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:41.897163 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-243d6e27-52c5-4b82-9dc2-f895651264cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:41.897919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-243d6e27-52c5-4b82-9dc2-f895651264cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:41.898604 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-243d6e27-52c5-4b82-9dc2-f895651264cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:42.025068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-243d6e27-52c5-4b82-9dc2-f895651264cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:42.032933 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-243d6e27-52c5-4b82-9dc2-f895651264cf tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147861 Jul 28 20:31:42.033494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1556/3253] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:43.056216 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7449b3a4-014d-49a8-8905-dde33e3134f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:43.056805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7449b3a4-014d-49a8-8905-dde33e3134f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:43.063417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7449b3a4-014d-49a8-8905-dde33e3134f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:43.063862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7449b3a4-014d-49a8-8905-dde33e3134f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:43.064649 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7449b3a4-014d-49a8-8905-dde33e3134f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:43.065091 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7449b3a4-014d-49a8-8905-dde33e3134f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:43.193895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7449b3a4-014d-49a8-8905-dde33e3134f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:43.201817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7449b3a4-014d-49a8-8905-dde33e3134f2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149700 Jul 28 20:31:43.202375 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1698/3254] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:43 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:44.224825 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e81a074f-95ca-47df-98be-f3dd7c1cd42c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:44.225444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e81a074f-95ca-47df-98be-f3dd7c1cd42c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:44.231877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e81a074f-95ca-47df-98be-f3dd7c1cd42c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:44.232326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e81a074f-95ca-47df-98be-f3dd7c1cd42c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:44.233118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e81a074f-95ca-47df-98be-f3dd7c1cd42c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:44.233561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e81a074f-95ca-47df-98be-f3dd7c1cd42c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:44.367610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e81a074f-95ca-47df-98be-f3dd7c1cd42c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:44.375469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e81a074f-95ca-47df-98be-f3dd7c1cd42c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155131 Jul 28 20:31:44.376032 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1557/3255] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:45.396458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eca8b542-6a13-4896-871b-9c1003630f4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:45.397093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eca8b542-6a13-4896-871b-9c1003630f4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:45.403905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eca8b542-6a13-4896-871b-9c1003630f4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:45.404353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eca8b542-6a13-4896-871b-9c1003630f4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:45.405218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eca8b542-6a13-4896-871b-9c1003630f4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:45.405642 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-eca8b542-6a13-4896-871b-9c1003630f4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:45.539007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eca8b542-6a13-4896-871b-9c1003630f4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:45.546824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eca8b542-6a13-4896-871b-9c1003630f4a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154252 Jul 28 20:31:45.547373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1699/3256] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:46.568493 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ba30a82d-4f3b-4416-b0c4-1b804cbfa842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:46.569106 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ba30a82d-4f3b-4416-b0c4-1b804cbfa842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:46.575507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba30a82d-4f3b-4416-b0c4-1b804cbfa842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:46.575951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba30a82d-4f3b-4416-b0c4-1b804cbfa842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:46.576732 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba30a82d-4f3b-4416-b0c4-1b804cbfa842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:46.577162 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ba30a82d-4f3b-4416-b0c4-1b804cbfa842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:46.711344 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ba30a82d-4f3b-4416-b0c4-1b804cbfa842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:46.719204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ba30a82d-4f3b-4416-b0c4-1b804cbfa842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154844 Jul 28 20:31:46.719757 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1558/3257] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:47.741442 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4f6f0ff4-f83d-48f1-8a01-747327b1ca2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:47.742081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4f6f0ff4-f83d-48f1-8a01-747327b1ca2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:47.748968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f6f0ff4-f83d-48f1-8a01-747327b1ca2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:47.749412 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f6f0ff4-f83d-48f1-8a01-747327b1ca2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:47.750162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f6f0ff4-f83d-48f1-8a01-747327b1ca2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:47.750607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f6f0ff4-f83d-48f1-8a01-747327b1ca2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:47.884452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4f6f0ff4-f83d-48f1-8a01-747327b1ca2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:47.892335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4f6f0ff4-f83d-48f1-8a01-747327b1ca2f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155488 Jul 28 20:31:47.892926 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1700/3258] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:48.914374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-898e2845-6b15-4869-a91d-6b44e90cfa84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:48.914972 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-898e2845-6b15-4869-a91d-6b44e90cfa84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:48.921500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-898e2845-6b15-4869-a91d-6b44e90cfa84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:48.921948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-898e2845-6b15-4869-a91d-6b44e90cfa84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:48.922695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-898e2845-6b15-4869-a91d-6b44e90cfa84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:48.923128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-898e2845-6b15-4869-a91d-6b44e90cfa84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:48.928141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:31:49.052214 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-898e2845-6b15-4869-a91d-6b44e90cfa84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:49.060068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-898e2845-6b15-4869-a91d-6b44e90cfa84 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150156 Jul 28 20:31:49.060645 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1559/3259] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:50.083914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-03a51a96-4444-4d7d-8e2c-709d5a885ec1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:50.084605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-03a51a96-4444-4d7d-8e2c-709d5a885ec1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:50.091089 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-03a51a96-4444-4d7d-8e2c-709d5a885ec1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:50.091542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-03a51a96-4444-4d7d-8e2c-709d5a885ec1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:50.092300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-03a51a96-4444-4d7d-8e2c-709d5a885ec1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:50.092771 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-03a51a96-4444-4d7d-8e2c-709d5a885ec1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:50.221909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-03a51a96-4444-4d7d-8e2c-709d5a885ec1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:50.229754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-03a51a96-4444-4d7d-8e2c-709d5a885ec1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152224 Jul 28 20:31:50.230304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1701/3260] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:50 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:51.250607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-012772c1-820e-46b5-9614-ba7191f27f14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:51.251382 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-012772c1-820e-46b5-9614-ba7191f27f14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:51.258529 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-012772c1-820e-46b5-9614-ba7191f27f14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:51.258980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-012772c1-820e-46b5-9614-ba7191f27f14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:51.259741 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-012772c1-820e-46b5-9614-ba7191f27f14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:51.260174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-012772c1-820e-46b5-9614-ba7191f27f14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:51.393949 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-012772c1-820e-46b5-9614-ba7191f27f14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:51.402413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-012772c1-820e-46b5-9614-ba7191f27f14 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.155632 Jul 28 20:31:51.402982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1560/3261] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:52.065668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:31:52.065888 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:31:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:31:52.423324 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2eadd966-52b5-4ee9-959c-ccd662ddf446 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:52.423919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2eadd966-52b5-4ee9-959c-ccd662ddf446 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:52.430859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2eadd966-52b5-4ee9-959c-ccd662ddf446 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:52.431309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2eadd966-52b5-4ee9-959c-ccd662ddf446 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:52.432057 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2eadd966-52b5-4ee9-959c-ccd662ddf446 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:52.432491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2eadd966-52b5-4ee9-959c-ccd662ddf446 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:52.562232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-2eadd966-52b5-4ee9-959c-ccd662ddf446 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:52.570656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2eadd966-52b5-4ee9-959c-ccd662ddf446 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151155 Jul 28 20:31:52.571208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1702/3262] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:53.653984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-80606f65-397d-4b66-a1fa-b72ad54c3fd3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:53.654595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-80606f65-397d-4b66-a1fa-b72ad54c3fd3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:53.661720 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80606f65-397d-4b66-a1fa-b72ad54c3fd3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:53.662166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80606f65-397d-4b66-a1fa-b72ad54c3fd3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:53.663036 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80606f65-397d-4b66-a1fa-b72ad54c3fd3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:53.663470 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80606f65-397d-4b66-a1fa-b72ad54c3fd3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:53.789724 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-80606f65-397d-4b66-a1fa-b72ad54c3fd3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:53.797715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-80606f65-397d-4b66-a1fa-b72ad54c3fd3 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147525 Jul 28 20:31:53.798269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1561/3263] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:54.819595 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-346b032f-ce30-485e-94a4-e067ef903ccd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:54.820228 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-346b032f-ce30-485e-94a4-e067ef903ccd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:54.826835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-346b032f-ce30-485e-94a4-e067ef903ccd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:54.827274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-346b032f-ce30-485e-94a4-e067ef903ccd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:54.828010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-346b032f-ce30-485e-94a4-e067ef903ccd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:54.828435 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-346b032f-ce30-485e-94a4-e067ef903ccd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:54.830888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:31:54.961136 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-346b032f-ce30-485e-94a4-e067ef903ccd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:54.969074 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-346b032f-ce30-485e-94a4-e067ef903ccd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153840 Jul 28 20:31:54.969633 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1703/3264] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:55.990522 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-45320df5-d8f5-4b4d-b247-0c6e2a092e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:55.991089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-45320df5-d8f5-4b4d-b247-0c6e2a092e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:55.997472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45320df5-d8f5-4b4d-b247-0c6e2a092e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:55.997915 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45320df5-d8f5-4b4d-b247-0c6e2a092e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:55.998654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45320df5-d8f5-4b4d-b247-0c6e2a092e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:55.999079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-45320df5-d8f5-4b4d-b247-0c6e2a092e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:56.128903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-45320df5-d8f5-4b4d-b247-0c6e2a092e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:56.136820 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-45320df5-d8f5-4b4d-b247-0c6e2a092e02 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150376 Jul 28 20:31:56.137377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1562/3265] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:55 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:57.158702 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-11ad5c4e-8c0c-4610-a092-1426d2a539e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:57.159264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-11ad5c4e-8c0c-4610-a092-1426d2a539e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:57.166041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-11ad5c4e-8c0c-4610-a092-1426d2a539e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:57.166493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-11ad5c4e-8c0c-4610-a092-1426d2a539e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:57.167261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-11ad5c4e-8c0c-4610-a092-1426d2a539e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:57.167698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-11ad5c4e-8c0c-4610-a092-1426d2a539e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:57.293358 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-11ad5c4e-8c0c-4610-a092-1426d2a539e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:57.301767 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-11ad5c4e-8c0c-4610-a092-1426d2a539e8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146889 Jul 28 20:31:57.302327 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1704/3266] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:57 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:58.330211 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-cd8e5f4a-67ef-4a35-a062-f1d47c81d0a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:58.330819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-cd8e5f4a-67ef-4a35-a062-f1d47c81d0a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:58.338003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cd8e5f4a-67ef-4a35-a062-f1d47c81d0a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:58.338446 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cd8e5f4a-67ef-4a35-a062-f1d47c81d0a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:58.339226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cd8e5f4a-67ef-4a35-a062-f1d47c81d0a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:58.339656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-cd8e5f4a-67ef-4a35-a062-f1d47c81d0a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:58.470836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-cd8e5f4a-67ef-4a35-a062-f1d47c81d0a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:58.479288 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-cd8e5f4a-67ef-4a35-a062-f1d47c81d0a2 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152951 Jul 28 20:31:58.479851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1563/3267] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:58 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:31:58.617192 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:31:58.617607 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:31:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:31:59.500620 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cc586412-c082-437e-ba0d-58c4bb74aa78 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:31:59.501170 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cc586412-c082-437e-ba0d-58c4bb74aa78 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:31:59.507676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc586412-c082-437e-ba0d-58c4bb74aa78 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:59.508119 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc586412-c082-437e-ba0d-58c4bb74aa78 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:59.508893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc586412-c082-437e-ba0d-58c4bb74aa78 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:31:59.509323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cc586412-c082-437e-ba0d-58c4bb74aa78 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:31:59.637758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-cc586412-c082-437e-ba0d-58c4bb74aa78 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:31:59.646326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cc586412-c082-437e-ba0d-58c4bb74aa78 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149611 Jul 28 20:31:59.646868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1705/3268] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:31:59 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:00.668861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8b06f049-7fa1-42cd-a9e4-6482fe8d4a63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:00.669480 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8b06f049-7fa1-42cd-a9e4-6482fe8d4a63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:00.676654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b06f049-7fa1-42cd-a9e4-6482fe8d4a63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:00.677114 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b06f049-7fa1-42cd-a9e4-6482fe8d4a63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:00.677886 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b06f049-7fa1-42cd-a9e4-6482fe8d4a63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:00.678333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8b06f049-7fa1-42cd-a9e4-6482fe8d4a63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:00.810254 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8b06f049-7fa1-42cd-a9e4-6482fe8d4a63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:00.818796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8b06f049-7fa1-42cd-a9e4-6482fe8d4a63 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153855 Jul 28 20:32:00.819377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1564/3269] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:00 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:01.840721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-b04c1d4f-6520-42cb-81ff-8dc46c481f24 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:01.841353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-b04c1d4f-6520-42cb-81ff-8dc46c481f24 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:01.848713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b04c1d4f-6520-42cb-81ff-8dc46c481f24 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:01.848713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b04c1d4f-6520-42cb-81ff-8dc46c481f24 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:01.849470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b04c1d4f-6520-42cb-81ff-8dc46c481f24 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:01.849894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-b04c1d4f-6520-42cb-81ff-8dc46c481f24 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:01.986452 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-b04c1d4f-6520-42cb-81ff-8dc46c481f24 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:01.995024 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-b04c1d4f-6520-42cb-81ff-8dc46c481f24 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158176 Jul 28 20:32:01.995572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1706/3270] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:01 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:03.015319 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-351abe3a-6857-4357-b026-0dae375e31be tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:03.015889 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-351abe3a-6857-4357-b026-0dae375e31be tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:03.018154 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=26 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:32:03.024462 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-351abe3a-6857-4357-b026-0dae375e31be tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:03.024930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-351abe3a-6857-4357-b026-0dae375e31be tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:03.025686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-351abe3a-6857-4357-b026-0dae375e31be tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:03.026117 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-351abe3a-6857-4357-b026-0dae375e31be tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:03.161484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-351abe3a-6857-4357-b026-0dae375e31be tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:03.169671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-351abe3a-6857-4357-b026-0dae375e31be tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158330 Jul 28 20:32:03.170223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1565/3271] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:03 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:04.191950 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-25872e14-5353-48c1-8541-c0c6e5f8a127 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:04.192578 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-25872e14-5353-48c1-8541-c0c6e5f8a127 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:04.198540 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-25872e14-5353-48c1-8541-c0c6e5f8a127 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:04.198976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-25872e14-5353-48c1-8541-c0c6e5f8a127 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:04.199718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-25872e14-5353-48c1-8541-c0c6e5f8a127 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:04.200143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-25872e14-5353-48c1-8541-c0c6e5f8a127 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:04.325660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-25872e14-5353-48c1-8541-c0c6e5f8a127 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:04.333531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-25872e14-5353-48c1-8541-c0c6e5f8a127 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146222 Jul 28 20:32:04.334081 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1707/3272] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:04 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:05.355355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3b1496e5-df1e-4c91-97d7-33ec274d3e66 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:05.355948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3b1496e5-df1e-4c91-97d7-33ec274d3e66 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:05.363017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b1496e5-df1e-4c91-97d7-33ec274d3e66 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:05.363548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b1496e5-df1e-4c91-97d7-33ec274d3e66 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:05.364300 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b1496e5-df1e-4c91-97d7-33ec274d3e66 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:05.364766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3b1496e5-df1e-4c91-97d7-33ec274d3e66 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:05.491227 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3b1496e5-df1e-4c91-97d7-33ec274d3e66 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:05.499216 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3b1496e5-df1e-4c91-97d7-33ec274d3e66 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147863 Jul 28 20:32:05.499772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1566/3273] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:05 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:06.521257 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7debac87-3aa0-42d7-9c1b-0c6b849dcce8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:06.521828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7debac87-3aa0-42d7-9c1b-0c6b849dcce8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:06.524423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=26 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:32:06.529823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7debac87-3aa0-42d7-9c1b-0c6b849dcce8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:06.530275 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7debac87-3aa0-42d7-9c1b-0c6b849dcce8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:06.531032 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7debac87-3aa0-42d7-9c1b-0c6b849dcce8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:06.531470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7debac87-3aa0-42d7-9c1b-0c6b849dcce8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:06.663905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7debac87-3aa0-42d7-9c1b-0c6b849dcce8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:06.671828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7debac87-3aa0-42d7-9c1b-0c6b849dcce8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154634 Jul 28 20:32:06.672384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1708/3274] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:06 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:07.694304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-508ac7ec-f6eb-4507-9d0a-e21dc31005b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:07.694913 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-508ac7ec-f6eb-4507-9d0a-e21dc31005b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:07.701429 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-508ac7ec-f6eb-4507-9d0a-e21dc31005b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:07.701871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-508ac7ec-f6eb-4507-9d0a-e21dc31005b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:07.702619 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-508ac7ec-f6eb-4507-9d0a-e21dc31005b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:07.703051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-508ac7ec-f6eb-4507-9d0a-e21dc31005b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:07.829100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-508ac7ec-f6eb-4507-9d0a-e21dc31005b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:07.837871 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-508ac7ec-f6eb-4507-9d0a-e21dc31005b5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147456 Jul 28 20:32:07.838428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1567/3275] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:07 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:08.859096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-628c9660-28b3-4edc-9876-3b908b7cdca0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:08.859705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-628c9660-28b3-4edc-9876-3b908b7cdca0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:08.867243 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-628c9660-28b3-4edc-9876-3b908b7cdca0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:08.867626 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-628c9660-28b3-4edc-9876-3b908b7cdca0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:08.868371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-628c9660-28b3-4edc-9876-3b908b7cdca0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:08.868819 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-628c9660-28b3-4edc-9876-3b908b7cdca0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:08.997430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-628c9660-28b3-4edc-9876-3b908b7cdca0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:09.005903 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-628c9660-28b3-4edc-9876-3b908b7cdca0 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150627 Jul 28 20:32:09.006455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1709/3276] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:08 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:10.027041 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-40068112-a991-4b2e-bd44-1754374d2fac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:10.027650 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-40068112-a991-4b2e-bd44-1754374d2fac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:10.034090 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40068112-a991-4b2e-bd44-1754374d2fac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:10.034536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40068112-a991-4b2e-bd44-1754374d2fac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:10.035329 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40068112-a991-4b2e-bd44-1754374d2fac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:10.035762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-40068112-a991-4b2e-bd44-1754374d2fac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:10.162299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-40068112-a991-4b2e-bd44-1754374d2fac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:10.170479 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-40068112-a991-4b2e-bd44-1754374d2fac tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147521 Jul 28 20:32:10.171038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1568/3277] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:10 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:10.277778 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:32:10.277955 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:32:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:32:11.193219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4d345e43-3159-48ae-a80d-bcef6a07a49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:11.193887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4d345e43-3159-48ae-a80d-bcef6a07a49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:11.200384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d345e43-3159-48ae-a80d-bcef6a07a49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:11.200864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d345e43-3159-48ae-a80d-bcef6a07a49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:11.201652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d345e43-3159-48ae-a80d-bcef6a07a49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:11.202085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4d345e43-3159-48ae-a80d-bcef6a07a49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:11.327248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4d345e43-3159-48ae-a80d-bcef6a07a49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:11.335223 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4d345e43-3159-48ae-a80d-bcef6a07a49c tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146480 Jul 28 20:32:11.335776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1710/3278] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:11 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:12.356326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-27713028-6d9a-45d3-b4d8-6549cca12748 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:12.356960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-27713028-6d9a-45d3-b4d8-6549cca12748 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:12.363942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27713028-6d9a-45d3-b4d8-6549cca12748 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:12.364389 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27713028-6d9a-45d3-b4d8-6549cca12748 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:12.365176 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27713028-6d9a-45d3-b4d8-6549cca12748 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:12.365613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27713028-6d9a-45d3-b4d8-6549cca12748 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:12.496679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-27713028-6d9a-45d3-b4d8-6549cca12748 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:12.505771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-27713028-6d9a-45d3-b4d8-6549cca12748 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153246 Jul 28 20:32:12.506324 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1569/3279] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:12 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:13.527887 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-611f214f-dea2-47f8-8640-f3cd7d94eb34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:13.528473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-611f214f-dea2-47f8-8640-f3cd7d94eb34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:13.534905 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-611f214f-dea2-47f8-8640-f3cd7d94eb34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:13.535434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-611f214f-dea2-47f8-8640-f3cd7d94eb34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:13.536177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-611f214f-dea2-47f8-8640-f3cd7d94eb34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:13.536637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-611f214f-dea2-47f8-8640-f3cd7d94eb34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:13.662006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-611f214f-dea2-47f8-8640-f3cd7d94eb34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:13.669746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-611f214f-dea2-47f8-8640-f3cd7d94eb34 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.145773 Jul 28 20:32:13.670274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1711/3280] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:13 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:14.691092 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-689ada4c-aa37-4769-82fb-8aa282dd0e57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:14.691704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-689ada4c-aa37-4769-82fb-8aa282dd0e57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:14.698615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-689ada4c-aa37-4769-82fb-8aa282dd0e57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:14.699059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-689ada4c-aa37-4769-82fb-8aa282dd0e57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:14.699813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-689ada4c-aa37-4769-82fb-8aa282dd0e57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:14.700247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-689ada4c-aa37-4769-82fb-8aa282dd0e57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:14.830859 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-689ada4c-aa37-4769-82fb-8aa282dd0e57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:14.839578 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-689ada4c-aa37-4769-82fb-8aa282dd0e57 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152354 Jul 28 20:32:14.840126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1570/3281] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:14 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:15.860650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5bfcf4a5-d9ea-4a74-8c80-7748b12cce10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:15.861273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5bfcf4a5-d9ea-4a74-8c80-7748b12cce10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:15.868218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5bfcf4a5-d9ea-4a74-8c80-7748b12cce10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:15.868700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5bfcf4a5-d9ea-4a74-8c80-7748b12cce10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:15.869484 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5bfcf4a5-d9ea-4a74-8c80-7748b12cce10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:15.869916 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5bfcf4a5-d9ea-4a74-8c80-7748b12cce10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:16.001778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5bfcf4a5-d9ea-4a74-8c80-7748b12cce10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:16.009611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5bfcf4a5-d9ea-4a74-8c80-7748b12cce10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152843 Jul 28 20:32:16.010164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1712/3282] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:15 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:17.031663 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8571f231-a315-4fc7-a2e3-403bc3268c05 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:17.032258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8571f231-a315-4fc7-a2e3-403bc3268c05 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:17.038699 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8571f231-a315-4fc7-a2e3-403bc3268c05 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:17.039147 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8571f231-a315-4fc7-a2e3-403bc3268c05 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:17.039900 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8571f231-a315-4fc7-a2e3-403bc3268c05 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:17.040333 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8571f231-a315-4fc7-a2e3-403bc3268c05 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:17.170104 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-8571f231-a315-4fc7-a2e3-403bc3268c05 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:17.178460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8571f231-a315-4fc7-a2e3-403bc3268c05 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151053 Jul 28 20:32:17.179047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1571/3283] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:17 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:18.200122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f4e3ea1c-4572-4a50-8a72-87dc3c250642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:18.200772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f4e3ea1c-4572-4a50-8a72-87dc3c250642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:18.207804 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4e3ea1c-4572-4a50-8a72-87dc3c250642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:18.208247 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4e3ea1c-4572-4a50-8a72-87dc3c250642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:18.209027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4e3ea1c-4572-4a50-8a72-87dc3c250642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:18.209453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f4e3ea1c-4572-4a50-8a72-87dc3c250642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:18.344047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f4e3ea1c-4572-4a50-8a72-87dc3c250642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:18.352646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f4e3ea1c-4572-4a50-8a72-87dc3c250642 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.156434 Jul 28 20:32:18.353205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1713/3284] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:18 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:19.380190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-57195de0-16cd-41a2-b90d-3319026fe5cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:19.380830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-57195de0-16cd-41a2-b90d-3319026fe5cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:19.387326 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57195de0-16cd-41a2-b90d-3319026fe5cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:19.387772 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57195de0-16cd-41a2-b90d-3319026fe5cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:19.388519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57195de0-16cd-41a2-b90d-3319026fe5cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:19.389005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-57195de0-16cd-41a2-b90d-3319026fe5cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:19.391474 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:32:19.515767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-57195de0-16cd-41a2-b90d-3319026fe5cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:19.524527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-57195de0-16cd-41a2-b90d-3319026fe5cb tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148567 Jul 28 20:32:19.525109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1572/3285] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:19 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:20.546490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-44c3a2a7-3a88-4077-8f3a-c520753dbb43 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:20.547075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-44c3a2a7-3a88-4077-8f3a-c520753dbb43 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:20.553783 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44c3a2a7-3a88-4077-8f3a-c520753dbb43 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:20.554234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44c3a2a7-3a88-4077-8f3a-c520753dbb43 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:20.554992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44c3a2a7-3a88-4077-8f3a-c520753dbb43 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:20.555424 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44c3a2a7-3a88-4077-8f3a-c520753dbb43 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:20.686289 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-44c3a2a7-3a88-4077-8f3a-c520753dbb43 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:20.695361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-44c3a2a7-3a88-4077-8f3a-c520753dbb43 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152824 Jul 28 20:32:20.695952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1714/3286] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:20 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:21.717471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-2cd0f6b7-7924-41b9-9b29-3c19fcffb85d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:21.718060 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-2cd0f6b7-7924-41b9-9b29-3c19fcffb85d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:21.725428 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2cd0f6b7-7924-41b9-9b29-3c19fcffb85d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:21.725879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2cd0f6b7-7924-41b9-9b29-3c19fcffb85d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:21.726632 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2cd0f6b7-7924-41b9-9b29-3c19fcffb85d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:21.727066 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-2cd0f6b7-7924-41b9-9b29-3c19fcffb85d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:21.857865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-2cd0f6b7-7924-41b9-9b29-3c19fcffb85d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:21.865746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-2cd0f6b7-7924-41b9-9b29-3c19fcffb85d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152549 Jul 28 20:32:21.866299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1573/3287] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:21 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:22.887166 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e47a6bc1-6efb-452e-8484-572c7d4092d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:22.887741 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e47a6bc1-6efb-452e-8484-572c7d4092d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:22.894061 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47a6bc1-6efb-452e-8484-572c7d4092d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:22.894516 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47a6bc1-6efb-452e-8484-572c7d4092d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:22.895845 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47a6bc1-6efb-452e-8484-572c7d4092d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:22.896280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e47a6bc1-6efb-452e-8484-572c7d4092d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:23.024210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e47a6bc1-6efb-452e-8484-572c7d4092d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:23.032177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e47a6bc1-6efb-452e-8484-572c7d4092d6 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148993 Jul 28 20:32:23.032770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1715/3288] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:22 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:24.054430 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7227a960-e520-47ff-b6cb-5e715e9d9b95 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:24.055037 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7227a960-e520-47ff-b6cb-5e715e9d9b95 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:24.061519 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7227a960-e520-47ff-b6cb-5e715e9d9b95 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:24.061963 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7227a960-e520-47ff-b6cb-5e715e9d9b95 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:24.062704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7227a960-e520-47ff-b6cb-5e715e9d9b95 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:24.063131 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7227a960-e520-47ff-b6cb-5e715e9d9b95 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:24.190934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7227a960-e520-47ff-b6cb-5e715e9d9b95 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:24.199520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7227a960-e520-47ff-b6cb-5e715e9d9b95 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149685 Jul 28 20:32:24.200076 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1574/3289] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:24 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:32:25.220728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-953e37fa-eb17-434b-882b-e7535696a7fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:25.221340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-953e37fa-eb17-434b-882b-e7535696a7fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:25.227976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-953e37fa-eb17-434b-882b-e7535696a7fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:25.228418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-953e37fa-eb17-434b-882b-e7535696a7fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:25.229209 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-953e37fa-eb17-434b-882b-e7535696a7fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:25.229645 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-953e37fa-eb17-434b-882b-e7535696a7fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:25.233478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=78 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:32:25.355379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-953e37fa-eb17-434b-882b-e7535696a7fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:25.363298 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-953e37fa-eb17-434b-882b-e7535696a7fa tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146469 Jul 28 20:32:25.363858 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1716/3290] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:25 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:26.385368 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fbdf60e9-fffa-446d-8ce5-45b312f09ea9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:26.385982 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fbdf60e9-fffa-446d-8ce5-45b312f09ea9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:26.392590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbdf60e9-fffa-446d-8ce5-45b312f09ea9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:26.393042 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbdf60e9-fffa-446d-8ce5-45b312f09ea9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:26.393799 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbdf60e9-fffa-446d-8ce5-45b312f09ea9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:26.394218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fbdf60e9-fffa-446d-8ce5-45b312f09ea9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:26.523283 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fbdf60e9-fffa-446d-8ce5-45b312f09ea9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:26.531416 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fbdf60e9-fffa-446d-8ce5-45b312f09ea9 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149904 Jul 28 20:32:26.531960 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1575/3291] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:26 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:27.553153 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-242b58de-8b0a-4fe2-957f-9864e476b177 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:27.553735 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-242b58de-8b0a-4fe2-957f-9864e476b177 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:27.560113 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-242b58de-8b0a-4fe2-957f-9864e476b177 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:27.560560 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-242b58de-8b0a-4fe2-957f-9864e476b177 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:27.561323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-242b58de-8b0a-4fe2-957f-9864e476b177 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:27.561747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-242b58de-8b0a-4fe2-957f-9864e476b177 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:27.687019 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-242b58de-8b0a-4fe2-957f-9864e476b177 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:27.695555 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-242b58de-8b0a-4fe2-957f-9864e476b177 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.146995 Jul 28 20:32:27.696102 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1717/3292] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:27 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:28.717116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1b1e6532-d2d7-46d6-abfd-e11bf0fc2d10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:28.717722 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1b1e6532-d2d7-46d6-abfd-e11bf0fc2d10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:28.724366 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b1e6532-d2d7-46d6-abfd-e11bf0fc2d10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:28.724839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b1e6532-d2d7-46d6-abfd-e11bf0fc2d10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:28.725590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b1e6532-d2d7-46d6-abfd-e11bf0fc2d10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:28.726019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1b1e6532-d2d7-46d6-abfd-e11bf0fc2d10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:29.064188 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1b1e6532-d2d7-46d6-abfd-e11bf0fc2d10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:29.072903 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1b1e6532-d2d7-46d6-abfd-e11bf0fc2d10 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.359587 Jul 28 20:32:29.073457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1576/3293] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:28 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:30.094709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c7bdfb87-607b-4940-8646-76ddc3ec23b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:30.095381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c7bdfb87-607b-4940-8646-76ddc3ec23b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:30.102066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7bdfb87-607b-4940-8646-76ddc3ec23b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:30.102513 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7bdfb87-607b-4940-8646-76ddc3ec23b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:30.103271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7bdfb87-607b-4940-8646-76ddc3ec23b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:30.103707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7bdfb87-607b-4940-8646-76ddc3ec23b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:30.230837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c7bdfb87-607b-4940-8646-76ddc3ec23b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:30.238712 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c7bdfb87-607b-4940-8646-76ddc3ec23b8 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147908 Jul 28 20:32:30.239868 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1718/3294] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:30 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:31.261496 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9d397aa9-6877-4214-99d2-5248e243f9e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:31.262107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9d397aa9-6877-4214-99d2-5248e243f9e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:31.268208 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d397aa9-6877-4214-99d2-5248e243f9e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:31.268709 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d397aa9-6877-4214-99d2-5248e243f9e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:31.269457 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d397aa9-6877-4214-99d2-5248e243f9e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:31.269883 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9d397aa9-6877-4214-99d2-5248e243f9e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:31.402215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9d397aa9-6877-4214-99d2-5248e243f9e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:31.410088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9d397aa9-6877-4214-99d2-5248e243f9e5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152480 Jul 28 20:32:31.410642 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1577/3295] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:31 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:32.430999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f15f628c-66e6-4411-91c8-b51cb2aaebcd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:32.431570 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f15f628c-66e6-4411-91c8-b51cb2aaebcd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:32.437936 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f15f628c-66e6-4411-91c8-b51cb2aaebcd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:32.438381 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f15f628c-66e6-4411-91c8-b51cb2aaebcd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:32.439117 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f15f628c-66e6-4411-91c8-b51cb2aaebcd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:32.439545 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f15f628c-66e6-4411-91c8-b51cb2aaebcd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:32.566218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-f15f628c-66e6-4411-91c8-b51cb2aaebcd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:32.574286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f15f628c-66e6-4411-91c8-b51cb2aaebcd tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147219 Jul 28 20:32:32.574849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1719/3296] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:32 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:33.595875 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4dec2ddc-796b-4d8b-8f07-a78021291486 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:33.596471 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4dec2ddc-796b-4d8b-8f07-a78021291486 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:33.598798 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=26 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:32:33.605019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4dec2ddc-796b-4d8b-8f07-a78021291486 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:33.605466 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4dec2ddc-796b-4d8b-8f07-a78021291486 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:33.606215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4dec2ddc-796b-4d8b-8f07-a78021291486 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:33.606648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4dec2ddc-796b-4d8b-8f07-a78021291486 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:33.737463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-4dec2ddc-796b-4d8b-8f07-a78021291486 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:33.745553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4dec2ddc-796b-4d8b-8f07-a78021291486 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.153573 Jul 28 20:32:33.746109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1578/3297] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:33 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:34.766952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e5d11b8a-ea0e-40a8-9400-a7acb641419b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:34.767583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e5d11b8a-ea0e-40a8-9400-a7acb641419b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:34.775045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5d11b8a-ea0e-40a8-9400-a7acb641419b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:34.775487 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5d11b8a-ea0e-40a8-9400-a7acb641419b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:34.776226 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5d11b8a-ea0e-40a8-9400-a7acb641419b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:34.776680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e5d11b8a-ea0e-40a8-9400-a7acb641419b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:34.903421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e5d11b8a-ea0e-40a8-9400-a7acb641419b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:34.911331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e5d11b8a-ea0e-40a8-9400-a7acb641419b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148219 Jul 28 20:32:34.912072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1720/3298] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:34 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:35.933397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-27db564e-d088-40fb-922d-3de483d4e2e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:35.934024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-27db564e-d088-40fb-922d-3de483d4e2e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:35.940511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27db564e-d088-40fb-922d-3de483d4e2e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:35.940985 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27db564e-d088-40fb-922d-3de483d4e2e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:35.941747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27db564e-d088-40fb-922d-3de483d4e2e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:35.942184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-27db564e-d088-40fb-922d-3de483d4e2e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:36.069002 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-27db564e-d088-40fb-922d-3de483d4e2e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:36.076964 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-27db564e-d088-40fb-922d-3de483d4e2e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147336 Jul 28 20:32:36.077526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1579/3299] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:35 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:37.098746 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ab5611f1-0c89-4277-8b9f-d17ea75d5b9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:37.100065 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ab5611f1-0c89-4277-8b9f-d17ea75d5b9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:37.102419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=26 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:32:37.107686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab5611f1-0c89-4277-8b9f-d17ea75d5b9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:37.108131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab5611f1-0c89-4277-8b9f-d17ea75d5b9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:37.108919 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab5611f1-0c89-4277-8b9f-d17ea75d5b9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:37.109354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ab5611f1-0c89-4277-8b9f-d17ea75d5b9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:37.238669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ab5611f1-0c89-4277-8b9f-d17ea75d5b9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:37.246750 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ab5611f1-0c89-4277-8b9f-d17ea75d5b9b tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151908 Jul 28 20:32:37.247305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1721/3300] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:37 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:38.268508 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f43f8214-17e2-4c8a-b8aa-e32806e77904 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:38.269145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f43f8214-17e2-4c8a-b8aa-e32806e77904 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:38.277077 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43f8214-17e2-4c8a-b8aa-e32806e77904 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:38.277528 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43f8214-17e2-4c8a-b8aa-e32806e77904 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:38.278282 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43f8214-17e2-4c8a-b8aa-e32806e77904 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:38.278715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f43f8214-17e2-4c8a-b8aa-e32806e77904 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:38.404991 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f43f8214-17e2-4c8a-b8aa-e32806e77904 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:38.413374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f43f8214-17e2-4c8a-b8aa-e32806e77904 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148722 Jul 28 20:32:38.413930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1580/3301] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:38 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:39.434664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e67f24ed-2442-4dc6-bab2-e8af0d9d3119 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:39.435197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e67f24ed-2442-4dc6-bab2-e8af0d9d3119 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:39.441569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e67f24ed-2442-4dc6-bab2-e8af0d9d3119 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:39.442014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e67f24ed-2442-4dc6-bab2-e8af0d9d3119 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:39.442756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e67f24ed-2442-4dc6-bab2-e8af0d9d3119 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:39.443188 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e67f24ed-2442-4dc6-bab2-e8af0d9d3119 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:39.571137 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e67f24ed-2442-4dc6-bab2-e8af0d9d3119 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:39.579326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e67f24ed-2442-4dc6-bab2-e8af0d9d3119 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148543 Jul 28 20:32:39.579882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1722/3302] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:39 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:40.600467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6b2f2b2b-b527-4e3a-a5e0-a06d9278c97e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:40.601189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6b2f2b2b-b527-4e3a-a5e0-a06d9278c97e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:40.607701 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b2f2b2b-b527-4e3a-a5e0-a06d9278c97e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:40.608149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b2f2b2b-b527-4e3a-a5e0-a06d9278c97e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:40.608942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b2f2b2b-b527-4e3a-a5e0-a06d9278c97e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:40.609381 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6b2f2b2b-b527-4e3a-a5e0-a06d9278c97e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:40.735489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6b2f2b2b-b527-4e3a-a5e0-a06d9278c97e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:40.743974 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6b2f2b2b-b527-4e3a-a5e0-a06d9278c97e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.147395 Jul 28 20:32:40.744527 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1581/3303] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:40 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:41.765838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-9c73e1ab-7712-4272-a132-10233572c239 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:41.766395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-9c73e1ab-7712-4272-a132-10233572c239 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:41.773888 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c73e1ab-7712-4272-a132-10233572c239 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:41.774331 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c73e1ab-7712-4272-a132-10233572c239 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:41.775071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c73e1ab-7712-4272-a132-10233572c239 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:41.775496 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-9c73e1ab-7712-4272-a132-10233572c239 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:41.901973 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-9c73e1ab-7712-4272-a132-10233572c239 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:41.914472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-9c73e1ab-7712-4272-a132-10233572c239 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152523 Jul 28 20:32:41.915042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1723/3304] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:41 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:42.935233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7cb01a85-a07d-4d77-be2e-5ff0847eab55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:42.935792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7cb01a85-a07d-4d77-be2e-5ff0847eab55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:42.942231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7cb01a85-a07d-4d77-be2e-5ff0847eab55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:42.942674 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7cb01a85-a07d-4d77-be2e-5ff0847eab55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:42.944067 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7cb01a85-a07d-4d77-be2e-5ff0847eab55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:42.944498 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7cb01a85-a07d-4d77-be2e-5ff0847eab55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:43.073748 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7cb01a85-a07d-4d77-be2e-5ff0847eab55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:43.081687 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7cb01a85-a07d-4d77-be2e-5ff0847eab55 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.150357 Jul 28 20:32:43.082253 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1582/3305] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:42 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:44.103454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4854a948-5d01-4eae-829b-369982866bd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:44.104059 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4854a948-5d01-4eae-829b-369982866bd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:44.110528 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4854a948-5d01-4eae-829b-369982866bd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:44.110978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4854a948-5d01-4eae-829b-369982866bd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:44.111725 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4854a948-5d01-4eae-829b-369982866bd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:44.112156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4854a948-5d01-4eae-829b-369982866bd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:44.239225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4854a948-5d01-4eae-829b-369982866bd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:44.247210 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4854a948-5d01-4eae-829b-369982866bd7 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148118 Jul 28 20:32:44.247761 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1724/3306] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:44 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:45.269988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b7c06301-1f73-4b3e-8c19-1318fd6c53ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:45.270595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b7c06301-1f73-4b3e-8c19-1318fd6c53ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:45.277803 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b7c06301-1f73-4b3e-8c19-1318fd6c53ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:45.278260 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b7c06301-1f73-4b3e-8c19-1318fd6c53ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:45.278986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b7c06301-1f73-4b3e-8c19-1318fd6c53ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:45.279413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b7c06301-1f73-4b3e-8c19-1318fd6c53ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:45.411553 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b7c06301-1f73-4b3e-8c19-1318fd6c53ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:45.420141 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b7c06301-1f73-4b3e-8c19-1318fd6c53ee tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154030 Jul 28 20:32:45.420648 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1583/3307] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:45 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:46.443053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-83830efd-da18-4cdb-af7f-aa32e4a6ca8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:46.443928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-83830efd-da18-4cdb-af7f-aa32e4a6ca8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:46.450217 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83830efd-da18-4cdb-af7f-aa32e4a6ca8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:46.450669 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83830efd-da18-4cdb-af7f-aa32e4a6ca8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:46.451414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83830efd-da18-4cdb-af7f-aa32e4a6ca8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:46.451843 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-83830efd-da18-4cdb-af7f-aa32e4a6ca8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:46.579895 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-83830efd-da18-4cdb-af7f-aa32e4a6ca8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:46.587817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-83830efd-da18-4cdb-af7f-aa32e4a6ca8a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149191 Jul 28 20:32:46.588368 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1725/3308] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:46 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:47.608802 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1842cfe8-4b99-4b4d-825b-bb8d63447c39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:47.609419 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1842cfe8-4b99-4b4d-825b-bb8d63447c39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:47.616195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1842cfe8-4b99-4b4d-825b-bb8d63447c39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:47.616678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1842cfe8-4b99-4b4d-825b-bb8d63447c39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:47.617433 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1842cfe8-4b99-4b4d-825b-bb8d63447c39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:47.617869 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1842cfe8-4b99-4b4d-825b-bb8d63447c39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:47.766561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1842cfe8-4b99-4b4d-825b-bb8d63447c39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:47.775800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1842cfe8-4b99-4b4d-825b-bb8d63447c39 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.170908 Jul 28 20:32:47.776354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1584/3309] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:47 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:48.797703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dff49926-16d1-4ca1-a082-f2319abee842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:48.798319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dff49926-16d1-4ca1-a082-f2319abee842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:48.805418 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dff49926-16d1-4ca1-a082-f2319abee842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:48.805864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dff49926-16d1-4ca1-a082-f2319abee842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:48.806611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dff49926-16d1-4ca1-a082-f2319abee842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:48.807041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dff49926-16d1-4ca1-a082-f2319abee842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:48.939195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dff49926-16d1-4ca1-a082-f2319abee842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:48.948093 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dff49926-16d1-4ca1-a082-f2319abee842 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.154218 Jul 28 20:32:48.948670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1726/3310] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:48 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:49.969939 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0bb35d91-6a9d-476c-b8e2-0cff078b4e82 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:49.970517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-0bb35d91-6a9d-476c-b8e2-0cff078b4e82 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:49.977638 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0bb35d91-6a9d-476c-b8e2-0cff078b4e82 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:49.978079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0bb35d91-6a9d-476c-b8e2-0cff078b4e82 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:49.978819 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0bb35d91-6a9d-476c-b8e2-0cff078b4e82 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:49.979245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-0bb35d91-6a9d-476c-b8e2-0cff078b4e82 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:49.983079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=78 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:32:50.108463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-0bb35d91-6a9d-476c-b8e2-0cff078b4e82 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:50.117116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0bb35d91-6a9d-476c-b8e2-0cff078b4e82 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.151148 Jul 28 20:32:50.117676 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1585/3311] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:49 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:51.138157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fe4bc9a3-3dc4-4500-aec9-b632584056ff tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:51.138795 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fe4bc9a3-3dc4-4500-aec9-b632584056ff tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:51.145261 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe4bc9a3-3dc4-4500-aec9-b632584056ff tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:51.145708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe4bc9a3-3dc4-4500-aec9-b632584056ff tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:51.147001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe4bc9a3-3dc4-4500-aec9-b632584056ff tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:51.147675 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fe4bc9a3-3dc4-4500-aec9-b632584056ff tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:51.284693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-fe4bc9a3-3dc4-4500-aec9-b632584056ff tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:51.293272 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fe4bc9a3-3dc4-4500-aec9-b632584056ff tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.158973 Jul 28 20:32:51.293828 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1727/3312] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:51 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:52.314781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ef625053-75f9-4695-a31f-26da35cb2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:52.315425 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ef625053-75f9-4695-a31f-26da35cb2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:52.322195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef625053-75f9-4695-a31f-26da35cb2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:52.322641 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef625053-75f9-4695-a31f-26da35cb2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:52.323386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef625053-75f9-4695-a31f-26da35cb2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:52.323812 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ef625053-75f9-4695-a31f-26da35cb2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:52.450581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ef625053-75f9-4695-a31f-26da35cb2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:52.459400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ef625053-75f9-4695-a31f-26da35cb2372 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.148424 Jul 28 20:32:52.459951 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1586/3313] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:52 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:53.480197 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3f8ef481-df7e-4d82-b67a-e5967004919a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:53.480812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3f8ef481-df7e-4d82-b67a-e5967004919a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:53.487280 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f8ef481-df7e-4d82-b67a-e5967004919a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:53.487728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f8ef481-df7e-4d82-b67a-e5967004919a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:53.488476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f8ef481-df7e-4d82-b67a-e5967004919a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:53.489085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3f8ef481-df7e-4d82-b67a-e5967004919a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:53.618406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3f8ef481-df7e-4d82-b67a-e5967004919a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:53.626274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3f8ef481-df7e-4d82-b67a-e5967004919a tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.149990 Jul 28 20:32:53.626827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1728/3314] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:53 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:54.647828 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b3451a33-0733-4d32-b3fa-e0de60051818 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:54.648435 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b3451a33-0733-4d32-b3fa-e0de60051818 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:32:54.654942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b3451a33-0733-4d32-b3fa-e0de60051818 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:54.655385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b3451a33-0733-4d32-b3fa-e0de60051818 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:54.656129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b3451a33-0733-4d32-b3fa-e0de60051818 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:54.656575 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b3451a33-0733-4d32-b3fa-e0de60051818 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:54.788151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b3451a33-0733-4d32-b3fa-e0de60051818 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:32:54.795906 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b3451a33-0733-4d32-b3fa-e0de60051818 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed" status: 200 len: 1735 microversion: 2.1 time: 0.152495 Jul 28 20:32:54.796458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1587/3315] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:32:54 2022] GET /compute/v2.1/servers/0038fe10-b9ea-4fe0-a220-9c2ab37f67ed => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:32:54.815520 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-66dacd3e-2981-47bd-81ff-d25e66351175 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '.version_select at 0x7f5036181160>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:32:54.820490 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR oslo.messaging._drivers.impl_rabbit [None req-66dacd3e-2981-47bd-81ff-d25e66351175 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [6867ed6b-5a6e-44db-b819-8aeabd0fe303] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 20:32:55.828685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [None req-66dacd3e-2981-47bd-81ff-d25e66351175 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [6867ed6b-5a6e-44db-b819-8aeabd0fe303] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 43482. Jul 28 20:32:55.846792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-66dacd3e-2981-47bd-81ff-d25e66351175 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933113843" status: 202 len: 0 microversion: 2.1 time: 1.034980 Jul 28 20:32:55.850808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1729/3316] 10.222.0.67 () {58 vars in 1218 bytes} [Thu Jul 28 20:32:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933113843 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:32:56.799867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-c5f9f32d-e4cd-4b0b-a1a3-9da3aef082f5 req-c6463ef7-f64b-400f-b553-5899d28d7c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0038fe10-b9ea-4fe0-a220-9c2ab37f67ed", "tag": "6dbb0ebe-84c3-436a-9f54-19cbea4b1db1"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:32:56.809658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-c5f9f32d-e4cd-4b0b-a1a3-9da3aef082f5 req-c6463ef7-f64b-400f-b553-5899d28d7c84 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:32:56.810105 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-c5f9f32d-e4cd-4b0b-a1a3-9da3aef082f5 req-c6463ef7-f64b-400f-b553-5899d28d7c84 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:32:56.822559 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-c5f9f32d-e4cd-4b0b-a1a3-9da3aef082f5 req-c6463ef7-f64b-400f-b553-5899d28d7c84 service nova] Creating event network-changed:6dbb0ebe-84c3-436a-9f54-19cbea4b1db1 for instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed on hv-cinder-85144 Jul 28 20:32:56.828034 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-c5f9f32d-e4cd-4b0b-a1a3-9da3aef082f5 req-c6463ef7-f64b-400f-b553-5899d28d7c84 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093391 Jul 28 20:32:56.828666 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1588/3317] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:33:05.835771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:33:05.836462 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:33:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:33:47.989363 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:33:47.990008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:34:03.371411 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=77 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:03.372147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:03.379048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-1d2c18ec-5133-4804-9dd6-b2dbe5ecdc9b req-abd1ae04-4612-4f47-9072-a6897cd197bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0038fe10-b9ea-4fe0-a220-9c2ab37f67ed", "name": "network-vif-deleted", "tag": "6dbb0ebe-84c3-436a-9f54-19cbea4b1db1"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:34:03.393264 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-1d2c18ec-5133-4804-9dd6-b2dbe5ecdc9b req-abd1ae04-4612-4f47-9072-a6897cd197bc service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:03.393708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-1d2c18ec-5133-4804-9dd6-b2dbe5ecdc9b req-abd1ae04-4612-4f47-9072-a6897cd197bc service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:03.405387 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-1d2c18ec-5133-4804-9dd6-b2dbe5ecdc9b req-abd1ae04-4612-4f47-9072-a6897cd197bc service nova] Creating event network-vif-deleted:6dbb0ebe-84c3-436a-9f54-19cbea4b1db1 for instance 0038fe10-b9ea-4fe0-a220-9c2ab37f67ed on hv-cinder-85144 Jul 28 20:34:03.412457 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-1d2c18ec-5133-4804-9dd6-b2dbe5ecdc9b req-abd1ae04-4612-4f47-9072-a6897cd197bc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042794 Jul 28 20:34:03.413314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1730/3318] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:34:03.729219 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=21 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:03.730323 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=19 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:03.735454 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bb69190b-07a5-4aa2-9ba1-55e21f778b2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:03.736062 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bb69190b-07a5-4aa2-9ba1-55e21f778b2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:03.744073 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb69190b-07a5-4aa2-9ba1-55e21f778b2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:03.744710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb69190b-07a5-4aa2-9ba1-55e21f778b2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:03.745489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb69190b-07a5-4aa2-9ba1-55e21f778b2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:03.745919 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bb69190b-07a5-4aa2-9ba1-55e21f778b2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:03.775770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bb69190b-07a5-4aa2-9ba1-55e21f778b2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:34:03.913338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bb69190b-07a5-4aa2-9ba1-55e21f778b2e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 204 len: 0 microversion: 2.1 time: 0.188483 Jul 28 20:34:03.914539 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1589/3319] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:34:03 2022] DELETE /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:34:03.924598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0a0e0e05-087c-44f4-9914-8d618f1ff27d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:03.925605 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0a0e0e05-087c-44f4-9914-8d618f1ff27d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:03.936589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a0e0e05-087c-44f4-9914-8d618f1ff27d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:03.937390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a0e0e05-087c-44f4-9914-8d618f1ff27d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:03.939092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a0e0e05-087c-44f4-9914-8d618f1ff27d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:03.939852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a0e0e05-087c-44f4-9914-8d618f1ff27d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:04.267663 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0a0e0e05-087c-44f4-9914-8d618f1ff27d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:04.276583 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0a0e0e05-087c-44f4-9914-8d618f1ff27d tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1508 microversion: 2.1 time: 0.357319 Jul 28 20:34:04.285650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1731/3320] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:03 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:05.301291 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-47831eff-ab23-42e3-979f-9d834c1df792 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:05.302719 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-47831eff-ab23-42e3-979f-9d834c1df792 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:05.310302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47831eff-ab23-42e3-979f-9d834c1df792 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:05.311293 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47831eff-ab23-42e3-979f-9d834c1df792 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:05.312278 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47831eff-ab23-42e3-979f-9d834c1df792 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:05.313228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-47831eff-ab23-42e3-979f-9d834c1df792 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:05.434844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-0071b702-8c9d-4e21-a2a9-1a241a6204fb req-12cbfe0e-c379-47da-bc94-b26e31d71aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768bb30f-60d9-4ad9-af77-64aadcfe531a", "name": "network-vif-deleted", "tag": "712aebad-d9b8-43d5-8376-3174657222f7"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:34:05.452964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-0071b702-8c9d-4e21-a2a9-1a241a6204fb req-12cbfe0e-c379-47da-bc94-b26e31d71aa1 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:05.454456 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-0071b702-8c9d-4e21-a2a9-1a241a6204fb req-12cbfe0e-c379-47da-bc94-b26e31d71aa1 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:05.467598 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-0071b702-8c9d-4e21-a2a9-1a241a6204fb req-12cbfe0e-c379-47da-bc94-b26e31d71aa1 service nova] Creating event network-vif-deleted:712aebad-d9b8-43d5-8376-3174657222f7 for instance 768bb30f-60d9-4ad9-af77-64aadcfe531a on hv-cinder-85144 Jul 28 20:34:05.473382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-0071b702-8c9d-4e21-a2a9-1a241a6204fb req-12cbfe0e-c379-47da-bc94-b26e31d71aa1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045590 Jul 28 20:34:05.475340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1732/3321] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:34:05.716116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-47831eff-ab23-42e3-979f-9d834c1df792 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:05.727342 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-47831eff-ab23-42e3-979f-9d834c1df792 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 200 len: 1466 microversion: 2.1 time: 0.431597 Jul 28 20:34:05.729182 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1590/3322] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:05 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 1466 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:06.871567 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:06.872383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: feb2a989-29e7-4123-bb19-871b05d7f88e] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:06.879770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:06.880211 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:06.880980 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:06.881408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:06.895097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Instance feb2a989-29e7-4123-bb19-871b05d7f88e could not be found. Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e HTTP/1.1 Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:34:06.897008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance feb2a989-29e7-4123-bb19-871b05d7f88e could not be found. Jul 28 20:34:06.898891 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'feb2a989-29e7-4123-bb19-871b05d7f88e'} Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance feb2a989-29e7-4123-bb19-871b05d7f88e could not be found. Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:34:06.901149 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance feb2a989-29e7-4123-bb19-871b05d7f88e could not be found. Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance feb2a989-29e7-4123-bb19-871b05d7f88e could not be found. Jul 28 20:34:06.902865 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:06.904386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 404 to user: Instance feb2a989-29e7-4123-bb19-871b05d7f88e could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:34:06.904386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5a4ea2f8-23c3-45f6-a7c7-f079764274e1 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e" status: 404 len: 111 microversion: 2.1 time: 0.151358 Jul 28 20:34:06.904386 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1733/3323] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:06 2022] GET /compute/v2.1/servers/feb2a989-29e7-4123-bb19-871b05d7f88e => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:34:06.907967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-18d0083b-5034-4bbf-bfe3-ab647d62eef5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:06.908654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-18d0083b-5034-4bbf-bfe3-ab647d62eef5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:06.916579 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d0083b-5034-4bbf-bfe3-ab647d62eef5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:06.917029 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d0083b-5034-4bbf-bfe3-ab647d62eef5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:06.917785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d0083b-5034-4bbf-bfe3-ab647d62eef5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:06.918218 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-18d0083b-5034-4bbf-bfe3-ab647d62eef5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:06.946057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-18d0083b-5034-4bbf-bfe3-ab647d62eef5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:34:07.018806 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-18d0083b-5034-4bbf-bfe3-ab647d62eef5 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 204 len: 0 microversion: 2.1 time: 0.114460 Jul 28 20:34:07.019379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1591/3324] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:34:06 2022] DELETE /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:34:07.028069 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e262b8da-cddb-423a-a032-9e73b268252f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:07.028826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e262b8da-cddb-423a-a032-9e73b268252f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:07.034929 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e262b8da-cddb-423a-a032-9e73b268252f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:07.035454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e262b8da-cddb-423a-a032-9e73b268252f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:07.036305 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e262b8da-cddb-423a-a032-9e73b268252f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:07.036844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e262b8da-cddb-423a-a032-9e73b268252f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:07.175756 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-e262b8da-cddb-423a-a032-9e73b268252f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:07.184173 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e262b8da-cddb-423a-a032-9e73b268252f tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1523 microversion: 2.1 time: 0.160449 Jul 28 20:34:07.184749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1734/3325] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:07 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:07.491094 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-4772e153-c02f-4f80-86a8-2a07f405986f req-9a69976e-4aeb-482a-a8ec-4f92bae11edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feb2a989-29e7-4123-bb19-871b05d7f88e", "name": "network-vif-deleted", "tag": "f92e97e3-b3c8-4bed-9bea-8dca7dcc33fc"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:34:07.500935 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-4772e153-c02f-4f80-86a8-2a07f405986f req-9a69976e-4aeb-482a-a8ec-4f92bae11edc service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:07.501372 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-4772e153-c02f-4f80-86a8-2a07f405986f req-9a69976e-4aeb-482a-a8ec-4f92bae11edc service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:07.512406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-4772e153-c02f-4f80-86a8-2a07f405986f req-9a69976e-4aeb-482a-a8ec-4f92bae11edc service nova] Creating event network-vif-deleted:f92e97e3-b3c8-4bed-9bea-8dca7dcc33fc for instance feb2a989-29e7-4123-bb19-871b05d7f88e on hv-cinder-85144 Jul 28 20:34:07.517468 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-4772e153-c02f-4f80-86a8-2a07f405986f req-9a69976e-4aeb-482a-a8ec-4f92bae11edc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030372 Jul 28 20:34:07.518034 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1592/3326] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:34:08.206068 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:08.206656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:08.213379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:08.213817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:08.214561 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:08.214986 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:08.247848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:08.248321 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:08.248861 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lazy-loading 'fault' on Instance uuid ea28ea30-1675-4f86-9a3d-8be8cf2b882d {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:34:08.288961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5be80ca35c954fdb963d6dc278fd62d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cc8b359904d4304a7b25954a46ae97b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:08.297077 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-31caa506-5885-49e3-868d-461bb4a10040 tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 200 len: 1312 microversion: 2.1 time: 0.094830 Jul 28 20:34:08.297628 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1735/3327] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:08 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:09.318643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:09.319371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] [instance: ea28ea30-1675-4f86-9a3d-8be8cf2b882d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:09.326010 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:09.326455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:09.327203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:09.327633 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:09.340995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] HTTP exception thrown: Instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d could not be found. Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Request method failure captured: Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d HTTP/1.1 Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4uppLuydVlUPjOVkN18S_Olr5dCogfcJRNz0CFBl1FoIRUXrj4SapBSJiNBNkqY4KdyRzlZBEMDPMVcAczW7GUCnVyBIBGm1TVlFuxCfCexY0UyRa2KPCCDF_2MygkYzFinUWOCUedTSMGs64WRq7OuXgcaWO-4SY_qW_d1zOraS4as Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:34:09.342517 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4cc8b359904d4304a7b25954a46ae97b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4cc8b359904d4304a7b25954a46ae97b"}]}] Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 4cc8b359904d4304a7b25954a46ae97b Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1491005133 Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 5be80ca35c954fdb963d6dc278fd62d3 Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1491005133-project Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d could not be found. Jul 28 20:34:09.344378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'ea28ea30-1675-4f86-9a3d-8be8cf2b882d'} Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d could not be found. Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:34:09.345369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d could not be found. Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d could not be found. Jul 28 20:34:09.346971 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:09.348400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] Returning 404 to user: Instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:34:09.348400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b079486b-d814-4c0d-909a-5c6264af314e tempest-ServerRescueNegativeTestJSON-1491005133 tempest-ServerRescueNegativeTestJSON-1491005133-project] 10.222.0.67 "GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d" status: 404 len: 111 microversion: 2.1 time: 0.029631 Jul 28 20:34:09.348400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1593/3328] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:09 2022] GET /compute/v2.1/servers/ea28ea30-1675-4f86-9a3d-8be8cf2b882d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:34:09.539657 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-21b07059-d956-4327-9e13-79bd784f3728 req-f16fee32-2ee8-4a4c-aeb7-19b01534b7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea28ea30-1675-4f86-9a3d-8be8cf2b882d", "name": "network-vif-deleted", "tag": "4ff28c7e-5433-4834-adf9-9e59ef20b859"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:34:09.550814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-21b07059-d956-4327-9e13-79bd784f3728 req-f16fee32-2ee8-4a4c-aeb7-19b01534b7fd service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:09.551254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-21b07059-d956-4327-9e13-79bd784f3728 req-f16fee32-2ee8-4a4c-aeb7-19b01534b7fd service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:09.563426 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-21b07059-d956-4327-9e13-79bd784f3728 req-f16fee32-2ee8-4a4c-aeb7-19b01534b7fd service nova] Creating event network-vif-deleted:4ff28c7e-5433-4834-adf9-9e59ef20b859 for instance ea28ea30-1675-4f86-9a3d-8be8cf2b882d on hv-cinder-85144 Jul 28 20:34:09.568438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-21b07059-d956-4327-9e13-79bd784f3728 req-f16fee32-2ee8-4a4c-aeb7-19b01534b7fd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032533 Jul 28 20:34:09.569060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1736/3329] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:34:18.460019 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b67543a4-f154-4cc3-8601-1f49109b6212 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'create', calling method: .version_select at 0x7f5037076940>, body: {"keypair": {"name": "tempest-keypair-161757863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLyx3oe5Z7+0s3ubGt6AZ5/QTspjzFr06FFX1V0vS34uttlxQgM3JP1+4F472muFvOqptmdoS70cc6erOcOqsrx/B9rFbY6GWzrUKl0Z2FIYxNjX6A0R5GYfMCwKarQCg=="}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:34:18.482490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-b67543a4-f154-4cc3-8601-1f49109b6212 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Getting quotas for project 6073a7dfe9864dee8831b72f165cf464. Resources: {'key_pairs'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:34:18.486815 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-b67543a4-f154-4cc3-8601-1f49109b6212 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Getting quotas for user b7fa18536db240e5b03c79408577cd6c and project 6073a7dfe9864dee8831b72f165cf464. Resources: {'key_pairs'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:34:18.512746 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b67543a4-f154-4cc3-8601-1f49109b6212 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.179021 Jul 28 20:34:18.513546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1594/3330] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:34:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:34:19.911909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=16 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:19.912990 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=28 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:19.918606 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1824884571", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc578bd6-9a8e-4cec-afe5-b0cf67324047"}], "security_groups": [{"name": "tempest-securitygroup--861594816"}], "key_name": "tempest-keypair-161757863", "user_data": "}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:34:20.060354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] validate_networks() for [('dc578bd6-9a8e-4cec-afe5-b0cf67324047', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:34:20.658100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:34:20.658806 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:34:20.659553 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:34:20.659985 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:34:20.660780 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:34:20.671090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:20.671641 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:20.672497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:20.673023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:20.691708 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Getting quotas for project 6073a7dfe9864dee8831b72f165cf464. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:34:20.697711 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Getting quotas for user b7fa18536db240e5b03c79408577cd6c and project 6073a7dfe9864dee8831b72f165cf464. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:34:20.708728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:34:20.711099 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:34:20.784476 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-bf0e22a0-600f-41f2-b273-d0b422ee57d9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.873980 Jul 28 20:34:20.785931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1737/3331] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:34:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:34:20.795204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:20.802594 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6717eb14-02d2-41a6-beaf-6250df9c7285 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:20.803213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6717eb14-02d2-41a6-beaf-6250df9c7285 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:20.923734 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-6717eb14-02d2-41a6-beaf-6250df9c7285 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:20.958489 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6717eb14-02d2-41a6-beaf-6250df9c7285 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1237 microversion: 2.1 time: 0.164012 Jul 28 20:34:20.977937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1595/3332] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:20 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1237 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:21.988421 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-77acd6e8-5f9d-44de-b9cc-c0b368a135ef tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:21.989071 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-77acd6e8-5f9d-44de-b9cc-c0b368a135ef tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:21.998202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77acd6e8-5f9d-44de-b9cc-c0b368a135ef tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:21.998625 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77acd6e8-5f9d-44de-b9cc-c0b368a135ef tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:21.999995 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77acd6e8-5f9d-44de-b9cc-c0b368a135ef tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:22.000656 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-77acd6e8-5f9d-44de-b9cc-c0b368a135ef tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:22.072322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-77acd6e8-5f9d-44de-b9cc-c0b368a135ef tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:22.080254 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-77acd6e8-5f9d-44de-b9cc-c0b368a135ef tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1289 microversion: 2.1 time: 0.096206 Jul 28 20:34:22.084823 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1738/3333] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:21 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:23.103512 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-29b81188-a801-4734-832a-333ca868b5e3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:23.104782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-29b81188-a801-4734-832a-333ca868b5e3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:23.111330 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29b81188-a801-4734-832a-333ca868b5e3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:23.111769 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29b81188-a801-4734-832a-333ca868b5e3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:23.112836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29b81188-a801-4734-832a-333ca868b5e3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:23.113355 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-29b81188-a801-4734-832a-333ca868b5e3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:23.281413 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-29b81188-a801-4734-832a-333ca868b5e3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:23.294887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-29b81188-a801-4734-832a-333ca868b5e3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1362 microversion: 2.1 time: 0.196013 Jul 28 20:34:23.296088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1596/3334] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:23 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:24.028923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-aa7b23ea-138c-440f-8186-4349ccce27e9 req-3d9bfa19-94e8-4b90-9f6a-b9a2e5d34de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9616e1-aa33-4392-8e87-a1932f07a45d", "tag": "09d5dc60-5e25-46d7-9ed9-4f7c36eef324"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:34:24.061000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-aa7b23ea-138c-440f-8186-4349ccce27e9 req-3d9bfa19-94e8-4b90-9f6a-b9a2e5d34de3 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:24.061454 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-aa7b23ea-138c-440f-8186-4349ccce27e9 req-3d9bfa19-94e8-4b90-9f6a-b9a2e5d34de3 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:24.075581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-aa7b23ea-138c-440f-8186-4349ccce27e9 req-3d9bfa19-94e8-4b90-9f6a-b9a2e5d34de3 service nova] Creating event network-changed:09d5dc60-5e25-46d7-9ed9-4f7c36eef324 for instance ff9616e1-aa33-4392-8e87-a1932f07a45d on hv-cinder-85144 Jul 28 20:34:24.082062 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-aa7b23ea-138c-440f-8186-4349ccce27e9 req-3d9bfa19-94e8-4b90-9f6a-b9a2e5d34de3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070195 Jul 28 20:34:24.083041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1739/3335] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:34:24.325070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-74f2e0ec-9607-4431-8cdc-134fdf661f96 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:24.325783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-74f2e0ec-9607-4431-8cdc-134fdf661f96 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:24.332560 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74f2e0ec-9607-4431-8cdc-134fdf661f96 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:24.333103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74f2e0ec-9607-4431-8cdc-134fdf661f96 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:24.333977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74f2e0ec-9607-4431-8cdc-134fdf661f96 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:24.334485 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-74f2e0ec-9607-4431-8cdc-134fdf661f96 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:24.471144 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-74f2e0ec-9607-4431-8cdc-134fdf661f96 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:24.479369 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-74f2e0ec-9607-4431-8cdc-134fdf661f96 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1362 microversion: 2.1 time: 0.159510 Jul 28 20:34:24.480026 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1597/3336] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:24 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:25.504851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3eb8b077-f235-4cab-b04b-e7d7f91002f9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:25.506230 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3eb8b077-f235-4cab-b04b-e7d7f91002f9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:25.513963 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3eb8b077-f235-4cab-b04b-e7d7f91002f9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:25.514718 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3eb8b077-f235-4cab-b04b-e7d7f91002f9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:25.515692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3eb8b077-f235-4cab-b04b-e7d7f91002f9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:25.516309 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3eb8b077-f235-4cab-b04b-e7d7f91002f9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:25.675432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3eb8b077-f235-4cab-b04b-e7d7f91002f9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:25.684274 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3eb8b077-f235-4cab-b04b-e7d7f91002f9 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1362 microversion: 2.1 time: 0.187634 Jul 28 20:34:25.684889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1740/3337] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:25 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:26.707103 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-80432f99-a4a2-4fa4-b278-a76b9b64f30f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:26.707713 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-80432f99-a4a2-4fa4-b278-a76b9b64f30f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:26.714967 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80432f99-a4a2-4fa4-b278-a76b9b64f30f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:26.715412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80432f99-a4a2-4fa4-b278-a76b9b64f30f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:26.716258 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80432f99-a4a2-4fa4-b278-a76b9b64f30f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:26.716715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-80432f99-a4a2-4fa4-b278-a76b9b64f30f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:26.852786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-80432f99-a4a2-4fa4-b278-a76b9b64f30f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:26.860717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-80432f99-a4a2-4fa4-b278-a76b9b64f30f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1362 microversion: 2.1 time: 0.157309 Jul 28 20:34:26.861511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1598/3338] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:26 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:27.881453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-020f7b53-23cf-46c7-9bb5-1c45e4351fd7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:27.882082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-020f7b53-23cf-46c7-9bb5-1c45e4351fd7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:27.888548 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-020f7b53-23cf-46c7-9bb5-1c45e4351fd7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:27.889015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-020f7b53-23cf-46c7-9bb5-1c45e4351fd7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:27.889758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-020f7b53-23cf-46c7-9bb5-1c45e4351fd7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:27.890183 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-020f7b53-23cf-46c7-9bb5-1c45e4351fd7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:28.020383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-020f7b53-23cf-46c7-9bb5-1c45e4351fd7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:28.028754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-020f7b53-23cf-46c7-9bb5-1c45e4351fd7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1362 microversion: 2.1 time: 0.151067 Jul 28 20:34:28.029296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1741/3339] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:27 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:29.048189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f3cae09f-d42f-4ac0-8262-e5ad3d3d752b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:29.049201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f3cae09f-d42f-4ac0-8262-e5ad3d3d752b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:29.055526 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3cae09f-d42f-4ac0-8262-e5ad3d3d752b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:29.056511 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3cae09f-d42f-4ac0-8262-e5ad3d3d752b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:29.057312 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3cae09f-d42f-4ac0-8262-e5ad3d3d752b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:29.057739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-f3cae09f-d42f-4ac0-8262-e5ad3d3d752b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:29.196942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f3cae09f-d42f-4ac0-8262-e5ad3d3d752b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:29.204861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f3cae09f-d42f-4ac0-8262-e5ad3d3d752b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1362 microversion: 2.1 time: 0.160474 Jul 28 20:34:29.205427 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1599/3340] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:29 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:29.477097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-805c143c-a92d-470c-897f-c2cdd52e6c4f req-fb382888-5125-4430-89b4-411684f405c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9616e1-aa33-4392-8e87-a1932f07a45d", "name": "network-vif-plugged", "status": "completed", "tag": "09d5dc60-5e25-46d7-9ed9-4f7c36eef324"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:34:29.486777 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-805c143c-a92d-470c-897f-c2cdd52e6c4f req-fb382888-5125-4430-89b4-411684f405c4 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:29.487208 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-805c143c-a92d-470c-897f-c2cdd52e6c4f req-fb382888-5125-4430-89b4-411684f405c4 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:29.500168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-805c143c-a92d-470c-897f-c2cdd52e6c4f req-fb382888-5125-4430-89b4-411684f405c4 service nova] Creating event network-vif-plugged:09d5dc60-5e25-46d7-9ed9-4f7c36eef324 for instance ff9616e1-aa33-4392-8e87-a1932f07a45d on hv-cinder-85144 Jul 28 20:34:29.505212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-805c143c-a92d-470c-897f-c2cdd52e6c4f req-fb382888-5125-4430-89b4-411684f405c4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213969 Jul 28 20:34:29.505822 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1742/3341] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:34:30.226332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-991596ab-bfdc-4028-b203-65645a00a6e1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:30.226940 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-991596ab-bfdc-4028-b203-65645a00a6e1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:30.233412 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-991596ab-bfdc-4028-b203-65645a00a6e1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:30.233851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-991596ab-bfdc-4028-b203-65645a00a6e1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:30.234587 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-991596ab-bfdc-4028-b203-65645a00a6e1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:30.235013 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-991596ab-bfdc-4028-b203-65645a00a6e1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:30.370196 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-991596ab-bfdc-4028-b203-65645a00a6e1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:30.378533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-991596ab-bfdc-4028-b203-65645a00a6e1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1362 microversion: 2.1 time: 0.156021 Jul 28 20:34:30.379086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1600/3342] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:30 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:31.398075 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:31.398747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=6 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:31.403340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-25ee150b-d216-4b76-9499-defc3cfec0a1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:31.404060 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-25ee150b-d216-4b76-9499-defc3cfec0a1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:31.411379 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-25ee150b-d216-4b76-9499-defc3cfec0a1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:31.411824 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-25ee150b-d216-4b76-9499-defc3cfec0a1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:31.412579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-25ee150b-d216-4b76-9499-defc3cfec0a1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:31.413008 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-25ee150b-d216-4b76-9499-defc3cfec0a1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:31.544425 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-25ee150b-d216-4b76-9499-defc3cfec0a1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:34:31.552195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-25ee150b-d216-4b76-9499-defc3cfec0a1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1547 microversion: 2.1 time: 0.155967 Jul 28 20:34:31.552778 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1743/3343] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:31 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:34:31.573404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b35ff0ac-01c7-41eb-b497-c080efcf9113 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:31.573948 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b35ff0ac-01c7-41eb-b497-c080efcf9113 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:31.575730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=6 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:31.581279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b35ff0ac-01c7-41eb-b497-c080efcf9113 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:31.581797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b35ff0ac-01c7-41eb-b497-c080efcf9113 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:31.582549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b35ff0ac-01c7-41eb-b497-c080efcf9113 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:31.582981 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b35ff0ac-01c7-41eb-b497-c080efcf9113 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:31.659510 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b35ff0ac-01c7-41eb-b497-c080efcf9113 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090259 Jul 28 20:34:31.660089 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1601/3344] 10.222.0.67 () {58 vars in 1275 bytes} [Thu Jul 28 20:34:31 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:34:32.854205 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-b29069a4-2b2f-4df7-9230-85f78568e7cb req-c22117ac-a57e-46b8-94e5-7ac65592ff56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff9616e1-aa33-4392-8e87-a1932f07a45d", "tag": "09d5dc60-5e25-46d7-9ed9-4f7c36eef324"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:34:32.863977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-b29069a4-2b2f-4df7-9230-85f78568e7cb req-c22117ac-a57e-46b8-94e5-7ac65592ff56 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:32.864414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-b29069a4-2b2f-4df7-9230-85f78568e7cb req-c22117ac-a57e-46b8-94e5-7ac65592ff56 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:32.875859 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-b29069a4-2b2f-4df7-9230-85f78568e7cb req-c22117ac-a57e-46b8-94e5-7ac65592ff56 service nova] Creating event network-changed:09d5dc60-5e25-46d7-9ed9-4f7c36eef324 for instance ff9616e1-aa33-4392-8e87-a1932f07a45d on hv-cinder-85144 Jul 28 20:34:32.880904 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-b29069a4-2b2f-4df7-9230-85f78568e7cb req-c22117ac-a57e-46b8-94e5-7ac65592ff56 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091106 Jul 28 20:34:32.881683 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1744/3345] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:34:54.341591 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:54.342538 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=34 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:54.346503 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:54.347003 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:54.354643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:54.355128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:54.355890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:54.356334 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:54.371647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 HTTP/1.1 Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:34:54.373232 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.375132 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'c1cb56a8-6993-4767-9e30-5786f3b94743'} Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:34:54.376365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.378295 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.380040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:34:54.380040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6d3e07c2-ec44-4df8-9b81-c189ec1a6a95 tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 404 len: 111 microversion: 2.1 time: 0.034403 Jul 28 20:34:54.380040 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1602/3346] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:34:54 2022] DELETE /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:34:54.383531 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:34:54.384676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] [instance: c1cb56a8-6993-4767-9e30-5786f3b94743] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:34:54.386977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:54.387616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=32 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:34:54.393729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:54.394171 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:54.394913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:34:54.395336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:34:54.416601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] HTTP exception thrown: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Request method failure captured: Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 HTTP/1.1 Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4urM8IvoHpWoSbiRihW7TqlJOP0cXeSBhnER8rckR13AOb8jsqTZVkiOsRFP1yiwctk8HJKe4jc9WTn0SNe9VdvYJAkUeargmRqR_sGDZEuoXB4YCYtm8b8HldggJOTUrrP3u_uJvq5u-TZAdV5GAg4Ou2VJ1D-D7vfkN5t0WNj8nLo Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:34:54.418160 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d6612a467ab54632a74cf113b4666eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d6612a467ab54632a74cf113b4666eb1"}]}] Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: d6612a467ab54632a74cf113b4666eb1 Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1241155329 Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: bd0b2bfa3d014222afd4e050ca8498f9 Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeNegativeTest-1241155329-project Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.419928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'c1cb56a8-6993-4767-9e30-5786f3b94743'} Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:34:54.420981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. Jul 28 20:34:54.422901 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:34:54.424596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] Returning 404 to user: Instance c1cb56a8-6993-4767-9e30-5786f3b94743 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:34:54.424596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-299eeb33-afd8-49e8-bdef-110aa61cf97f tempest-AttachVolumeNegativeTest-1241155329 tempest-AttachVolumeNegativeTest-1241155329-project] 10.222.0.67 "GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743" status: 404 len: 111 microversion: 2.1 time: 0.040045 Jul 28 20:34:54.424596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1745/3347] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:34:54 2022] GET /compute/v2.1/servers/c1cb56a8-6993-4767-9e30-5786f3b94743 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:35:08.985867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-6c30f9ba-f8c5-4ade-8e4b-e788c6c9ee6f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:08.986455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-6c30f9ba-f8c5-4ade-8e4b-e788c6c9ee6f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:08.988469 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:35:08.989124 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:35:08.995476 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c30f9ba-f8c5-4ade-8e4b-e788c6c9ee6f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:08.995921 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c30f9ba-f8c5-4ade-8e4b-e788c6c9ee6f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:08.996711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c30f9ba-f8c5-4ade-8e4b-e788c6c9ee6f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:08.997145 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-6c30f9ba-f8c5-4ade-8e4b-e788c6c9ee6f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:09.020273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-6c30f9ba-f8c5-4ade-8e4b-e788c6c9ee6f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/ips" status: 200 len: 144 microversion: 2.1 time: 0.038274 Jul 28 20:35:09.021100 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1603/3348] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 20:35:08 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:35:12.043175 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a1e41439-c6d8-465d-9d2f-1e94cb492e37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae66a779-3c04-46c3-8c5b-140215ec80a2"}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:35:12.045514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a1e41439-c6d8-465d-9d2f-1e94cb492e37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:12.047453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:35:12.048085 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:35:12.054009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1e41439-c6d8-465d-9d2f-1e94cb492e37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:12.054451 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1e41439-c6d8-465d-9d2f-1e94cb492e37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:12.055212 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1e41439-c6d8-465d-9d2f-1e94cb492e37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:12.055653 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a1e41439-c6d8-465d-9d2f-1e94cb492e37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:12.074472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:35:12.075044 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:35:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:35:12.339133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a1e41439-c6d8-465d-9d2f-1e94cb492e37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300218 Jul 28 20:35:12.340147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1746/3349] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:35:12 2022] POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:35:19.883727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fdaa75b1-366e-4ca8-a1d9-4cc2a90f521f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:35:19.886506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:35:19.887194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:35:19.892581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fdaa75b1-366e-4ca8-a1d9-4cc2a90f521f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:19.893024 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fdaa75b1-366e-4ca8-a1d9-4cc2a90f521f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:19.952109 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fdaa75b1-366e-4ca8-a1d9-4cc2a90f521f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Going to try to stop instance {{(pid=117968) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 20:35:19.993122 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fdaa75b1-366e-4ca8-a1d9-4cc2a90f521f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/action" status: 202 len: 0 microversion: 2.1 time: 0.113025 Jul 28 20:35:19.993763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1604/3350] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:35:19 2022] POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:35:20.003323 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-15c909bb-d855-4c98-8685-e581dc5e4bae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:20.004048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-15c909bb-d855-4c98-8685-e581dc5e4bae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:20.010486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-15c909bb-d855-4c98-8685-e581dc5e4bae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:20.010969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-15c909bb-d855-4c98-8685-e581dc5e4bae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:20.011709 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-15c909bb-d855-4c98-8685-e581dc5e4bae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:20.012133 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-15c909bb-d855-4c98-8685-e581dc5e4bae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:20.144873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-15c909bb-d855-4c98-8685-e581dc5e4bae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:20.153770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-15c909bb-d855-4c98-8685-e581dc5e4bae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1721 microversion: 2.1 time: 0.155143 Jul 28 20:35:20.154322 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1747/3351] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:19 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:21.178195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c371cf79-1909-40b0-b227-958c8dae9d04 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:21.179421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c371cf79-1909-40b0-b227-958c8dae9d04 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:21.189261 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c371cf79-1909-40b0-b227-958c8dae9d04 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:21.189715 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c371cf79-1909-40b0-b227-958c8dae9d04 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:21.190520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c371cf79-1909-40b0-b227-958c8dae9d04 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:21.191220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c371cf79-1909-40b0-b227-958c8dae9d04 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:21.342912 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c371cf79-1909-40b0-b227-958c8dae9d04 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:21.350986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c371cf79-1909-40b0-b227-958c8dae9d04 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1721 microversion: 2.1 time: 0.179320 Jul 28 20:35:21.351551 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1605/3352] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:21 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:22.375014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-294bf6cc-c046-4586-9aab-25c897f696f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:22.375699 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-294bf6cc-c046-4586-9aab-25c897f696f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:22.382250 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-294bf6cc-c046-4586-9aab-25c897f696f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:22.382694 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-294bf6cc-c046-4586-9aab-25c897f696f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:22.383441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-294bf6cc-c046-4586-9aab-25c897f696f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:22.383925 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-294bf6cc-c046-4586-9aab-25c897f696f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:22.585659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-294bf6cc-c046-4586-9aab-25c897f696f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:22.593792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-294bf6cc-c046-4586-9aab-25c897f696f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1721 microversion: 2.1 time: 0.223464 Jul 28 20:35:22.594459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1748/3353] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:22 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:23.616356 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3f7c1156-e58f-486f-b232-226b51742433 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:23.617051 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3f7c1156-e58f-486f-b232-226b51742433 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:23.623595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3f7c1156-e58f-486f-b232-226b51742433 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:23.624047 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3f7c1156-e58f-486f-b232-226b51742433 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:23.624842 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3f7c1156-e58f-486f-b232-226b51742433 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:23.625279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3f7c1156-e58f-486f-b232-226b51742433 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:23.829166 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3f7c1156-e58f-486f-b232-226b51742433 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:23.837299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3f7c1156-e58f-486f-b232-226b51742433 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1721 microversion: 2.1 time: 0.225874 Jul 28 20:35:23.838647 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1606/3354] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:23 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:24.861448 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c31e8e9b-b005-45f6-b43e-3ae4307bf512 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:24.862157 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c31e8e9b-b005-45f6-b43e-3ae4307bf512 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:24.870076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c31e8e9b-b005-45f6-b43e-3ae4307bf512 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:24.870596 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c31e8e9b-b005-45f6-b43e-3ae4307bf512 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:24.871356 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c31e8e9b-b005-45f6-b43e-3ae4307bf512 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:24.871788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c31e8e9b-b005-45f6-b43e-3ae4307bf512 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:25.016001 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c31e8e9b-b005-45f6-b43e-3ae4307bf512 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:25.024132 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c31e8e9b-b005-45f6-b43e-3ae4307bf512 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1721 microversion: 2.1 time: 0.166784 Jul 28 20:35:25.024728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1749/3355] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:24 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:26.046279 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1cd46150-b962-41b6-936a-c298c958c417 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:26.046914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1cd46150-b962-41b6-936a-c298c958c417 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:26.053549 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1cd46150-b962-41b6-936a-c298c958c417 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:26.053995 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1cd46150-b962-41b6-936a-c298c958c417 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:26.054745 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1cd46150-b962-41b6-936a-c298c958c417 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:26.055174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1cd46150-b962-41b6-936a-c298c958c417 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:26.200521 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1cd46150-b962-41b6-936a-c298c958c417 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:26.208386 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1cd46150-b962-41b6-936a-c298c958c417 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1721 microversion: 2.1 time: 0.166584 Jul 28 20:35:26.208977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1607/3356] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:26 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:35:27.229876 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6f3e87fe-9b5b-4a42-b4bf-fd6f2b05c85b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:27.230526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6f3e87fe-9b5b-4a42-b4bf-fd6f2b05c85b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:27.236964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f3e87fe-9b5b-4a42-b4bf-fd6f2b05c85b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:27.237408 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f3e87fe-9b5b-4a42-b4bf-fd6f2b05c85b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:27.238148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f3e87fe-9b5b-4a42-b4bf-fd6f2b05c85b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:27.238572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6f3e87fe-9b5b-4a42-b4bf-fd6f2b05c85b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:27.370076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6f3e87fe-9b5b-4a42-b4bf-fd6f2b05c85b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:27.377948 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6f3e87fe-9b5b-4a42-b4bf-fd6f2b05c85b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1721 microversion: 2.1 time: 0.152348 Jul 28 20:35:27.378498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1750/3357] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:27 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:28.399568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1c42a940-9685-4657-9631-ceb98625ecdb tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:28.400738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1c42a940-9685-4657-9631-ceb98625ecdb tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:28.407164 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c42a940-9685-4657-9631-ceb98625ecdb tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:28.407618 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c42a940-9685-4657-9631-ceb98625ecdb tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:28.408371 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c42a940-9685-4657-9631-ceb98625ecdb tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:28.408839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1c42a940-9685-4657-9631-ceb98625ecdb tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:28.532980 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1c42a940-9685-4657-9631-ceb98625ecdb tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:28.541879 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1c42a940-9685-4657-9631-ceb98625ecdb tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1721 microversion: 2.1 time: 0.146358 Jul 28 20:35:28.542440 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1608/3358] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:28 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:29.563164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-19888b6b-452c-43bd-99fa-56418b79da7c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:29.563739 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-19888b6b-452c-43bd-99fa-56418b79da7c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:29.570167 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19888b6b-452c-43bd-99fa-56418b79da7c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:29.570619 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19888b6b-452c-43bd-99fa-56418b79da7c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:29.571374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19888b6b-452c-43bd-99fa-56418b79da7c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:29.571860 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-19888b6b-452c-43bd-99fa-56418b79da7c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:29.914644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-19888b6b-452c-43bd-99fa-56418b79da7c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:29.923550 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-19888b6b-452c-43bd-99fa-56418b79da7c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1721 microversion: 2.1 time: 0.364267 Jul 28 20:35:29.924127 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1751/3359] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:29 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1721 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:30.945184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9644ae68-0650-4faf-b2d6-1f8e63a9fba8 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:30.945794 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9644ae68-0650-4faf-b2d6-1f8e63a9fba8 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:30.952770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9644ae68-0650-4faf-b2d6-1f8e63a9fba8 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:30.953222 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9644ae68-0650-4faf-b2d6-1f8e63a9fba8 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:30.953975 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9644ae68-0650-4faf-b2d6-1f8e63a9fba8 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:30.954409 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9644ae68-0650-4faf-b2d6-1f8e63a9fba8 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:31.080909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9644ae68-0650-4faf-b2d6-1f8e63a9fba8 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:31.089027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9644ae68-0650-4faf-b2d6-1f8e63a9fba8 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1698 microversion: 2.1 time: 0.147687 Jul 28 20:35:31.089584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1609/3360] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:30 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1698 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:31.110869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0a116d2d-16c6-41f7-a158-5a33440defba tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:35:31.117367 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a116d2d-16c6-41f7-a158-5a33440defba tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:31.117810 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0a116d2d-16c6-41f7-a158-5a33440defba tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:31.177890 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0a116d2d-16c6-41f7-a158-5a33440defba tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Going to try to start instance {{(pid=117969) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 20:35:31.219336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0a116d2d-16c6-41f7-a158-5a33440defba tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/action" status: 202 len: 0 microversion: 2.1 time: 0.112146 Jul 28 20:35:31.220047 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1752/3361] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:35:31 2022] POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:35:31.229057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7840eed6-f5b6-41b5-86ed-f23bf97c5bd1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:31.229755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7840eed6-f5b6-41b5-86ed-f23bf97c5bd1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:31.236049 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7840eed6-f5b6-41b5-86ed-f23bf97c5bd1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:31.236581 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7840eed6-f5b6-41b5-86ed-f23bf97c5bd1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:31.237543 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7840eed6-f5b6-41b5-86ed-f23bf97c5bd1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:31.238017 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7840eed6-f5b6-41b5-86ed-f23bf97c5bd1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:31.381266 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7840eed6-f5b6-41b5-86ed-f23bf97c5bd1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:31.390338 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7840eed6-f5b6-41b5-86ed-f23bf97c5bd1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1707 microversion: 2.1 time: 0.165969 Jul 28 20:35:31.391157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1610/3362] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:31 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1707 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:32.413270 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c7b56099-f8e4-4617-9026-fae4683304be tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:32.414044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c7b56099-f8e4-4617-9026-fae4683304be tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:32.420353 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7b56099-f8e4-4617-9026-fae4683304be tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:32.420773 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7b56099-f8e4-4617-9026-fae4683304be tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:32.421514 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7b56099-f8e4-4617-9026-fae4683304be tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:32.421939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c7b56099-f8e4-4617-9026-fae4683304be tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:32.558362 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c7b56099-f8e4-4617-9026-fae4683304be tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:32.566231 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c7b56099-f8e4-4617-9026-fae4683304be tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1707 microversion: 2.1 time: 0.157695 Jul 28 20:35:32.566785 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1753/3363] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:32 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:33.588693 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-fb04d9e6-feb8-406a-97d7-7a59b2ffe8dd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:33.589302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-fb04d9e6-feb8-406a-97d7-7a59b2ffe8dd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:33.595735 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb04d9e6-feb8-406a-97d7-7a59b2ffe8dd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:33.596251 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb04d9e6-feb8-406a-97d7-7a59b2ffe8dd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:33.597034 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb04d9e6-feb8-406a-97d7-7a59b2ffe8dd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:33.597461 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-fb04d9e6-feb8-406a-97d7-7a59b2ffe8dd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:33.724902 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-fb04d9e6-feb8-406a-97d7-7a59b2ffe8dd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:33.733607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-fb04d9e6-feb8-406a-97d7-7a59b2ffe8dd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1707 microversion: 2.1 time: 0.149463 Jul 28 20:35:33.734159 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1611/3364] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:33 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1707 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:34.755213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7b5bb702-6cea-4d47-8285-0b866b616ba1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:34.755821 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7b5bb702-6cea-4d47-8285-0b866b616ba1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:34.762997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7b5bb702-6cea-4d47-8285-0b866b616ba1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:34.763447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7b5bb702-6cea-4d47-8285-0b866b616ba1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:34.764199 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7b5bb702-6cea-4d47-8285-0b866b616ba1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:34.764664 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7b5bb702-6cea-4d47-8285-0b866b616ba1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:34.898262 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-7b5bb702-6cea-4d47-8285-0b866b616ba1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:34.906839 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7b5bb702-6cea-4d47-8285-0b866b616ba1 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1707 microversion: 2.1 time: 0.155549 Jul 28 20:35:34.907406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1754/3365] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:34 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:35:35.926882 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-d8e72801-4fbc-4da2-b269-14523365fe13 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:35:35.927490 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-d8e72801-4fbc-4da2-b269-14523365fe13 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:35:35.935191 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d8e72801-4fbc-4da2-b269-14523365fe13 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:35.935640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d8e72801-4fbc-4da2-b269-14523365fe13 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:35.936394 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d8e72801-4fbc-4da2-b269-14523365fe13 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:35:35.936850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-d8e72801-4fbc-4da2-b269-14523365fe13 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:35:36.070738 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-d8e72801-4fbc-4da2-b269-14523365fe13 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:35:36.079736 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-d8e72801-4fbc-4da2-b269-14523365fe13 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1711 microversion: 2.1 time: 0.156574 Jul 28 20:35:36.080298 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1612/3366] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:35:35 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1711 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:15.739488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-893871b7-044c-4670-8f0b-58a4e4002a17 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:15.740095 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-893871b7-044c-4670-8f0b-58a4e4002a17 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:15.742124 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=18 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:36:15.742866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:36:15.748646 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-893871b7-044c-4670-8f0b-58a4e4002a17 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:15.749100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-893871b7-044c-4670-8f0b-58a4e4002a17 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:15.749863 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-893871b7-044c-4670-8f0b-58a4e4002a17 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:15.750302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-893871b7-044c-4670-8f0b-58a4e4002a17 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:15.831404 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-893871b7-044c-4670-8f0b-58a4e4002a17 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lazy-loading 'services' on Instance uuid ff9616e1-aa33-4392-8e87-a1932f07a45d {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:36:15.901640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-893871b7-044c-4670-8f0b-58a4e4002a17 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/os-volume_attachments/ae66a779-3c04-46c3-8c5b-140215ec80a2" status: 202 len: 0 microversion: 2.1 time: 0.166386 Jul 28 20:36:15.902300 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1755/3367] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:36:15 2022] DELETE /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/os-volume_attachments/ae66a779-3c04-46c3-8c5b-140215ec80a2 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:36:17.020946 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ce4e5112-4cef-4f68-a635-ee4298bff188 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:36:17.023115 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=18 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:36:17.023755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:36:17.029408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce4e5112-4cef-4f68-a635-ee4298bff188 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:17.029850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ce4e5112-4cef-4f68-a635-ee4298bff188 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:17.053683 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ce4e5112-4cef-4f68-a635-ee4298bff188 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Going to try to stop instance {{(pid=117968) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 20:36:17.093536 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ce4e5112-4cef-4f68-a635-ee4298bff188 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/action" status: 202 len: 0 microversion: 2.1 time: 0.076802 Jul 28 20:36:17.094118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1613/3368] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:36:17 2022] POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:36:17.104129 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c412d1b8-f2f1-43c2-a484-5d256638436f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:17.104907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c412d1b8-f2f1-43c2-a484-5d256638436f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:17.111292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c412d1b8-f2f1-43c2-a484-5d256638436f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:17.112472 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c412d1b8-f2f1-43c2-a484-5d256638436f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:17.113552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c412d1b8-f2f1-43c2-a484-5d256638436f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:17.113979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c412d1b8-f2f1-43c2-a484-5d256638436f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:17.253439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c412d1b8-f2f1-43c2-a484-5d256638436f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:17.261121 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c412d1b8-f2f1-43c2-a484-5d256638436f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1675 microversion: 2.1 time: 0.162013 Jul 28 20:36:17.261681 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1756/3369] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:17 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:18.284565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-11fff93d-4b6d-4732-b24c-12fc2a9f7b50 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:18.285354 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-11fff93d-4b6d-4732-b24c-12fc2a9f7b50 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:18.291467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11fff93d-4b6d-4732-b24c-12fc2a9f7b50 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:18.291914 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11fff93d-4b6d-4732-b24c-12fc2a9f7b50 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:18.292691 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11fff93d-4b6d-4732-b24c-12fc2a9f7b50 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:18.293116 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-11fff93d-4b6d-4732-b24c-12fc2a9f7b50 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:18.423339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-11fff93d-4b6d-4732-b24c-12fc2a9f7b50 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:18.431069 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-11fff93d-4b6d-4732-b24c-12fc2a9f7b50 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1675 microversion: 2.1 time: 0.151716 Jul 28 20:36:18.431627 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1614/3370] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:18 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:19.452652 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-4f4124b3-2aa1-4894-83d8-a610659055f0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:19.453219 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-4f4124b3-2aa1-4894-83d8-a610659055f0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:19.460131 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f4124b3-2aa1-4894-83d8-a610659055f0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:19.460599 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f4124b3-2aa1-4894-83d8-a610659055f0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:19.461340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f4124b3-2aa1-4894-83d8-a610659055f0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:19.461763 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-4f4124b3-2aa1-4894-83d8-a610659055f0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:19.591241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-4f4124b3-2aa1-4894-83d8-a610659055f0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:19.598820 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-4f4124b3-2aa1-4894-83d8-a610659055f0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1675 microversion: 2.1 time: 0.150104 Jul 28 20:36:19.599396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1757/3371] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:19 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:20.619922 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-178eedaf-e3e5-4e60-bef5-37082b82e2f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:20.620513 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-178eedaf-e3e5-4e60-bef5-37082b82e2f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:20.627129 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-178eedaf-e3e5-4e60-bef5-37082b82e2f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:20.627573 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-178eedaf-e3e5-4e60-bef5-37082b82e2f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:20.628404 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-178eedaf-e3e5-4e60-bef5-37082b82e2f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:20.628861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-178eedaf-e3e5-4e60-bef5-37082b82e2f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:20.759834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-178eedaf-e3e5-4e60-bef5-37082b82e2f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:20.767411 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-178eedaf-e3e5-4e60-bef5-37082b82e2f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1675 microversion: 2.1 time: 0.151298 Jul 28 20:36:20.767969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1615/3372] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:20 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:21.790110 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a0bad54a-6137-4fe7-ae06-b54a921babfc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:21.790879 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a0bad54a-6137-4fe7-ae06-b54a921babfc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:21.797811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0bad54a-6137-4fe7-ae06-b54a921babfc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:21.798271 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0bad54a-6137-4fe7-ae06-b54a921babfc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:21.799040 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0bad54a-6137-4fe7-ae06-b54a921babfc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:21.799497 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a0bad54a-6137-4fe7-ae06-b54a921babfc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:21.927933 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-a0bad54a-6137-4fe7-ae06-b54a921babfc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:21.935374 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a0bad54a-6137-4fe7-ae06-b54a921babfc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1675 microversion: 2.1 time: 0.149361 Jul 28 20:36:21.935924 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1758/3373] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:21 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:22.956788 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7232b404-1e17-4c28-8676-e9a49426ea72 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:22.957445 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7232b404-1e17-4c28-8676-e9a49426ea72 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:22.963970 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7232b404-1e17-4c28-8676-e9a49426ea72 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:22.964408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7232b404-1e17-4c28-8676-e9a49426ea72 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:22.965192 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7232b404-1e17-4c28-8676-e9a49426ea72 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:22.965617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7232b404-1e17-4c28-8676-e9a49426ea72 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:23.104845 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7232b404-1e17-4c28-8676-e9a49426ea72 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:23.112834 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7232b404-1e17-4c28-8676-e9a49426ea72 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1675 microversion: 2.1 time: 0.160049 Jul 28 20:36:23.113403 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1616/3374] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:22 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:24.134700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-ad828d30-cc80-432c-81b6-41fd74319dcd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:24.135302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-ad828d30-cc80-432c-81b6-41fd74319dcd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:24.141685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad828d30-cc80-432c-81b6-41fd74319dcd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:24.142123 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad828d30-cc80-432c-81b6-41fd74319dcd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:24.142867 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad828d30-cc80-432c-81b6-41fd74319dcd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:24.143423 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-ad828d30-cc80-432c-81b6-41fd74319dcd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:24.270913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-ad828d30-cc80-432c-81b6-41fd74319dcd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:24.278415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-ad828d30-cc80-432c-81b6-41fd74319dcd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1675 microversion: 2.1 time: 0.147580 Jul 28 20:36:24.278971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1759/3375] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:24 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:25.300668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1a1bc938-bbbe-4c53-8b7a-bdf96b03a25e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:25.301277 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1a1bc938-bbbe-4c53-8b7a-bdf96b03a25e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:25.307657 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a1bc938-bbbe-4c53-8b7a-bdf96b03a25e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:25.308095 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a1bc938-bbbe-4c53-8b7a-bdf96b03a25e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:25.308873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a1bc938-bbbe-4c53-8b7a-bdf96b03a25e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:25.309304 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1a1bc938-bbbe-4c53-8b7a-bdf96b03a25e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:25.438703 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1a1bc938-bbbe-4c53-8b7a-bdf96b03a25e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:25.446908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1a1bc938-bbbe-4c53-8b7a-bdf96b03a25e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1675 microversion: 2.1 time: 0.150291 Jul 28 20:36:25.447462 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1617/3376] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:25 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:26.467849 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-73bfab26-7600-4082-8148-0b24e984a0f2 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:26.468403 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-73bfab26-7600-4082-8148-0b24e984a0f2 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:26.475627 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73bfab26-7600-4082-8148-0b24e984a0f2 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:26.476076 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73bfab26-7600-4082-8148-0b24e984a0f2 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:26.476873 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73bfab26-7600-4082-8148-0b24e984a0f2 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:26.477302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-73bfab26-7600-4082-8148-0b24e984a0f2 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:26.614293 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-73bfab26-7600-4082-8148-0b24e984a0f2 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:26.621662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-73bfab26-7600-4082-8148-0b24e984a0f2 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1675 microversion: 2.1 time: 0.157735 Jul 28 20:36:26.622214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1760/3377] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:26 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:27.642856 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-07c890cd-ac23-4517-a71f-ab8f4446b768 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:27.643582 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-07c890cd-ac23-4517-a71f-ab8f4446b768 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:27.650327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07c890cd-ac23-4517-a71f-ab8f4446b768 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:27.650767 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07c890cd-ac23-4517-a71f-ab8f4446b768 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:27.651514 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07c890cd-ac23-4517-a71f-ab8f4446b768 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:27.651945 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-07c890cd-ac23-4517-a71f-ab8f4446b768 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:27.783271 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-07c890cd-ac23-4517-a71f-ab8f4446b768 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:27.790936 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-07c890cd-ac23-4517-a71f-ab8f4446b768 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1652 microversion: 2.1 time: 0.151857 Jul 28 20:36:27.791494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1618/3378] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:27 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1652 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:27.811483 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1a867d26-2b5e-4a5b-9218-2b48db3532fd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:36:27.818671 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a867d26-2b5e-4a5b-9218-2b48db3532fd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:27.819115 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-1a867d26-2b5e-4a5b-9218-2b48db3532fd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:27.841717 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-1a867d26-2b5e-4a5b-9218-2b48db3532fd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Going to try to start instance {{(pid=117969) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 20:36:27.891964 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1a867d26-2b5e-4a5b-9218-2b48db3532fd tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/action" status: 202 len: 0 microversion: 2.1 time: 0.084064 Jul 28 20:36:27.892579 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1761/3379] 10.222.0.67 () {60 vars in 1278 bytes} [Thu Jul 28 20:36:27 2022] POST /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:36:27.901187 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-728d15b7-d21d-4114-bbca-7f66f62ed64f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:27.901726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-728d15b7-d21d-4114-bbca-7f66f62ed64f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:27.907662 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-728d15b7-d21d-4114-bbca-7f66f62ed64f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:27.908120 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-728d15b7-d21d-4114-bbca-7f66f62ed64f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:27.909406 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-728d15b7-d21d-4114-bbca-7f66f62ed64f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:27.909986 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-728d15b7-d21d-4114-bbca-7f66f62ed64f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:28.046782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-728d15b7-d21d-4114-bbca-7f66f62ed64f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:28.055417 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-728d15b7-d21d-4114-bbca-7f66f62ed64f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1661 microversion: 2.1 time: 0.158127 Jul 28 20:36:28.055988 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1619/3380] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:27 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:29.076866 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c78a7948-52f8-4a0e-8383-54dae00cfa19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:29.077571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-c78a7948-52f8-4a0e-8383-54dae00cfa19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:29.085269 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c78a7948-52f8-4a0e-8383-54dae00cfa19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:29.085721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c78a7948-52f8-4a0e-8383-54dae00cfa19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:29.086479 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c78a7948-52f8-4a0e-8383-54dae00cfa19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:29.086909 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-c78a7948-52f8-4a0e-8383-54dae00cfa19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:29.214799 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-c78a7948-52f8-4a0e-8383-54dae00cfa19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:29.222155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c78a7948-52f8-4a0e-8383-54dae00cfa19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1661 microversion: 2.1 time: 0.149547 Jul 28 20:36:29.222706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1762/3381] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:29 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:30.243475 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-de5389b6-77f6-4d70-8787-0a8ea78f2f0c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:36:30.244078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-de5389b6-77f6-4d70-8787-0a8ea78f2f0c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:36:30.250504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de5389b6-77f6-4d70-8787-0a8ea78f2f0c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:30.250942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de5389b6-77f6-4d70-8787-0a8ea78f2f0c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:30.251686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de5389b6-77f6-4d70-8787-0a8ea78f2f0c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:36:30.252110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-de5389b6-77f6-4d70-8787-0a8ea78f2f0c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:36:30.378873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-de5389b6-77f6-4d70-8787-0a8ea78f2f0c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:36:30.386492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-de5389b6-77f6-4d70-8787-0a8ea78f2f0c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1665 microversion: 2.1 time: 0.146833 Jul 28 20:36:30.387078 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1620/3382] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:36:30 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1665 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:36:58.627732 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:36:58.628453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:36:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:37:03.507971 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-7abbbf56-9cf1-4155-9548-2b317c0babdf tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:03.510306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-7abbbf56-9cf1-4155-9548-2b317c0babdf tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:03.512400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=16 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:03.513078 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:03.519665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7abbbf56-9cf1-4155-9548-2b317c0babdf tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:03.520148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7abbbf56-9cf1-4155-9548-2b317c0babdf tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:03.520952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7abbbf56-9cf1-4155-9548-2b317c0babdf tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:03.521390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-7abbbf56-9cf1-4155-9548-2b317c0babdf tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:03.552034 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-7abbbf56-9cf1-4155-9548-2b317c0babdf tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048229 Jul 28 20:37:03.552594 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1763/3383] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:37:03 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 20:37:03.613301 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5757f77f-354d-4e12-8e38-15906cfa0483 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:03.613839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5757f77f-354d-4e12-8e38-15906cfa0483 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:03.616098 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=16 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:03.616925 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:03.622426 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5757f77f-354d-4e12-8e38-15906cfa0483 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:03.622873 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5757f77f-354d-4e12-8e38-15906cfa0483 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:03.623626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5757f77f-354d-4e12-8e38-15906cfa0483 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:03.624059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5757f77f-354d-4e12-8e38-15906cfa0483 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:03.649640 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5757f77f-354d-4e12-8e38-15906cfa0483 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:37:03.723654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5757f77f-354d-4e12-8e38-15906cfa0483 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 204 len: 0 microversion: 2.1 time: 0.113829 Jul 28 20:37:03.724331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1621/3384] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:37:03 2022] DELETE /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 20:37:03.733249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-dab0b318-c1ea-493b-9497-f3862a72f772 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:03.733862 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-dab0b318-c1ea-493b-9497-f3862a72f772 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:03.740504 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dab0b318-c1ea-493b-9497-f3862a72f772 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:03.740976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dab0b318-c1ea-493b-9497-f3862a72f772 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:03.741724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dab0b318-c1ea-493b-9497-f3862a72f772 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:03.742148 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-dab0b318-c1ea-493b-9497-f3862a72f772 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:03.872378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-dab0b318-c1ea-493b-9497-f3862a72f772 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:03.880225 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-dab0b318-c1ea-493b-9497-f3862a72f772 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1671 microversion: 2.1 time: 0.151822 Jul 28 20:37:03.880782 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1764/3385] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:03 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:37:04.902783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bfece195-1e04-413b-9a5b-e3b75538e78c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:04.903478 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bfece195-1e04-413b-9a5b-e3b75538e78c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:04.910231 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bfece195-1e04-413b-9a5b-e3b75538e78c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:04.910671 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bfece195-1e04-413b-9a5b-e3b75538e78c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:04.911414 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bfece195-1e04-413b-9a5b-e3b75538e78c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:04.911927 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bfece195-1e04-413b-9a5b-e3b75538e78c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:05.047795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-bfece195-1e04-413b-9a5b-e3b75538e78c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:05.056139 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bfece195-1e04-413b-9a5b-e3b75538e78c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1671 microversion: 2.1 time: 0.157601 Jul 28 20:37:05.056717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1622/3386] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:04 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:06.078023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0732f379-ada5-4734-a71c-8f46170b5995 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:06.078629 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0732f379-ada5-4734-a71c-8f46170b5995 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:06.085234 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0732f379-ada5-4734-a71c-8f46170b5995 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:06.085676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0732f379-ada5-4734-a71c-8f46170b5995 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:06.086432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0732f379-ada5-4734-a71c-8f46170b5995 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:06.086854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0732f379-ada5-4734-a71c-8f46170b5995 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:06.223727 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0732f379-ada5-4734-a71c-8f46170b5995 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:06.231290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0732f379-ada5-4734-a71c-8f46170b5995 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1671 microversion: 2.1 time: 0.157135 Jul 28 20:37:06.231864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1765/3387] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:06 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:06.873783 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-1f81386a-8e52-4707-b7af-e533bab29c23 req-53727930-a001-4310-9033-7aa89dc4db8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff9616e1-aa33-4392-8e87-a1932f07a45d", "name": "network-vif-deleted", "tag": "09d5dc60-5e25-46d7-9ed9-4f7c36eef324"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:37:06.888058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-1f81386a-8e52-4707-b7af-e533bab29c23 req-53727930-a001-4310-9033-7aa89dc4db8c service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:06.888520 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-1f81386a-8e52-4707-b7af-e533bab29c23 req-53727930-a001-4310-9033-7aa89dc4db8c service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:06.902276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-1f81386a-8e52-4707-b7af-e533bab29c23 req-53727930-a001-4310-9033-7aa89dc4db8c service nova] Creating event network-vif-deleted:09d5dc60-5e25-46d7-9ed9-4f7c36eef324 for instance ff9616e1-aa33-4392-8e87-a1932f07a45d on hv-cinder-85144 Jul 28 20:37:06.908438 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-1f81386a-8e52-4707-b7af-e533bab29c23 req-53727930-a001-4310-9033-7aa89dc4db8c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038248 Jul 28 20:37:06.909781 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1623/3388] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:37:07.253831 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:07.254443 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:07.261090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:07.261535 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:07.262326 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:07.262753 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:07.294993 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:07.295427 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:07.295871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lazy-loading 'fault' on Instance uuid ff9616e1-aa33-4392-8e87-a1932f07a45d {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:37:07.338165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:07.345921 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-88a4fbd4-ebe1-404c-b128-8ba87d39b330 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 200 len: 1327 microversion: 2.1 time: 0.097109 Jul 28 20:37:07.346597 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1766/3389] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:07 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:37:08.368128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:08.368857 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:08.375059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:08.375507 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:08.376245 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:08.376717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:08.390111 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] HTTP exception thrown: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Request method failure captured: Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d HTTP/1.1 Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4vLKAQWpXCLaQo1X2FP17Phg2h4uwpme7rNOdWJge3vGFl6Tj1SnodKpPCVJ40TbY9vOSbJYloeaPYKQK-b2ApNTPZ0bMs9L2ljtWRhc2j-q09esq8wC9aN3_7pixRI2Y8OwsukWjaMrp093JH8EfEaou-0qwpl6FnDwCDEEfXJJ3jg Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:37:08.391747 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6073a7dfe9864dee8831b72f165cf464"}]}] Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: b7fa18536db240e5b03c79408577cd6c Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:37:08.394447 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'ff9616e1-aa33-4392-8e87-a1932f07a45d'} Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:37:08.395678 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:37:08.397484 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:37:08.399220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Returning 404 to user: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:37:08.399220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eedd6aac-c98c-407c-abe2-7a1091792e36 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 404 len: 111 microversion: 2.1 time: 0.030512 Jul 28 20:37:08.399220 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1624/3390] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:08 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:37:08.403007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e4658b26-24b9-4925-aaf4-421ae4c6ad19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '.version_select at 0x7f5036114ca0>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:08.422282 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e4658b26-24b9-4925-aaf4-421ae4c6ad19 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-161757863" status: 202 len: 0 microversion: 2.1 time: 0.022868 Jul 28 20:37:08.422760 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1767/3391] 10.222.0.67 () {58 vars in 1218 bytes} [Thu Jul 28 20:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-161757863 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 20:37:09.047239 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-10c6bf89-fadd-4496-b819-f5f8540fba02 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'create', calling method: .version_select at 0x7f503b05e280>, body: {"keypair": {"name": "tempest-keypair-911272610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNS6Ot/NE3q50hbXQ9cgN7n0DJQ0jeyIZOiqA4TcBdIMSt7N63LLeFlttPWK49QQJ7VSWtIz1n+4wnoLUreG9rESV+Lyej41T62zKLp7MxagJBojaZVrKxa7V3Tktzucg=="}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:37:09.062613 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-10c6bf89-fadd-4496-b819-f5f8540fba02 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Getting quotas for project 6073a7dfe9864dee8831b72f165cf464. Resources: {'key_pairs'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:37:09.066977 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.quota [None req-10c6bf89-fadd-4496-b819-f5f8540fba02 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Getting quotas for user b7fa18536db240e5b03c79408577cd6c and project 6073a7dfe9864dee8831b72f165cf464. Resources: {'key_pairs'} {{(pid=117968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:37:09.088081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-10c6bf89-fadd-4496-b819-f5f8540fba02 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044713 Jul 28 20:37:09.088679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1625/3392] 10.222.0.67 () {60 vars in 1159 bytes} [Thu Jul 28 20:37:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:37:10.365106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-823174848", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc578bd6-9a8e-4cec-afe5-b0cf67324047"}], "security_groups": [{"name": "tempest-securitygroup--1379319775"}], "key_name": "tempest-keypair-911272610", "user_data": "}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:37:10.467273 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] validate_networks() for [('dc578bd6-9a8e-4cec-afe5-b0cf67324047', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:37:10.833869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:37:10.834290 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:37:10.834758 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:37:10.835161 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:37:10.835864 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:37:10.845587 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:10.846090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:10.846884 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:10.847319 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:10.866286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Getting quotas for project 6073a7dfe9864dee8831b72f165cf464. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:37:10.870252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Getting quotas for user b7fa18536db240e5b03c79408577cd6c and project 6073a7dfe9864dee8831b72f165cf464. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:37:10.883088 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:37:10.885737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:37:10.932026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-16b25b35-6d57-4958-a537-e0e6de066424 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.572154 Jul 28 20:37:10.932976 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1768/3393] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:37:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:37:10.944590 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7046b69d-d050-4bad-9a1a-505d007b9503 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:10.945203 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7046b69d-d050-4bad-9a1a-505d007b9503 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:11.001243 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7046b69d-d050-4bad-9a1a-505d007b9503 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:11.009740 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7046b69d-d050-4bad-9a1a-505d007b9503 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1236 microversion: 2.1 time: 0.069769 Jul 28 20:37:11.010761 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1626/3394] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:10 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:12.037731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0c451cd4-85d7-47e5-a37c-db794169b230 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:12.038316 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0c451cd4-85d7-47e5-a37c-db794169b230 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:12.044438 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c451cd4-85d7-47e5-a37c-db794169b230 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:12.044907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c451cd4-85d7-47e5-a37c-db794169b230 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:12.045852 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c451cd4-85d7-47e5-a37c-db794169b230 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:12.046801 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0c451cd4-85d7-47e5-a37c-db794169b230 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:12.110218 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0c451cd4-85d7-47e5-a37c-db794169b230 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:12.119996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0c451cd4-85d7-47e5-a37c-db794169b230 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1296 microversion: 2.1 time: 0.086686 Jul 28 20:37:12.120592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1769/3395] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:12 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:13.141817 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eb1fc3c7-b5ca-4f08-9d96-255e7e76f112 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:13.142557 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eb1fc3c7-b5ca-4f08-9d96-255e7e76f112 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:13.149385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb1fc3c7-b5ca-4f08-9d96-255e7e76f112 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:13.149839 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb1fc3c7-b5ca-4f08-9d96-255e7e76f112 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:13.150606 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb1fc3c7-b5ca-4f08-9d96-255e7e76f112 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:13.151048 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eb1fc3c7-b5ca-4f08-9d96-255e7e76f112 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:13.294730 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-eb1fc3c7-b5ca-4f08-9d96-255e7e76f112 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:13.303110 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eb1fc3c7-b5ca-4f08-9d96-255e7e76f112 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1362 microversion: 2.1 time: 0.165182 Jul 28 20:37:13.303668 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1627/3396] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:13 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:13.672096 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-5158d29e-6eef-4501-b678-76b9a51865e4 req-45337ff5-972b-4809-8943-77ceb8272d1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5fc284-1c97-4262-83b6-299fa70c6c1a", "tag": "b3b50e84-9095-422c-9832-42bd1f14d63f"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:37:13.684524 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-5158d29e-6eef-4501-b678-76b9a51865e4 req-45337ff5-972b-4809-8943-77ceb8272d1a service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:13.685023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-5158d29e-6eef-4501-b678-76b9a51865e4 req-45337ff5-972b-4809-8943-77ceb8272d1a service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:13.698460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-5158d29e-6eef-4501-b678-76b9a51865e4 req-45337ff5-972b-4809-8943-77ceb8272d1a service nova] Creating event network-changed:b3b50e84-9095-422c-9832-42bd1f14d63f for instance fd5fc284-1c97-4262-83b6-299fa70c6c1a on hv-cinder-85144 Jul 28 20:37:13.703459 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-5158d29e-6eef-4501-b678-76b9a51865e4 req-45337ff5-972b-4809-8943-77ceb8272d1a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034949 Jul 28 20:37:13.710917 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1770/3397] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:37:14.324452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-69e0bad3-bcb9-4e5d-a66f-f54636d4615b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:14.325082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-69e0bad3-bcb9-4e5d-a66f-f54636d4615b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:14.331770 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69e0bad3-bcb9-4e5d-a66f-f54636d4615b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:14.332210 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69e0bad3-bcb9-4e5d-a66f-f54636d4615b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:14.332997 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69e0bad3-bcb9-4e5d-a66f-f54636d4615b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:14.333421 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-69e0bad3-bcb9-4e5d-a66f-f54636d4615b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:14.462729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-69e0bad3-bcb9-4e5d-a66f-f54636d4615b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:14.470081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-69e0bad3-bcb9-4e5d-a66f-f54636d4615b tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1362 microversion: 2.1 time: 0.149530 Jul 28 20:37:14.470636 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1628/3398] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:14 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:15.492259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-98e1ade1-2784-45d0-80f2-e18f4a026d93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:15.492999 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-98e1ade1-2784-45d0-80f2-e18f4a026d93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:15.499150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98e1ade1-2784-45d0-80f2-e18f4a026d93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:15.499601 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98e1ade1-2784-45d0-80f2-e18f4a026d93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:15.500361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98e1ade1-2784-45d0-80f2-e18f4a026d93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:15.500826 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-98e1ade1-2784-45d0-80f2-e18f4a026d93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:15.644869 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-98e1ade1-2784-45d0-80f2-e18f4a026d93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:15.652252 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-98e1ade1-2784-45d0-80f2-e18f4a026d93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1362 microversion: 2.1 time: 0.164696 Jul 28 20:37:15.652847 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1771/3399] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:15 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:16.673005 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7e2b1c4b-e616-4e39-a96f-1e52f5184cd4 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:16.673645 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7e2b1c4b-e616-4e39-a96f-1e52f5184cd4 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:16.680651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e2b1c4b-e616-4e39-a96f-1e52f5184cd4 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:16.681101 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e2b1c4b-e616-4e39-a96f-1e52f5184cd4 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:16.681872 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e2b1c4b-e616-4e39-a96f-1e52f5184cd4 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:16.682311 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7e2b1c4b-e616-4e39-a96f-1e52f5184cd4 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:16.810396 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7e2b1c4b-e616-4e39-a96f-1e52f5184cd4 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:16.818339 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7e2b1c4b-e616-4e39-a96f-1e52f5184cd4 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1362 microversion: 2.1 time: 0.149138 Jul 28 20:37:16.818851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1629/3400] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:16 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:17.839014 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-5e567a83-89a3-4d9d-9adc-141cb8e4a8f3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:17.839615 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-5e567a83-89a3-4d9d-9adc-141cb8e4a8f3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:17.846310 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e567a83-89a3-4d9d-9adc-141cb8e4a8f3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:17.846714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e567a83-89a3-4d9d-9adc-141cb8e4a8f3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:17.847453 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e567a83-89a3-4d9d-9adc-141cb8e4a8f3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:17.847877 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-5e567a83-89a3-4d9d-9adc-141cb8e4a8f3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:17.979729 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-5e567a83-89a3-4d9d-9adc-141cb8e4a8f3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:17.987644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-5e567a83-89a3-4d9d-9adc-141cb8e4a8f3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1362 microversion: 2.1 time: 0.152513 Jul 28 20:37:17.988202 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1772/3401] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:17 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:18.206432 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-a00f6fa8-243b-4a59-aa73-5ff4cabce206 req-78234162-7d42-4c63-b1dc-270756eff0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5fc284-1c97-4262-83b6-299fa70c6c1a", "name": "network-vif-plugged", "status": "completed", "tag": "b3b50e84-9095-422c-9832-42bd1f14d63f"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:37:18.217014 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-a00f6fa8-243b-4a59-aa73-5ff4cabce206 req-78234162-7d42-4c63-b1dc-270756eff0ac service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:18.217460 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-a00f6fa8-243b-4a59-aa73-5ff4cabce206 req-78234162-7d42-4c63-b1dc-270756eff0ac service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:18.229455 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-a00f6fa8-243b-4a59-aa73-5ff4cabce206 req-78234162-7d42-4c63-b1dc-270756eff0ac service nova] Creating event network-vif-plugged:b3b50e84-9095-422c-9832-42bd1f14d63f for instance fd5fc284-1c97-4262-83b6-299fa70c6c1a on hv-cinder-85144 Jul 28 20:37:18.234397 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-a00f6fa8-243b-4a59-aa73-5ff4cabce206 req-78234162-7d42-4c63-b1dc-270756eff0ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031818 Jul 28 20:37:18.234979 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1630/3402] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:37:19.009055 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-24c43c94-911f-422b-a354-5f65376c35ae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:19.009680 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-24c43c94-911f-422b-a354-5f65376c35ae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:19.016371 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-24c43c94-911f-422b-a354-5f65376c35ae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:19.016857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-24c43c94-911f-422b-a354-5f65376c35ae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:19.017757 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-24c43c94-911f-422b-a354-5f65376c35ae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:19.018339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-24c43c94-911f-422b-a354-5f65376c35ae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:19.145325 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-24c43c94-911f-422b-a354-5f65376c35ae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:19.152640 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-24c43c94-911f-422b-a354-5f65376c35ae tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1362 microversion: 2.1 time: 0.147468 Jul 28 20:37:19.153195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1773/3403] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:19 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:20.174661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-3eb510ae-b228-4e79-bf03-f27476ff59f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:20.175331 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-3eb510ae-b228-4e79-bf03-f27476ff59f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:20.181777 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3eb510ae-b228-4e79-bf03-f27476ff59f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:20.182223 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3eb510ae-b228-4e79-bf03-f27476ff59f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:20.182965 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3eb510ae-b228-4e79-bf03-f27476ff59f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:20.183394 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-3eb510ae-b228-4e79-bf03-f27476ff59f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:20.311548 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-3eb510ae-b228-4e79-bf03-f27476ff59f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:37:20.319710 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-3eb510ae-b228-4e79-bf03-f27476ff59f7 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1548 microversion: 2.1 time: 0.150259 Jul 28 20:37:20.320267 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1631/3404] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:37:20 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:37:20.339907 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-85fda39e-db37-40e0-a08d-c86892ce5fbc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:20.340417 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-85fda39e-db37-40e0-a08d-c86892ce5fbc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:20.346827 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85fda39e-db37-40e0-a08d-c86892ce5fbc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:20.347542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85fda39e-db37-40e0-a08d-c86892ce5fbc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:20.348108 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85fda39e-db37-40e0-a08d-c86892ce5fbc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:20.348563 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-85fda39e-db37-40e0-a08d-c86892ce5fbc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:20.428480 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-85fda39e-db37-40e0-a08d-c86892ce5fbc tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092299 Jul 28 20:37:20.429100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1774/3405] 10.222.0.67 () {58 vars in 1275 bytes} [Thu Jul 28 20:37:20 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:37:21.570851 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-05d1a8d5-cf43-456a-afd0-36bb5b2b7852 req-e1b6225d-8c40-4344-9598-51fb69a6e2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5fc284-1c97-4262-83b6-299fa70c6c1a", "tag": "b3b50e84-9095-422c-9832-42bd1f14d63f"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:37:21.575850 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=6 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:21.583909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-05d1a8d5-cf43-456a-afd0-36bb5b2b7852 req-e1b6225d-8c40-4344-9598-51fb69a6e2d9 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:21.584351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-05d1a8d5-cf43-456a-afd0-36bb5b2b7852 req-e1b6225d-8c40-4344-9598-51fb69a6e2d9 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:21.596224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-05d1a8d5-cf43-456a-afd0-36bb5b2b7852 req-e1b6225d-8c40-4344-9598-51fb69a6e2d9 service nova] Creating event network-changed:b3b50e84-9095-422c-9832-42bd1f14d63f for instance fd5fc284-1c97-4262-83b6-299fa70c6c1a on hv-cinder-85144 Jul 28 20:37:21.601824 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-05d1a8d5-cf43-456a-afd0-36bb5b2b7852 req-e1b6225d-8c40-4344-9598-51fb69a6e2d9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034521 Jul 28 20:37:21.602852 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1632/3406] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:37:57.578928 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:57.579805 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=6 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:57.581105 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:57.581685 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=58 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:57.585937 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-a033f4ff-741a-4b13-b50c-14a72e104078 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:37:57.586434 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-a033f4ff-741a-4b13-b50c-14a72e104078 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:57.594955 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a033f4ff-741a-4b13-b50c-14a72e104078 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:57.595400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a033f4ff-741a-4b13-b50c-14a72e104078 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:57.596150 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a033f4ff-741a-4b13-b50c-14a72e104078 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:57.596693 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-a033f4ff-741a-4b13-b50c-14a72e104078 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:57.621947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-a033f4ff-741a-4b13-b50c-14a72e104078 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/ips" status: 200 len: 146 microversion: 2.1 time: 0.043752 Jul 28 20:37:57.622526 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1775/3407] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 20:37:57 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:37:58.967969 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-bdf3d782-74ac-4dc0-9e66-8cfc6077c35f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f31f907c-24eb-4ba4-b498-094be81d47c1"}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:37:58.970463 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-bdf3d782-74ac-4dc0-9e66-8cfc6077c35f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:37:58.972890 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:58.974184 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:37:58.980637 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bdf3d782-74ac-4dc0-9e66-8cfc6077c35f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:58.981083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bdf3d782-74ac-4dc0-9e66-8cfc6077c35f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:58.981835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bdf3d782-74ac-4dc0-9e66-8cfc6077c35f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:37:58.982264 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-bdf3d782-74ac-4dc0-9e66-8cfc6077c35f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:37:59.360943 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-bdf3d782-74ac-4dc0-9e66-8cfc6077c35f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397313 Jul 28 20:37:59.361612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1633/3408] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:37:58 2022] POST /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:38:06.882465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-93db2760-1514-46eb-8a92-5b690d9601d3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:06.884803 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-93db2760-1514-46eb-8a92-5b690d9601d3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:06.890818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93db2760-1514-46eb-8a92-5b690d9601d3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:06.891268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93db2760-1514-46eb-8a92-5b690d9601d3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:06.892027 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93db2760-1514-46eb-8a92-5b690d9601d3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:06.892465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-93db2760-1514-46eb-8a92-5b690d9601d3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:06.922705 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-93db2760-1514-46eb-8a92-5b690d9601d3 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Jul 28 20:38:06.923241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1776/3409] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:38:06 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:38:06.935286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-4fa3c7bc-8a12-4743-844e-6b725160ceac tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:06.935854 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-4fa3c7bc-8a12-4743-844e-6b725160ceac tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:06.942027 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fa3c7bc-8a12-4743-844e-6b725160ceac tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:06.942472 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fa3c7bc-8a12-4743-844e-6b725160ceac tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:06.943958 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fa3c7bc-8a12-4743-844e-6b725160ceac tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:06.944390 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-4fa3c7bc-8a12-4743-844e-6b725160ceac tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:06.972128 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-4fa3c7bc-8a12-4743-844e-6b725160ceac tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/f31f907c-24eb-4ba4-b498-094be81d47c1" status: 200 len: 194 microversion: 2.1 time: 0.041498 Jul 28 20:38:06.972712 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1634/3410] 10.222.0.67 () {58 vars in 1413 bytes} [Thu Jul 28 20:38:06 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/f31f907c-24eb-4ba4-b498-094be81d47c1 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:38:08.308769 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-2f576d93-2caa-4430-b11d-08f59693f55c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e8c1c8d-31a7-40f5-8366-2e6e663849c0"}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:38:08.311058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-2f576d93-2caa-4430-b11d-08f59693f55c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:08.317467 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f576d93-2caa-4430-b11d-08f59693f55c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:08.317913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f576d93-2caa-4430-b11d-08f59693f55c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:08.318647 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f576d93-2caa-4430-b11d-08f59693f55c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:08.319072 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-2f576d93-2caa-4430-b11d-08f59693f55c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:08.578366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-2f576d93-2caa-4430-b11d-08f59693f55c tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "POST /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273946 Jul 28 20:38:08.579026 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1777/3411] 10.222.0.67 () {60 vars in 1323 bytes} [Thu Jul 28 20:38:08 2022] POST /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:38:16.106865 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b1bbf3ef-6665-4f08-ac4b-9f11c4d1f111 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:16.109107 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b1bbf3ef-6665-4f08-ac4b-9f11c4d1f111 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:16.117866 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1bbf3ef-6665-4f08-ac4b-9f11c4d1f111 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:16.118313 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1bbf3ef-6665-4f08-ac4b-9f11c4d1f111 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:16.119074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1bbf3ef-6665-4f08-ac4b-9f11c4d1f111 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:16.119509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b1bbf3ef-6665-4f08-ac4b-9f11c4d1f111 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:16.150286 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b1bbf3ef-6665-4f08-ac4b-9f11c4d1f111 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047355 Jul 28 20:38:16.150826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1635/3412] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:38:16 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:38:16.316636 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-13249bfc-ef98-471d-a4cb-fafad3276e57 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:16.317143 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-13249bfc-ef98-471d-a4cb-fafad3276e57 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:16.323455 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13249bfc-ef98-471d-a4cb-fafad3276e57 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:16.323893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13249bfc-ef98-471d-a4cb-fafad3276e57 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:16.324670 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13249bfc-ef98-471d-a4cb-fafad3276e57 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:16.325097 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-13249bfc-ef98-471d-a4cb-fafad3276e57 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:16.352737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-13249bfc-ef98-471d-a4cb-fafad3276e57 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/f31f907c-24eb-4ba4-b498-094be81d47c1" status: 200 len: 194 microversion: 2.1 time: 0.040918 Jul 28 20:38:16.353307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1778/3413] 10.222.0.67 () {58 vars in 1413 bytes} [Thu Jul 28 20:38:16 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/f31f907c-24eb-4ba4-b498-094be81d47c1 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:38:16.363167 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-814eced6-872e-42c8-91fc-ceb9de1ca0b0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:16.363658 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-814eced6-872e-42c8-91fc-ceb9de1ca0b0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:16.370731 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-814eced6-872e-42c8-91fc-ceb9de1ca0b0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:16.371180 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-814eced6-872e-42c8-91fc-ceb9de1ca0b0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:16.371930 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-814eced6-872e-42c8-91fc-ceb9de1ca0b0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:16.372365 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-814eced6-872e-42c8-91fc-ceb9de1ca0b0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:16.453504 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-814eced6-872e-42c8-91fc-ceb9de1ca0b0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lazy-loading 'services' on Instance uuid fd5fc284-1c97-4262-83b6-299fa70c6c1a {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:38:16.524697 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-814eced6-872e-42c8-91fc-ceb9de1ca0b0 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/f31f907c-24eb-4ba4-b498-094be81d47c1" status: 202 len: 0 microversion: 2.1 time: 0.165139 Jul 28 20:38:16.525265 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1636/3414] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:38:16 2022] DELETE /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/f31f907c-24eb-4ba4-b498-094be81d47c1 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:38:18.699366 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3c330789-dac0-4779-94b8-eb88443d9b37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:18.699851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3c330789-dac0-4779-94b8-eb88443d9b37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:18.706396 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c330789-dac0-4779-94b8-eb88443d9b37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:18.706838 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c330789-dac0-4779-94b8-eb88443d9b37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:18.707582 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c330789-dac0-4779-94b8-eb88443d9b37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:18.708010 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3c330789-dac0-4779-94b8-eb88443d9b37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:18.735611 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3c330789-dac0-4779-94b8-eb88443d9b37 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/3e8c1c8d-31a7-40f5-8366-2e6e663849c0" status: 200 len: 194 microversion: 2.1 time: 0.040172 Jul 28 20:38:18.736164 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1779/3415] 10.222.0.67 () {58 vars in 1413 bytes} [Thu Jul 28 20:38:18 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/3e8c1c8d-31a7-40f5-8366-2e6e663849c0 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:38:18.748205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-95633828-4f93-4596-a5a6-b3bde20c4af6 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:18.748813 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-95633828-4f93-4596-a5a6-b3bde20c4af6 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:18.754952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95633828-4f93-4596-a5a6-b3bde20c4af6 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:18.755400 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95633828-4f93-4596-a5a6-b3bde20c4af6 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:18.756151 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95633828-4f93-4596-a5a6-b3bde20c4af6 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:18.756667 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-95633828-4f93-4596-a5a6-b3bde20c4af6 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:18.836465 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-95633828-4f93-4596-a5a6-b3bde20c4af6 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lazy-loading 'services' on Instance uuid fd5fc284-1c97-4262-83b6-299fa70c6c1a {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:38:18.906685 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-95633828-4f93-4596-a5a6-b3bde20c4af6 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/3e8c1c8d-31a7-40f5-8366-2e6e663849c0" status: 202 len: 0 microversion: 2.1 time: 0.163070 Jul 28 20:38:18.907195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1637/3416] 10.222.0.67 () {58 vars in 1416 bytes} [Thu Jul 28 20:38:18 2022] DELETE /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments/3e8c1c8d-31a7-40f5-8366-2e6e663849c0 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:38:20.079156 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-e30e94bb-3738-4a5f-9722-a3ca8f08e839 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:20.081464 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-e30e94bb-3738-4a5f-9722-a3ca8f08e839 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:20.088836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e30e94bb-3738-4a5f-9722-a3ca8f08e839 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:20.089284 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e30e94bb-3738-4a5f-9722-a3ca8f08e839 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:20.090036 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e30e94bb-3738-4a5f-9722-a3ca8f08e839 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:20.090465 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-e30e94bb-3738-4a5f-9722-a3ca8f08e839 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:20.119178 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-e30e94bb-3738-4a5f-9722-a3ca8f08e839 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043879 Jul 28 20:38:20.119724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1780/3417] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:38:20 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 20:38:20.232055 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eeb2af59-d1bb-41cb-a274-eef96b4d0950 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:20.234377 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eeb2af59-d1bb-41cb-a274-eef96b4d0950 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:20.240593 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eeb2af59-d1bb-41cb-a274-eef96b4d0950 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:20.241119 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eeb2af59-d1bb-41cb-a274-eef96b4d0950 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:20.242054 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eeb2af59-d1bb-41cb-a274-eef96b4d0950 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:20.242491 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eeb2af59-d1bb-41cb-a274-eef96b4d0950 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:20.270959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eeb2af59-d1bb-41cb-a274-eef96b4d0950 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043582 Jul 28 20:38:20.271500 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1638/3418] 10.222.0.67 () {58 vars in 1302 bytes} [Thu Jul 28 20:38:20 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 20:38:20.331996 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-156b3c7b-545d-464e-a3c8-cc858ae02d91 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:20.332515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-156b3c7b-545d-464e-a3c8-cc858ae02d91 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:20.338430 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-156b3c7b-545d-464e-a3c8-cc858ae02d91 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:20.338874 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-156b3c7b-545d-464e-a3c8-cc858ae02d91 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:20.339616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-156b3c7b-545d-464e-a3c8-cc858ae02d91 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:20.340042 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-156b3c7b-545d-464e-a3c8-cc858ae02d91 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:20.364100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-156b3c7b-545d-464e-a3c8-cc858ae02d91 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Going to try to terminate instance {{(pid=117969) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:38:20.438706 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-156b3c7b-545d-464e-a3c8-cc858ae02d91 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 204 len: 0 microversion: 2.1 time: 0.110215 Jul 28 20:38:20.439213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1781/3419] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:38:20 2022] DELETE /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:38:20.448436 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-c53195e3-57bc-46ef-bf12-331cec557c42 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:20.449273 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-c53195e3-57bc-46ef-bf12-331cec557c42 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:20.455206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c53195e3-57bc-46ef-bf12-331cec557c42 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:20.455656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c53195e3-57bc-46ef-bf12-331cec557c42 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:20.456405 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c53195e3-57bc-46ef-bf12-331cec557c42 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:20.456877 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-c53195e3-57bc-46ef-bf12-331cec557c42 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:20.587332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-c53195e3-57bc-46ef-bf12-331cec557c42 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:38:20.594797 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-c53195e3-57bc-46ef-bf12-331cec557c42 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1673 microversion: 2.1 time: 0.151175 Jul 28 20:38:20.595349 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1639/3420] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:38:20 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:38:21.615770 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-8f8c8f73-e3a8-479f-912c-cf0d6e6bd74e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:21.616572 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-8f8c8f73-e3a8-479f-912c-cf0d6e6bd74e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:21.622939 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f8c8f73-e3a8-479f-912c-cf0d6e6bd74e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:21.623383 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f8c8f73-e3a8-479f-912c-cf0d6e6bd74e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:21.624126 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f8c8f73-e3a8-479f-912c-cf0d6e6bd74e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:21.624569 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-8f8c8f73-e3a8-479f-912c-cf0d6e6bd74e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:21.750373 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-8f8c8f73-e3a8-479f-912c-cf0d6e6bd74e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:38:21.758224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-8f8c8f73-e3a8-479f-912c-cf0d6e6bd74e tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1673 microversion: 2.1 time: 0.146713 Jul 28 20:38:21.758774 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1782/3421] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:38:21 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:38:22.779686 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ffcac33f-d0e7-4a9b-bd7e-adf9c9b1340f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:22.780302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ffcac33f-d0e7-4a9b-bd7e-adf9c9b1340f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:22.786792 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffcac33f-d0e7-4a9b-bd7e-adf9c9b1340f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:22.787248 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffcac33f-d0e7-4a9b-bd7e-adf9c9b1340f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:22.788612 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffcac33f-d0e7-4a9b-bd7e-adf9c9b1340f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:22.789056 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ffcac33f-d0e7-4a9b-bd7e-adf9c9b1340f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:22.919996 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ffcac33f-d0e7-4a9b-bd7e-adf9c9b1340f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:38:22.927917 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ffcac33f-d0e7-4a9b-bd7e-adf9c9b1340f tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1673 microversion: 2.1 time: 0.152104 Jul 28 20:38:22.928762 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1640/3422] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:38:22 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:38:23.666249 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-f19eb56d-666b-4cf4-80b1-9e618d851ff2 req-73386519-60c8-416a-ac3a-a2e1b304eaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5fc284-1c97-4262-83b6-299fa70c6c1a", "name": "network-vif-deleted", "tag": "b3b50e84-9095-422c-9832-42bd1f14d63f"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:38:23.677392 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-f19eb56d-666b-4cf4-80b1-9e618d851ff2 req-73386519-60c8-416a-ac3a-a2e1b304eaa3 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:23.678058 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-f19eb56d-666b-4cf4-80b1-9e618d851ff2 req-73386519-60c8-416a-ac3a-a2e1b304eaa3 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:23.690762 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-f19eb56d-666b-4cf4-80b1-9e618d851ff2 req-73386519-60c8-416a-ac3a-a2e1b304eaa3 service nova] Creating event network-vif-deleted:b3b50e84-9095-422c-9832-42bd1f14d63f for instance fd5fc284-1c97-4262-83b6-299fa70c6c1a on hv-cinder-85144 Jul 28 20:38:23.696498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-f19eb56d-666b-4cf4-80b1-9e618d851ff2 req-73386519-60c8-416a-ac3a-a2e1b304eaa3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238803 Jul 28 20:38:23.697307 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1783/3423] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:38:23.949533 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:23.950059 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:23.956725 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:23.957173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:23.957926 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:23.958351 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:23.991739 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:23.992202 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:23.992679 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lazy-loading 'fault' on Instance uuid fd5fc284-1c97-4262-83b6-299fa70c6c1a {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:38:24.041408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fa18536db240e5b03c79408577cd6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6073a7dfe9864dee8831b72f165cf464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:38:24.049874 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-67c55fa4-1444-4ec6-9580-1244608ed270 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 200 len: 1326 microversion: 2.1 time: 0.104154 Jul 28 20:38:24.050652 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1641/3424] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:38:23 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:38:25.072844 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:25.073580 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:25.079776 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:25.080224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:25.081006 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:25.081444 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:25.095041 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] HTTP exception thrown: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Request method failure captured: Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a HTTP/1.1 Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4vLKAQWpXCLaQo1X2FP17Phg2h4uwpme7rNOdWJge3vGFl6Tj1SnodKpPCVJ40TbY9vOSbJYloeaPYKQK-b2ApNTPZ0bMs9L2ljtWRhc2j-q09esq8wC9aN3_7pixRI2Y8OwsukWjaMrp093JH8EfEaou-0qwpl6FnDwCDEEfXJJ3jg Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:38:25.096665 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6073a7dfe9864dee8831b72f165cf464"}]}] Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: b7fa18536db240e5b03c79408577cd6c Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:25.097881 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'fd5fc284-1c97-4262-83b6-299fa70c6c1a'} Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:25.098584 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:25.099871 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:25.101689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Returning 404 to user: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:25.101689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f77cdfa7-7f1f-4aa8-b144-63f28c1b8051 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 404 len: 111 microversion: 2.1 time: 0.030304 Jul 28 20:38:25.101689 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1784/3425] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:38:25 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:38:25.107340 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-01e5c151-e362-462f-ade0-a272323cecba tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '.version_select at 0x7f503b091af0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:25.126204 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-01e5c151-e362-462f-ade0-a272323cecba tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-911272610" status: 202 len: 0 microversion: 2.1 time: 0.022637 Jul 28 20:38:25.126780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1642/3426] 10.222.0.67 () {58 vars in 1218 bytes} [Thu Jul 28 20:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-911272610 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 20:38:27.998997 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:27.999491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:28.001889 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:38:28.007195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:28.007637 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:28.008398 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:28.008857 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:28.012098 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:38:28.027049 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] HTTP exception thrown: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Request method failure captured: Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a HTTP/1.1 Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4vLKAQWpXCLaQo1X2FP17Phg2h4uwpme7rNOdWJge3vGFl6Tj1SnodKpPCVJ40TbY9vOSbJYloeaPYKQK-b2ApNTPZ0bMs9L2ljtWRhc2j-q09esq8wC9aN3_7pixRI2Y8OwsukWjaMrp093JH8EfEaou-0qwpl6FnDwCDEEfXJJ3jg Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:38:28.028659 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6073a7dfe9864dee8831b72f165cf464"}]}] Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: b7fa18536db240e5b03c79408577cd6c Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.029710 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'fd5fc284-1c97-4262-83b6-299fa70c6c1a'} Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:28.030260 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.031215 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.032100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Returning 404 to user: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:28.032100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-44b36854-e709-4d51-8a23-3d788dd1ac1d tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "DELETE /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 404 len: 111 microversion: 2.1 time: 0.034847 Jul 28 20:38:28.032100 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1785/3427] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:38:27 2022] DELETE /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:38:28.039195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:28.039795 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: fd5fc284-1c97-4262-83b6-299fa70c6c1a] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:28.047177 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:28.047631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:28.048388 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:28.048867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:28.063374 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] HTTP exception thrown: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Request method failure captured: Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a HTTP/1.1 Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4vLKAQWpXCLaQo1X2FP17Phg2h4uwpme7rNOdWJge3vGFl6Tj1SnodKpPCVJ40TbY9vOSbJYloeaPYKQK-b2ApNTPZ0bMs9L2ljtWRhc2j-q09esq8wC9aN3_7pixRI2Y8OwsukWjaMrp093JH8EfEaou-0qwpl6FnDwCDEEfXJJ3jg Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:38:28.065102 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6073a7dfe9864dee8831b72f165cf464"}]}] Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: b7fa18536db240e5b03c79408577cd6c Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.066276 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'fd5fc284-1c97-4262-83b6-299fa70c6c1a'} Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:28.066830 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. Jul 28 20:38:28.067771 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:28.068607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Returning 404 to user: Instance fd5fc284-1c97-4262-83b6-299fa70c6c1a could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:28.068607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-8d559d76-9a50-41fb-8529-7e95656daf93 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a" status: 404 len: 111 microversion: 2.1 time: 0.031806 Jul 28 20:38:28.068607 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1643/3428] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:38:28 2022] GET /compute/v2.1/servers/fd5fc284-1c97-4262-83b6-299fa70c6c1a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:38:29.204851 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:29.205345 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:29.212491 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:29.212952 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:29.213695 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:29.214120 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:29.227686 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] HTTP exception thrown: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Request method failure captured: Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d HTTP/1.1 Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4vLKAQWpXCLaQo1X2FP17Phg2h4uwpme7rNOdWJge3vGFl6Tj1SnodKpPCVJ40TbY9vOSbJYloeaPYKQK-b2ApNTPZ0bMs9L2ljtWRhc2j-q09esq8wC9aN3_7pixRI2Y8OwsukWjaMrp093JH8EfEaou-0qwpl6FnDwCDEEfXJJ3jg Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:38:29.229286 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6073a7dfe9864dee8831b72f165cf464"}]}] Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: b7fa18536db240e5b03c79408577cd6c Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.230259 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'ff9616e1-aa33-4392-8e87-a1932f07a45d'} Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:29.230814 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.231747 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.232931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Returning 404 to user: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:29.232931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-576e16a3-814b-4caf-87bc-7be8d619f118 tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 404 len: 111 microversion: 2.1 time: 0.029580 Jul 28 20:38:29.232931 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1786/3429] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:38:29 2022] DELETE /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:38:29.238931 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:29.239540 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] [instance: ff9616e1-aa33-4392-8e87-a1932f07a45d] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:38:29.243194 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:38:29.249523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:29.249973 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:29.250727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:38:29.251156 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:38:29.255615 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:38:29.266289 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] HTTP exception thrown: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Request method failure captured: Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d HTTP/1.1 Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4vLKAQWpXCLaQo1X2FP17Phg2h4uwpme7rNOdWJge3vGFl6Tj1SnodKpPCVJ40TbY9vOSbJYloeaPYKQK-b2ApNTPZ0bMs9L2ljtWRhc2j-q09esq8wC9aN3_7pixRI2Y8OwsukWjaMrp093JH8EfEaou-0qwpl6FnDwCDEEfXJJ3jg Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:38:29.268157 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6073a7dfe9864dee8831b72f165cf464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6073a7dfe9864dee8831b72f165cf464"}]}] Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 6073a7dfe9864dee8831b72f165cf464 Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-AttachVolumeTestJSON-946124004 Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: b7fa18536db240e5b03c79408577cd6c Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-AttachVolumeTestJSON-946124004-project Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.269584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'ff9616e1-aa33-4392-8e87-a1932f07a45d'} Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:29.270696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. Jul 28 20:38:29.272038 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:29.273173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] Returning 404 to user: Instance ff9616e1-aa33-4392-8e87-a1932f07a45d could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:29.273173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-eda90977-2a0d-43f9-a15f-2a72c7e922ea tempest-AttachVolumeTestJSON-946124004 tempest-AttachVolumeTestJSON-946124004-project] 10.222.0.67 "GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d" status: 404 len: 111 microversion: 2.1 time: 0.034532 Jul 28 20:38:29.273173 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1644/3430] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:38:29 2022] GET /compute/v2.1/servers/ff9616e1-aa33-4392-8e87-a1932f07a45d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:38:32.082993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:38:32.083576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:38:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:38:33.567283 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c5b784f-caa1-42b5-bc9b-20831e375fd4 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Action: 'create', calling method: .version_select at 0x7f503b07ea60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-385216529", "metadata": {"Type": "work"}}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c5b784f-caa1-42b5-bc9b-20831e375fd4 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Request method failure captured: Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 121 Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4vPJ8y9P-GmVyfYsyL92kWNel2CW0sL6lx0C0zyWTfJjsfjPrtCyF10LU6jh4DlXJWn7JdQnTO5vYbiPYDqvUfaT_eyLgbfHxmQEl_NI9QcNgtYPVJTo2MmtSNuNvMochTxtfwLXXS2bZQK86VL8CZ5WUn4c_YaPWz6CF3mz0YR-sWw Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:38:33.592297 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5e0e7ffc50bf481abb5e9b9971873992"}]}] Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 0cb71b5924294f2b84a1a264223214df Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-385216529", "metadata": {"Type": "work"}}} Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: Jul 28 20:38:33.593848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-385216529', 'metadata': {'Type': 'work'}}}} Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise error Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:33.594523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 20:38:33.596488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 20:38:33.600241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 20:38:33.600241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.600241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-1c5b784f-caa1-42b5-bc9b-20831e375fd4 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:33.600241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-1c5b784f-caa1-42b5-bc9b-20831e375fd4 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141293 Jul 28 20:38:33.600241 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1787/3431] 10.222.0.67 () {60 vars in 1156 bytes} [Thu Jul 28 20:38:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:38:33.605908 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-708fe303-811c-415c-8873-0fa00edde8c9 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Action: 'create', calling method: .version_select at 0x7f503afffca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1730715945", "metadata": {"Type": "work"}}} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-708fe303-811c-415c-8873-0fa00edde8c9 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Request method failure captured: Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 120 Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4vPJ8y9P-GmVyfYsyL92kWNel2CW0sL6lx0C0zyWTfJjsfjPrtCyF10LU6jh4DlXJWn7JdQnTO5vYbiPYDqvUfaT_eyLgbfHxmQEl_NI9QcNgtYPVJTo2MmtSNuNvMochTxtfwLXXS2bZQK86VL8CZ5WUn4c_YaPWz6CF3mz0YR-sWw Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:38:33.610494 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5e0e7ffc50bf481abb5e9b9971873992"}]}] Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 0cb71b5924294f2b84a1a264223214df Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1730715945", "metadata": {"Type": "work"}}} Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: Jul 28 20:38:33.611844 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1730715945', 'metadata': {'Type': 'work'}}}} Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise error Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi '0' Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:33.612656 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 20:38:33.613885 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 20:38:33.614944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 20:38:33.614944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.614944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-708fe303-811c-415c-8873-0fa00edde8c9 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:33.614944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-708fe303-811c-415c-8873-0fa00edde8c9 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009806 Jul 28 20:38:33.614944 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1645/3432] 10.222.0.67 () {60 vars in 1156 bytes} [Thu Jul 28 20:38:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:38:33.621432 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c4c398e7-6a3a-4d35-9668-75bdc0409001 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Action: 'create', calling method: .version_select at 0x7f503b002b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1739749054", "metadata": {"Type": "work"}}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c4c398e7-6a3a-4d35-9668-75bdc0409001 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Request method failure captured: Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 119 Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4vPJ8y9P-GmVyfYsyL92kWNel2CW0sL6lx0C0zyWTfJjsfjPrtCyF10LU6jh4DlXJWn7JdQnTO5vYbiPYDqvUfaT_eyLgbfHxmQEl_NI9QcNgtYPVJTo2MmtSNuNvMochTxtfwLXXS2bZQK86VL8CZ5WUn4c_YaPWz6CF3mz0YR-sWw Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:38:33.624935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5e0e7ffc50bf481abb5e9b9971873992"}]}] Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 0cb71b5924294f2b84a1a264223214df Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1739749054", "metadata": {"Type": "work"}}} Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: Jul 28 20:38:33.626168 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1739749054', 'metadata': {'Type': 'work'}}}} Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise error Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi '' Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:33.626982 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 20:38:33.628320 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 20:38:33.629328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 20:38:33.629328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.629328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-c4c398e7-6a3a-4d35-9668-75bdc0409001 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:33.629328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-c4c398e7-6a3a-4d35-9668-75bdc0409001 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008563 Jul 28 20:38:33.629328 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1788/3433] 10.222.0.67 () {60 vars in 1156 bytes} [Thu Jul 28 20:38:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 20:38:33.636153 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ff53065-7d1e-455d-b8d5-ad1817c3b9e7 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Calling method '.version_select at 0x7f503afa3790>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:33.665796 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-0ff53065-7d1e-455d-b8d5-ad1817c3b9e7 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] HTTP exception thrown: Volume tempest-invalid-1658315046 could not be found. Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ff53065-7d1e-455d-b8d5-ad1817c3b9e7 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Request method failure captured: Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1658315046 HTTP/1.1 Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4vPJ8y9P-GmVyfYsyL92kWNel2CW0sL6lx0C0zyWTfJjsfjPrtCyF10LU6jh4DlXJWn7JdQnTO5vYbiPYDqvUfaT_eyLgbfHxmQEl_NI9QcNgtYPVJTo2MmtSNuNvMochTxtfwLXXS2bZQK86VL8CZ5WUn4c_YaPWz6CF3mz0YR-sWw Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:38:33.668068 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5e0e7ffc50bf481abb5e9b9971873992"}]}] Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 0cb71b5924294f2b84a1a264223214df Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Volume tempest-invalid-1658315046 could not be found. Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'tempest-invalid-1658315046'} Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:33.669422 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1658315046 could not be found. (HTTP 404) (Request-ID: req-401d2a12-3993-48dc-a6ae-69c6e9520788) Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.670215 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 20:38:33.671126 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1658315046 could not be found. Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:38:33.671953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1658315046 could not be found. Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1658315046 could not be found. Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-0ff53065-7d1e-455d-b8d5-ad1817c3b9e7 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Returning 404 to user: Volume tempest-invalid-1658315046 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-0ff53065-7d1e-455d-b8d5-ad1817c3b9e7 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1658315046" status: 404 len: 99 microversion: 2.1 time: 0.038169 Jul 28 20:38:33.672901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1646/3434] 10.222.0.67 () {58 vars in 1218 bytes} [Thu Jul 28 20:38:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1658315046 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 20:38:33.681818 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-10a28a50-a3c4-4d7f-95bf-628bc9512b5e tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003776 Jul 28 20:38:33.682317 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1789/3435] 10.222.0.67 () {58 vars in 1140 bytes} [Thu Jul 28 20:38:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 20:38:33.690393 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7572c511-7bfa-4941-9951-654960d42efd tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003648 Jul 28 20:38:33.690876 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1647/3436] 10.222.0.67 () {58 vars in 1137 bytes} [Thu Jul 28 20:38:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 20:38:33.699092 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-106ffac2-6c1e-4fc2-aa68-1961c34fcb35 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Calling method '.version_select at 0x7f503aed9b80>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:33.726714 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-106ffac2-6c1e-4fc2-aa68-1961c34fcb35 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] HTTP exception thrown: Volume c0a25068-7736-45f2-8cfd-9e57a512be73 could not be found. Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-106ffac2-6c1e-4fc2-aa68-1961c34fcb35 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Request method failure captured: Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: DELETE /compute/v2.1/os-volumes/c0a25068-7736-45f2-8cfd-9e57a512be73 HTTP/1.1 Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4vPJ8y9P-GmVyfYsyL92kWNel2CW0sL6lx0C0zyWTfJjsfjPrtCyF10LU6jh4DlXJWn7JdQnTO5vYbiPYDqvUfaT_eyLgbfHxmQEl_NI9QcNgtYPVJTo2MmtSNuNvMochTxtfwLXXS2bZQK86VL8CZ5WUn4c_YaPWz6CF3mz0YR-sWw Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:38:33.728715 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5e0e7ffc50bf481abb5e9b9971873992"}]}] Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 0cb71b5924294f2b84a1a264223214df Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Volume c0a25068-7736-45f2-8cfd-9e57a512be73 could not be found. Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'c0a25068-7736-45f2-8cfd-9e57a512be73'} Jul 28 20:38:33.729915 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c0a25068-7736-45f2-8cfd-9e57a512be73 could not be found. (HTTP 404) (Request-ID: req-4ef89f2d-2ef2-4950-8bcb-b92d001d5021) Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.730676 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 20:38:33.731660 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c0a25068-7736-45f2-8cfd-9e57a512be73 could not be found. Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 20:38:33.732523 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c0a25068-7736-45f2-8cfd-9e57a512be73 could not be found. Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c0a25068-7736-45f2-8cfd-9e57a512be73 could not be found. Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-106ffac2-6c1e-4fc2-aa68-1961c34fcb35 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Returning 404 to user: Volume c0a25068-7736-45f2-8cfd-9e57a512be73 could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-106ffac2-6c1e-4fc2-aa68-1961c34fcb35 tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/c0a25068-7736-45f2-8cfd-9e57a512be73" status: 404 len: 109 microversion: 2.1 time: 0.034474 Jul 28 20:38:33.735009 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1790/3437] 10.222.0.67 () {58 vars in 1248 bytes} [Thu Jul 28 20:38:33 2022] DELETE /compute/v2.1/os-volumes/c0a25068-7736-45f2-8cfd-9e57a512be73 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:38:33.739290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5cf24d07-6746-4152-863d-88ad4170d25f tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Calling method '.version_select at 0x7f503afffdc0>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:38:33.766378 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-5cf24d07-6746-4152-863d-88ad4170d25f tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] HTTP exception thrown: Volume ff4fc10f-64bf-4815-b457-eb2dfd112d8f could not be found. Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5cf24d07-6746-4152-863d-88ad4170d25f tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Request method failure captured: Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/os-volumes/ff4fc10f-64bf-4815-b457-eb2dfd112d8f HTTP/1.1 Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4vPJ8y9P-GmVyfYsyL92kWNel2CW0sL6lx0C0zyWTfJjsfjPrtCyF10LU6jh4DlXJWn7JdQnTO5vYbiPYDqvUfaT_eyLgbfHxmQEl_NI9QcNgtYPVJTo2MmtSNuNvMochTxtfwLXXS2bZQK86VL8CZ5WUn4c_YaPWz6CF3mz0YR-sWw Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:38:33.768639 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/5e0e7ffc50bf481abb5e9b9971873992"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_5e0e7ffc50bf481abb5e9b9971873992"}]}] Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 5e0e7ffc50bf481abb5e9b9971873992 Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-VolumesNegativeTest-43728798 Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 0cb71b5924294f2b84a1a264223214df Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-VolumesNegativeTest-43728798-project Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Volume ff4fc10f-64bf-4815-b457-eb2dfd112d8f could not be found. Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'ff4fc10f-64bf-4815-b457-eb2dfd112d8f'} Jul 28 20:38:33.769880 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff4fc10f-64bf-4815-b457-eb2dfd112d8f could not be found. (HTTP 404) (Request-ID: req-7dc1aea5-565f-45e0-a66a-fa6a5452fe2d) Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.770726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 20:38:33.771600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff4fc10f-64bf-4815-b457-eb2dfd112d8f could not be found. Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 20:38:33.772588 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff4fc10f-64bf-4815-b457-eb2dfd112d8f could not be found. Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff4fc10f-64bf-4815-b457-eb2dfd112d8f could not be found. Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5cf24d07-6746-4152-863d-88ad4170d25f tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] Returning 404 to user: Volume ff4fc10f-64bf-4815-b457-eb2dfd112d8f could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5cf24d07-6746-4152-863d-88ad4170d25f tempest-VolumesNegativeTest-43728798 tempest-VolumesNegativeTest-43728798-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/ff4fc10f-64bf-4815-b457-eb2dfd112d8f" status: 404 len: 109 microversion: 2.1 time: 0.034439 Jul 28 20:38:33.773558 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1648/3438] 10.222.0.67 () {58 vars in 1245 bytes} [Thu Jul 28 20:38:33 2022] GET /compute/v2.1/os-volumes/ff4fc10f-64bf-4815-b457-eb2dfd112d8f => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:39:01.427894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:01.428731 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=3 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:01.433811 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1063997323", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "networks": [{"uuid": "90e5dc59-9323-4fb9-bf92-f58b4bb3a1c1"}]}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:39:01.488112 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] validate_networks() for [('90e5dc59-9323-4fb9-bf92-f58b4bb3a1c1', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:39:01.843415 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:39:01.843912 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:39:01.844460 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:39:01.844977 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:39:01.845458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:39:01.855622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:01.856154 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:01.856978 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:01.857439 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:01.874436 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Getting quotas for project 92f934b29b224cce936b6548b5d624a5. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:39:01.878299 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Getting quotas for user 1e308dccd1ec4cc1a43dfe1b051595b1 and project 92f934b29b224cce936b6548b5d624a5. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:39:01.890486 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:39:01.893012 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:39:01.942295 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-f17422fc-bf30-49e2-90fd-fc82a9aa464c tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515592 Jul 28 20:39:01.942923 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1791/3439] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:39:01.952148 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:01.952952 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=1 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:01.956727 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-84f1e605-19f8-4d50-82a4-55c29410640b tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:01.957332 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-84f1e605-19f8-4d50-82a4-55c29410640b tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:02.010870 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-84f1e605-19f8-4d50-82a4-55c29410640b tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:02.017780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-84f1e605-19f8-4d50-82a4-55c29410640b tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1214 microversion: 2.1 time: 0.067679 Jul 28 20:39:02.018327 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1649/3440] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:01 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:03.038837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3b72e5d9-8d7d-4977-b568-5e14f9307060 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:03.039658 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3b72e5d9-8d7d-4977-b568-5e14f9307060 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:03.046082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b72e5d9-8d7d-4977-b568-5e14f9307060 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:03.046631 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b72e5d9-8d7d-4977-b568-5e14f9307060 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:03.047515 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b72e5d9-8d7d-4977-b568-5e14f9307060 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:03.048038 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3b72e5d9-8d7d-4977-b568-5e14f9307060 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:03.112914 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3b72e5d9-8d7d-4977-b568-5e14f9307060 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:03.125896 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3b72e5d9-8d7d-4977-b568-5e14f9307060 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1274 microversion: 2.1 time: 0.091088 Jul 28 20:39:03.126812 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1792/3441] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:03 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:04.148984 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ee3e24c9-63f6-4bc3-a649-ab046cc21956 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:04.150228 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ee3e24c9-63f6-4bc3-a649-ab046cc21956 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:04.160597 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee3e24c9-63f6-4bc3-a649-ab046cc21956 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:04.161370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee3e24c9-63f6-4bc3-a649-ab046cc21956 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:04.162160 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee3e24c9-63f6-4bc3-a649-ab046cc21956 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:04.162755 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ee3e24c9-63f6-4bc3-a649-ab046cc21956 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:04.300861 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ee3e24c9-63f6-4bc3-a649-ab046cc21956 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:04.309007 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ee3e24c9-63f6-4bc3-a649-ab046cc21956 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1314 microversion: 2.1 time: 0.165014 Jul 28 20:39:04.309574 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1650/3442] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:04 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:39:04.351624 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-428dd97c-0281-4c05-a555-91de53aa7085 req-ed700948-49cc-4c39-b107-ef260d08f56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7c636d1-a9b6-46a3-879b-0466ca9b06b0", "tag": "99459c8a-a5ca-43cd-9cee-42c24032a043"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:39:04.361608 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-428dd97c-0281-4c05-a555-91de53aa7085 req-ed700948-49cc-4c39-b107-ef260d08f56e service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:04.362294 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-428dd97c-0281-4c05-a555-91de53aa7085 req-ed700948-49cc-4c39-b107-ef260d08f56e service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:04.374754 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-428dd97c-0281-4c05-a555-91de53aa7085 req-ed700948-49cc-4c39-b107-ef260d08f56e service nova] Creating event network-changed:99459c8a-a5ca-43cd-9cee-42c24032a043 for instance c7c636d1-a9b6-46a3-879b-0466ca9b06b0 on hv-cinder-85144 Jul 28 20:39:04.379400 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-428dd97c-0281-4c05-a555-91de53aa7085 req-ed700948-49cc-4c39-b107-ef260d08f56e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Jul 28 20:39:04.379992 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1793/3443] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:39:05.330596 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-ebb274f9-3e3f-4698-a2ad-d5134da04d7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:05.331205 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-ebb274f9-3e3f-4698-a2ad-d5134da04d7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:05.338367 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ebb274f9-3e3f-4698-a2ad-d5134da04d7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:05.338814 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ebb274f9-3e3f-4698-a2ad-d5134da04d7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:05.339572 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ebb274f9-3e3f-4698-a2ad-d5134da04d7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:05.340006 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-ebb274f9-3e3f-4698-a2ad-d5134da04d7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:05.604079 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-ebb274f9-3e3f-4698-a2ad-d5134da04d7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:05.611840 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-ebb274f9-3e3f-4698-a2ad-d5134da04d7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1314 microversion: 2.1 time: 0.285030 Jul 28 20:39:05.612399 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1651/3444] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:05 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:06.633292 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-23726550-e3a3-4eb5-a82f-2d877859500e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:06.634147 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-23726550-e3a3-4eb5-a82f-2d877859500e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:06.640314 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23726550-e3a3-4eb5-a82f-2d877859500e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:06.640791 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23726550-e3a3-4eb5-a82f-2d877859500e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:06.641537 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23726550-e3a3-4eb5-a82f-2d877859500e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:06.641962 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-23726550-e3a3-4eb5-a82f-2d877859500e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:06.850644 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-23726550-e3a3-4eb5-a82f-2d877859500e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:06.858177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-23726550-e3a3-4eb5-a82f-2d877859500e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1314 microversion: 2.1 time: 0.230177 Jul 28 20:39:06.858733 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1794/3445] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:06 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 20:39:07.879224 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b5f28830-23c7-452b-af83-f8422479881e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:07.879835 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b5f28830-23c7-452b-af83-f8422479881e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:07.887146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5f28830-23c7-452b-af83-f8422479881e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:07.887600 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5f28830-23c7-452b-af83-f8422479881e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:07.888352 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5f28830-23c7-452b-af83-f8422479881e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:07.888826 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b5f28830-23c7-452b-af83-f8422479881e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:08.020584 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b5f28830-23c7-452b-af83-f8422479881e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:08.028070 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b5f28830-23c7-452b-af83-f8422479881e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1314 microversion: 2.1 time: 0.152700 Jul 28 20:39:08.028651 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1652/3446] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:07 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:08.706493 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-6bf79775-a18b-4af4-8ec7-2f88211dc053 req-0d350813-7eeb-4cf6-a691-e419cf6a4dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c636d1-a9b6-46a3-879b-0466ca9b06b0", "name": "network-vif-plugged", "status": "completed", "tag": "99459c8a-a5ca-43cd-9cee-42c24032a043"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:39:08.718979 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-6bf79775-a18b-4af4-8ec7-2f88211dc053 req-0d350813-7eeb-4cf6-a691-e419cf6a4dc7 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:08.719428 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-6bf79775-a18b-4af4-8ec7-2f88211dc053 req-0d350813-7eeb-4cf6-a691-e419cf6a4dc7 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:08.731469 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-6bf79775-a18b-4af4-8ec7-2f88211dc053 req-0d350813-7eeb-4cf6-a691-e419cf6a4dc7 service nova] Creating event network-vif-plugged:99459c8a-a5ca-43cd-9cee-42c24032a043 for instance c7c636d1-a9b6-46a3-879b-0466ca9b06b0 on hv-cinder-85144 Jul 28 20:39:08.736336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-6bf79775-a18b-4af4-8ec7-2f88211dc053 req-0d350813-7eeb-4cf6-a691-e419cf6a4dc7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033634 Jul 28 20:39:08.736961 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1795/3447] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:39:09.049669 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-1bde19f8-b698-4c63-8f85-c3bdd46799dc tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:09.050280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-1bde19f8-b698-4c63-8f85-c3bdd46799dc tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:09.056993 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1bde19f8-b698-4c63-8f85-c3bdd46799dc tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:09.057441 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1bde19f8-b698-4c63-8f85-c3bdd46799dc tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:09.058195 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1bde19f8-b698-4c63-8f85-c3bdd46799dc tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:09.058626 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-1bde19f8-b698-4c63-8f85-c3bdd46799dc tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:09.191247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-1bde19f8-b698-4c63-8f85-c3bdd46799dc tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:09.198942 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-1bde19f8-b698-4c63-8f85-c3bdd46799dc tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1314 microversion: 2.1 time: 0.153209 Jul 28 20:39:09.199509 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1653/3448] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:09 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:10.221728 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-562c988e-6f6f-41d4-bda8-16dd7f75aded tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:10.222419 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-562c988e-6f6f-41d4-bda8-16dd7f75aded tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:10.229449 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-562c988e-6f6f-41d4-bda8-16dd7f75aded tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:10.229893 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-562c988e-6f6f-41d4-bda8-16dd7f75aded tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:10.230632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-562c988e-6f6f-41d4-bda8-16dd7f75aded tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:10.231082 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-562c988e-6f6f-41d4-bda8-16dd7f75aded tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:10.364139 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-562c988e-6f6f-41d4-bda8-16dd7f75aded tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:10.372835 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-562c988e-6f6f-41d4-bda8-16dd7f75aded tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1314 microversion: 2.1 time: 0.155847 Jul 28 20:39:10.373390 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1796/3449] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:10 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:11.393776 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-9ecfe263-407a-4dfb-a7bd-4d52c222af18 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:11.394395 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-9ecfe263-407a-4dfb-a7bd-4d52c222af18 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:11.401391 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ecfe263-407a-4dfb-a7bd-4d52c222af18 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:11.401843 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ecfe263-407a-4dfb-a7bd-4d52c222af18 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:11.402595 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ecfe263-407a-4dfb-a7bd-4d52c222af18 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:11.403031 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-9ecfe263-407a-4dfb-a7bd-4d52c222af18 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:11.534257 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-9ecfe263-407a-4dfb-a7bd-4d52c222af18 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:11.542568 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-9ecfe263-407a-4dfb-a7bd-4d52c222af18 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1497 microversion: 2.1 time: 0.152949 Jul 28 20:39:11.543118 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1654/3450] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:11 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:12.027007 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-fdc1ac31-4ec3-42dc-a91b-6fa8c699a529 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:12.027519 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fdc1ac31-4ec3-42dc-a91b-6fa8c699a529 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:12.029935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:12.030577 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=6 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:12.036336 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdc1ac31-4ec3-42dc-a91b-6fa8c699a529 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:12.036800 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdc1ac31-4ec3-42dc-a91b-6fa8c699a529 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:12.037581 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdc1ac31-4ec3-42dc-a91b-6fa8c699a529 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:12.038030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-fdc1ac31-4ec3-42dc-a91b-6fa8c699a529 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:12.063335 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-fdc1ac31-4ec3-42dc-a91b-6fa8c699a529 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Going to try to terminate instance {{(pid=117969) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:39:12.139201 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-fdc1ac31-4ec3-42dc-a91b-6fa8c699a529 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 204 len: 0 microversion: 2.1 time: 0.115662 Jul 28 20:39:12.139768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1797/3451] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:39:12 2022] DELETE /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:39:12.148887 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5b311d9a-9687-42fa-b24d-e0ba4ecbc88e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:12.149492 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5b311d9a-9687-42fa-b24d-e0ba4ecbc88e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:12.151359 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=2 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:12.156703 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b311d9a-9687-42fa-b24d-e0ba4ecbc88e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:12.157146 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b311d9a-9687-42fa-b24d-e0ba4ecbc88e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:12.157891 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b311d9a-9687-42fa-b24d-e0ba4ecbc88e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:12.158317 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5b311d9a-9687-42fa-b24d-e0ba4ecbc88e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:12.449622 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5b311d9a-9687-42fa-b24d-e0ba4ecbc88e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:12.457213 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5b311d9a-9687-42fa-b24d-e0ba4ecbc88e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1503 microversion: 2.1 time: 0.312801 Jul 28 20:39:12.457773 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1655/3452] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:12 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:13.478749 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-34c7c7b4-ee9a-4b1b-8981-36179cd4f74f tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:13.479355 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-34c7c7b4-ee9a-4b1b-8981-36179cd4f74f tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:13.485848 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34c7c7b4-ee9a-4b1b-8981-36179cd4f74f tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:13.486296 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34c7c7b4-ee9a-4b1b-8981-36179cd4f74f tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:13.487043 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34c7c7b4-ee9a-4b1b-8981-36179cd4f74f tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:13.487473 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34c7c7b4-ee9a-4b1b-8981-36179cd4f74f tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:13.620361 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-34c7c7b4-ee9a-4b1b-8981-36179cd4f74f tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:13.627836 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-34c7c7b4-ee9a-4b1b-8981-36179cd4f74f tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1503 microversion: 2.1 time: 0.153527 Jul 28 20:39:13.628395 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1798/3453] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:13 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:14.152074 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-5c2d257e-0403-4b47-9668-d9f5f9fa1408 req-fd6eacd5-fd3c-400d-a900-2b7e80416a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7c636d1-a9b6-46a3-879b-0466ca9b06b0", "name": "network-vif-deleted", "tag": "99459c8a-a5ca-43cd-9cee-42c24032a043"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:39:14.164057 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-5c2d257e-0403-4b47-9668-d9f5f9fa1408 req-fd6eacd5-fd3c-400d-a900-2b7e80416a8f service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:14.164752 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-5c2d257e-0403-4b47-9668-d9f5f9fa1408 req-fd6eacd5-fd3c-400d-a900-2b7e80416a8f service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:14.185280 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-5c2d257e-0403-4b47-9668-d9f5f9fa1408 req-fd6eacd5-fd3c-400d-a900-2b7e80416a8f service nova] Creating event network-vif-deleted:99459c8a-a5ca-43cd-9cee-42c24032a043 for instance c7c636d1-a9b6-46a3-879b-0466ca9b06b0 on hv-cinder-85144 Jul 28 20:39:14.190546 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-5c2d257e-0403-4b47-9668-d9f5f9fa1408 req-fd6eacd5-fd3c-400d-a900-2b7e80416a8f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042104 Jul 28 20:39:14.191130 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1656/3454] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:39:14.650446 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:14.651165 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:14.658162 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:14.658589 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:14.659406 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:14.659837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:14.695772 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:14.696214 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:14.696692 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.objects.instance [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lazy-loading 'fault' on Instance uuid c7c636d1-a9b6-46a3-879b-0466ca9b06b0 {{(pid=117969) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:39:14.737854 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:14.745482 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6ed4d9e8-3a30-464a-935f-00b64660456a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 200 len: 1304 microversion: 2.1 time: 0.100011 Jul 28 20:39:14.746051 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1799/3455] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:14 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:15.769348 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:15.769953 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: c7c636d1-a9b6-46a3-879b-0466ca9b06b0] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:15.776909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:15.777379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:15.778134 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:15.778566 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:15.792408 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.wsgi [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] HTTP exception thrown: Instance c7c636d1-a9b6-46a3-879b-0466ca9b06b0 could not be found. Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Request method failure captured: Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: request: GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 HTTP/1.1 Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept: application/json Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Accept-Encoding: identity Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Connection: close Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Length: 0 Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Content-Type: application/json Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Host: 10.222.0.67 Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Openstack-System-Scope: None Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: User-Agent: python-urllib3/1.26.10 Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Auth-Token: gAAAAABi4vPjSxUw37rRU8Vbyz_pWJUtrEXO7qbJwbtCon2-jhGKEAkpN0SH2-xVFD7lIC3BnLH9aljqed1aj6mflPT9LINaal-owRXZNSYvdZjdHG1RxkAZzCYfQvGpDcABZ8DSVYYGOnRHaG-qJIYdvA-LrWsgWg07KfJV41hU6-upW9K87gU Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Id: None Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Domain-Name: None Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Identity-Status: Confirmed Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Is-Admin-Project: True Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Id: default Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Domain-Name: Default Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Id: 92f934b29b224cce936b6548b5d624a5 Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Project-Name: tempest-VolumesActionsTest-361522340 Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Role: reader,member Jul 28 20:39:15.794083 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Roles: reader,member Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/92f934b29b224cce936b6548b5d624a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/92f934b29b224cce936b6548b5d624a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/92f934b29b224cce936b6548b5d624a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_92f934b29b224cce936b6548b5d624a5"}]}] Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant: tempest-VolumesActionsTest-361522340 Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Id: 92f934b29b224cce936b6548b5d624a5 Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-Tenant-Name: tempest-VolumesActionsTest-361522340 Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User: tempest-VolumesActionsTest-361522340-project Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Id: default Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Domain-Name: Default Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Id: 1e308dccd1ec4cc1a43dfe1b051595b1 Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: X-User-Name: tempest-VolumesActionsTest-361522340-project Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: method: > Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: exception: Instance c7c636d1-a9b6-46a3-879b-0466ca9b06b0 could not be found. Jul 28 20:39:15.795442 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: action_args: {'id': 'c7c636d1-a9b6-46a3-879b-0466ca9b06b0'} Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7c636d1-a9b6-46a3-879b-0466ca9b06b0 could not be found. Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:39:15.796269 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7c636d1-a9b6-46a3-879b-0466ca9b06b0 could not be found. Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7c636d1-a9b6-46a3-879b-0466ca9b06b0 could not be found. Jul 28 20:39:15.797643 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: ERROR nova.api.openstack.wsgi Jul 28 20:39:15.798966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Returning 404 to user: Instance c7c636d1-a9b6-46a3-879b-0466ca9b06b0 could not be found. {{(pid=117968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:39:15.798966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-77d48934-d44a-43c6-84bb-d4c3435c4b05 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0" status: 404 len: 111 microversion: 2.1 time: 0.031191 Jul 28 20:39:15.798966 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1657/3456] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:15 2022] GET /compute/v2.1/servers/c7c636d1-a9b6-46a3-879b-0466ca9b06b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:39:15.844721 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1037044714", "imageRef": "200102d0-3aff-4f7e-9aae-64a536f12bf7", "flavorRef": "452", "networks": [{"uuid": "90e5dc59-9323-4fb9-bf92-f58b4bb3a1c1"}]}} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:39:15.898268 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.network.neutron [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] validate_networks() for [('90e5dc59-9323-4fb9-bf92-f58b4bb3a1c1', None, None, None, None, None)] {{(pid=117969) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 20:39:16.250045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Flavor limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 20:39:16.250461 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Image limits 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 20:39:16.250960 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Flavor pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 20:39:16.251365 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Image pref 0:0:0 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 20:39:16.251768 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.virt.hardware [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117969) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 20:39:16.260668 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:16.261106 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:16.261882 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:16.262304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:16.280177 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Getting quotas for project 92f934b29b224cce936b6548b5d624a5. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 20:39:16.284224 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.quota [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Getting quotas for user 1e308dccd1ec4cc1a43dfe1b051595b1 and project 92f934b29b224cce936b6548b5d624a5. Resources: {'instances', 'cores', 'ram'} {{(pid=117969) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 20:39:16.295898 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Going to run 1 instances... {{(pid=117969) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 20:39:16.298189 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='200102d0-3aff-4f7e-9aae-64a536f12bf7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117969) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 20:39:16.343155 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3cc66670-82be-428a-8a18-07861771aeb6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502279 Jul 28 20:39:16.343793 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1800/3457] 10.222.0.67 () {60 vars in 1147 bytes} [Thu Jul 28 20:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 20:39:16.355058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-f51e8bac-51e8-44f2-b6a3-7a9f8b1b27d9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:16.355704 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-f51e8bac-51e8-44f2-b6a3-7a9f8b1b27d9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:16.409217 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-f51e8bac-51e8-44f2-b6a3-7a9f8b1b27d9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:16.417170 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-f51e8bac-51e8-44f2-b6a3-7a9f8b1b27d9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1214 microversion: 2.1 time: 0.065962 Jul 28 20:39:16.417717 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1658/3458] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:16 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:17.439662 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-eefea65d-bee0-427f-b464-47240b88ccec tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:17.440278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-eefea65d-bee0-427f-b464-47240b88ccec tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:17.493101 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-eefea65d-bee0-427f-b464-47240b88ccec tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:17.499713 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-eefea65d-bee0-427f-b464-47240b88ccec tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1214 microversion: 2.1 time: 0.064490 Jul 28 20:39:17.500265 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1801/3459] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:17 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:18.520909 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e2c3cc5b-6b8c-4a17-9b51-b5670a23effe tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:18.521585 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e2c3cc5b-6b8c-4a17-9b51-b5670a23effe tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:18.576086 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e2c3cc5b-6b8c-4a17-9b51-b5670a23effe tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:18.583541 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e2c3cc5b-6b8c-4a17-9b51-b5670a23effe tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1214 microversion: 2.1 time: 0.066787 Jul 28 20:39:18.584088 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1659/3460] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:18 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:19.604737 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-620572ed-0afc-4f7d-a83d-8de41cb529a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:19.605340 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-620572ed-0afc-4f7d-a83d-8de41cb529a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:19.665850 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-620572ed-0afc-4f7d-a83d-8de41cb529a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:19.673053 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-620572ed-0afc-4f7d-a83d-8de41cb529a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1214 microversion: 2.1 time: 0.072130 Jul 28 20:39:19.673618 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1802/3461] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:19 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:20.694236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-82bec21a-7a80-4b3a-b294-d61a86ac1a89 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:20.694884 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-82bec21a-7a80-4b3a-b294-d61a86ac1a89 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:20.701576 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82bec21a-7a80-4b3a-b294-d61a86ac1a89 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:20.702028 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82bec21a-7a80-4b3a-b294-d61a86ac1a89 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:20.702790 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82bec21a-7a80-4b3a-b294-d61a86ac1a89 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:20.703226 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-82bec21a-7a80-4b3a-b294-d61a86ac1a89 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:20.764299 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-82bec21a-7a80-4b3a-b294-d61a86ac1a89 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:20.775310 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-82bec21a-7a80-4b3a-b294-d61a86ac1a89 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1218 microversion: 2.1 time: 0.083643 Jul 28 20:39:20.776385 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1660/3462] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:20 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:21.796945 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-3d262403-a388-4c6f-a9f1-30de93d8fe5e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:21.797547 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-3d262403-a388-4c6f-a9f1-30de93d8fe5e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:21.805278 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d262403-a388-4c6f-a9f1-30de93d8fe5e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:21.805968 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d262403-a388-4c6f-a9f1-30de93d8fe5e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:21.807030 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d262403-a388-4c6f-a9f1-30de93d8fe5e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:21.807648 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-3d262403-a388-4c6f-a9f1-30de93d8fe5e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:21.873944 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-3d262403-a388-4c6f-a9f1-30de93d8fe5e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:21.882251 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-3d262403-a388-4c6f-a9f1-30de93d8fe5e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1272 microversion: 2.1 time: 0.089333 Jul 28 20:39:21.882817 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1803/3463] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:21 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:22.903867 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-788c9415-a212-4b24-9936-91d902cd01e7 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:22.904565 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-788c9415-a212-4b24-9936-91d902cd01e7 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:22.911240 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-788c9415-a212-4b24-9936-91d902cd01e7 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:22.911688 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-788c9415-a212-4b24-9936-91d902cd01e7 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:22.913360 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-788c9415-a212-4b24-9936-91d902cd01e7 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:22.913675 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-788c9415-a212-4b24-9936-91d902cd01e7 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:23.036045 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-ac04e3c3-95f0-4e8c-83aa-815d366da88a req-08bf5164-844a-45ec-afbf-097edaa5de8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b", "tag": "219236f0-2ab3-4ac7-b94a-26de5ffa2da3"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:39:23.050947 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-ac04e3c3-95f0-4e8c-83aa-815d366da88a req-08bf5164-844a-45ec-afbf-097edaa5de8c service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:23.051378 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-ac04e3c3-95f0-4e8c-83aa-815d366da88a req-08bf5164-844a-45ec-afbf-097edaa5de8c service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:23.054233 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-788c9415-a212-4b24-9936-91d902cd01e7 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:23.062174 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-788c9415-a212-4b24-9936-91d902cd01e7 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1314 microversion: 2.1 time: 0.162093 Jul 28 20:39:23.062726 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1661/3464] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:22 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:23.066837 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-ac04e3c3-95f0-4e8c-83aa-815d366da88a req-08bf5164-844a-45ec-afbf-097edaa5de8c service nova] Creating event network-changed:219236f0-2ab3-4ac7-b94a-26de5ffa2da3 for instance ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b on hv-cinder-85144 Jul 28 20:39:23.072018 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-ac04e3c3-95f0-4e8c-83aa-815d366da88a req-08bf5164-844a-45ec-afbf-097edaa5de8c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041112 Jul 28 20:39:23.072632 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1804/3465] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:39:24.083081 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b6a2f33b-c3e4-48fd-9f96-a3b2f2eff896 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:24.083696 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b6a2f33b-c3e4-48fd-9f96-a3b2f2eff896 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:24.090262 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6a2f33b-c3e4-48fd-9f96-a3b2f2eff896 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:24.090711 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6a2f33b-c3e4-48fd-9f96-a3b2f2eff896 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:24.091467 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6a2f33b-c3e4-48fd-9f96-a3b2f2eff896 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:24.091898 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b6a2f33b-c3e4-48fd-9f96-a3b2f2eff896 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:24.226785 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-b6a2f33b-c3e4-48fd-9f96-a3b2f2eff896 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:24.234306 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b6a2f33b-c3e4-48fd-9f96-a3b2f2eff896 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1314 microversion: 2.1 time: 0.155036 Jul 28 20:39:24.234893 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1662/3466] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:24 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:25.257600 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-34490927-07cd-4e4e-ad5d-30d4243cf4b6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:25.258302 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-34490927-07cd-4e4e-ad5d-30d4243cf4b6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:25.264458 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34490927-07cd-4e4e-ad5d-30d4243cf4b6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:25.264935 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34490927-07cd-4e4e-ad5d-30d4243cf4b6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:25.265679 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34490927-07cd-4e4e-ad5d-30d4243cf4b6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:25.266107 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-34490927-07cd-4e4e-ad5d-30d4243cf4b6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:25.394724 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-34490927-07cd-4e4e-ad5d-30d4243cf4b6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:25.402969 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-34490927-07cd-4e4e-ad5d-30d4243cf4b6 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1314 microversion: 2.1 time: 0.151166 Jul 28 20:39:25.403532 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1805/3467] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:25 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:26.423780 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-e49ba5c7-449c-48dd-977b-ea205a3027a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:26.424315 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-e49ba5c7-449c-48dd-977b-ea205a3027a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:26.431698 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e49ba5c7-449c-48dd-977b-ea205a3027a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:26.432149 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e49ba5c7-449c-48dd-977b-ea205a3027a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:26.432937 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e49ba5c7-449c-48dd-977b-ea205a3027a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:26.433370 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-e49ba5c7-449c-48dd-977b-ea205a3027a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:26.777201 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-e49ba5c7-449c-48dd-977b-ea205a3027a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:26.784631 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-e49ba5c7-449c-48dd-977b-ea205a3027a0 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1314 microversion: 2.1 time: 0.364743 Jul 28 20:39:26.785247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1663/3468] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:26 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:27.807602 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6690b790-8cc1-466a-97f7-b4441822da57 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:27.808232 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6690b790-8cc1-466a-97f7-b4441822da57 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:27.810616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=2 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:27.816745 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6690b790-8cc1-466a-97f7-b4441822da57 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:27.817195 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6690b790-8cc1-466a-97f7-b4441822da57 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:27.817949 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6690b790-8cc1-466a-97f7-b4441822da57 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:27.818382 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6690b790-8cc1-466a-97f7-b4441822da57 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:27.956798 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6690b790-8cc1-466a-97f7-b4441822da57 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:27.964498 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6690b790-8cc1-466a-97f7-b4441822da57 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1314 microversion: 2.1 time: 0.161436 Jul 28 20:39:27.965090 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1806/3469] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:27 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:28.821373 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [req-09779db4-c999-4178-99ef-cbd85cde8e80 req-65ac6b38-dcb3-4bad-a6f3-a652a5f673a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b", "name": "network-vif-plugged", "status": "completed", "tag": "219236f0-2ab3-4ac7-b94a-26de5ffa2da3"}]} {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:39:28.826901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell0:SELECT=4 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:28.833290 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-09779db4-c999-4178-99ef-cbd85cde8e80 req-65ac6b38-dcb3-4bad-a6f3-a652a5f673a6 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:28.833811 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [req-09779db4-c999-4178-99ef-cbd85cde8e80 req-65ac6b38-dcb3-4bad-a6f3-a652a5f673a6 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:28.846800 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.compute.server_external_events [req-09779db4-c999-4178-99ef-cbd85cde8e80 req-65ac6b38-dcb3-4bad-a6f3-a652a5f673a6 service nova] Creating event network-vif-plugged:219236f0-2ab3-4ac7-b94a-26de5ffa2da3 for instance ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b on hv-cinder-85144 Jul 28 20:39:28.852082 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [req-09779db4-c999-4178-99ef-cbd85cde8e80 req-65ac6b38-dcb3-4bad-a6f3-a652a5f673a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035648 Jul 28 20:39:28.852729 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1664/3470] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 20:39:28.984342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-6ebd8093-f9b0-4f07-90d9-a05c15734473 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:28.985015 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-6ebd8093-f9b0-4f07-90d9-a05c15734473 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:28.991650 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ebd8093-f9b0-4f07-90d9-a05c15734473 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:28.992213 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ebd8093-f9b0-4f07-90d9-a05c15734473 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:28.993048 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ebd8093-f9b0-4f07-90d9-a05c15734473 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:28.993488 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-6ebd8093-f9b0-4f07-90d9-a05c15734473 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:29.128622 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-6ebd8093-f9b0-4f07-90d9-a05c15734473 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:29.142908 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-6ebd8093-f9b0-4f07-90d9-a05c15734473 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1314 microversion: 2.1 time: 0.162317 Jul 28 20:39:29.143477 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1807/3471] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:28 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:30.167458 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-5a66ab9e-b89b-40bb-b7b9-55f701134b23 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:30.177108 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-5a66ab9e-b89b-40bb-b7b9-55f701134b23 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:30.181610 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a66ab9e-b89b-40bb-b7b9-55f701134b23 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:30.182058 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a66ab9e-b89b-40bb-b7b9-55f701134b23 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:30.182838 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a66ab9e-b89b-40bb-b7b9-55f701134b23 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:30.183789 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-5a66ab9e-b89b-40bb-b7b9-55f701134b23 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:30.324818 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-5a66ab9e-b89b-40bb-b7b9-55f701134b23 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:30.332499 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-5a66ab9e-b89b-40bb-b7b9-55f701134b23 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1314 microversion: 2.1 time: 0.172189 Jul 28 20:39:30.333093 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1665/3472] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:30 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:31.353470 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-0ee0f144-6fa3-477c-95bf-b7accef1b936 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:31.354630 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-0ee0f144-6fa3-477c-95bf-b7accef1b936 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:31.356512 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell0:SELECT=10 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:31.362342 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ee0f144-6fa3-477c-95bf-b7accef1b936 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:31.362788 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ee0f144-6fa3-477c-95bf-b7accef1b936 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:31.363542 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ee0f144-6fa3-477c-95bf-b7accef1b936 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:31.363981 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-0ee0f144-6fa3-477c-95bf-b7accef1b936 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:31.502339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-0ee0f144-6fa3-477c-95bf-b7accef1b936 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:31.504552 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:31.512441 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-0ee0f144-6fa3-477c-95bf-b7accef1b936 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1498 microversion: 2.1 time: 0.163054 Jul 28 20:39:31.513070 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1808/3473] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:31 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:32.037836 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-b2c79789-69b1-4286-a39d-28e11b9428c5 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:32.038901 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b2c79789-69b1-4286-a39d-28e11b9428c5 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:32.041053 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_api:SELECT=41 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:32.046782 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2c79789-69b1-4286-a39d-28e11b9428c5 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:32.047259 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2c79789-69b1-4286-a39d-28e11b9428c5 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:32.048022 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2c79789-69b1-4286-a39d-28e11b9428c5 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:32.048452 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-b2c79789-69b1-4286-a39d-28e11b9428c5 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:32.051302 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG dbcounter [-] [117968] Writing DB stats nova_cell1:SELECT=73 {{(pid=117968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:32.074654 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-b2c79789-69b1-4286-a39d-28e11b9428c5 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Going to try to terminate instance {{(pid=117968) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 20:39:32.153444 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-b2c79789-69b1-4286-a39d-28e11b9428c5 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 204 len: 0 microversion: 2.1 time: 0.119125 Jul 28 20:39:32.154121 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1666/3474] 10.222.0.67 () {58 vars in 1239 bytes} [Thu Jul 28 20:39:32 2022] DELETE /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 20:39:32.163066 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-d16d31b9-6cc1-4089-ab24-2c568770fb6a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:32.164447 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-d16d31b9-6cc1-4089-ab24-2c568770fb6a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:32.166573 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG dbcounter [-] [117969] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 20:39:32.173138 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d16d31b9-6cc1-4089-ab24-2c568770fb6a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:32.173586 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d16d31b9-6cc1-4089-ab24-2c568770fb6a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:32.174354 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d16d31b9-6cc1-4089-ab24-2c568770fb6a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:32.174781 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-d16d31b9-6cc1-4089-ab24-2c568770fb6a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:32.310304 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.policy [None req-d16d31b9-6cc1-4089-ab24-2c568770fb6a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117969) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:32.318000 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-d16d31b9-6cc1-4089-ab24-2c568770fb6a tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1504 microversion: 2.1 time: 0.159295 Jul 28 20:39:32.318564 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1809/3475] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:32 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:33.340206 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-7ceeef21-6f2d-4d2c-8aca-b641f72fde7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:33.340928 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-7ceeef21-6f2d-4d2c-8aca-b641f72fde7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:33.347523 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ceeef21-6f2d-4d2c-8aca-b641f72fde7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:33.347968 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ceeef21-6f2d-4d2c-8aca-b641f72fde7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:33.348763 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ceeef21-6f2d-4d2c-8aca-b641f72fde7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:33.349190 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-7ceeef21-6f2d-4d2c-8aca-b641f72fde7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:33.482008 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-7ceeef21-6f2d-4d2c-8aca-b641f72fde7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:33.489695 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-7ceeef21-6f2d-4d2c-8aca-b641f72fde7e tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1504 microversion: 2.1 time: 0.153785 Jul 28 20:39:33.490247 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1667/3476] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:33 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:34.168894 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [req-56357e92-050d-4b34-a03e-ec6bb483c22d req-fb93e60e-3a24-48cf-87ed-ddbb2e3b3663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b", "name": "network-vif-deleted", "tag": "219236f0-2ab3-4ac7-b94a-26de5ffa2da3"}]} {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 20:39:34.181351 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-56357e92-050d-4b34-a03e-ec6bb483c22d req-fb93e60e-3a24-48cf-87ed-ddbb2e3b3663 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:34.181787 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [req-56357e92-050d-4b34-a03e-ec6bb483c22d req-fb93e60e-3a24-48cf-87ed-ddbb2e3b3663 service nova] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:34.193559 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.compute.server_external_events [req-56357e92-050d-4b34-a03e-ec6bb483c22d req-fb93e60e-3a24-48cf-87ed-ddbb2e3b3663 service nova] Creating event network-vif-deleted:219236f0-2ab3-4ac7-b94a-26de5ffa2da3 for instance ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b on hv-cinder-85144 Jul 28 20:39:34.199022 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [req-56357e92-050d-4b34-a03e-ec6bb483c22d req-fb93e60e-3a24-48cf-87ed-ddbb2e3b3663 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Jul 28 20:39:34.200023 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1810/3477] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jul 28 20:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 20:39:34.511766 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.api.openstack.wsgi [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:34.512375 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.compute.api [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117968) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:34.519112 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:34.519561 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:34.520316 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:34.520786 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:34.551506 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:34.551934 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG oslo_concurrency.lockutils [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:34.552379 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.objects.instance [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lazy-loading 'fault' on Instance uuid ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b {{(pid=117968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 20:39:34.596087 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: DEBUG nova.policy [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e308dccd1ec4cc1a43dfe1b051595b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92f934b29b224cce936b6548b5d624a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117968) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 20:39:34.604661 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO nova.api.openstack.requestlog [None req-dd2306de-de88-433f-a28d-bd3ac1cbccc9 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 200 len: 1304 microversion: 2.1 time: 0.096782 Jul 28 20:39:34.605236 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: [pid: 117968|app: 0|req: 1668/3478] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:34 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 20:39:35.626913 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Calling method '>' {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 20:39:35.627616 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.compute.api [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] [instance: ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b] Fetching instance by UUID {{(pid=117969) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 20:39:35.635122 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:35.635571 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:35.636339 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 20:39:35.636808 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG oslo_concurrency.lockutils [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Lock "4a45bd5e-a9aa-40c0-b86c-7b1b2576c347" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 20:39:35.650698 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.wsgi [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] HTTP exception thrown: Instance ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b could not be found. Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Request method failure captured: Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: request: GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b HTTP/1.1 Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept: application/json Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Accept-Encoding: identity Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Connection: close Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Length: 0 Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Content-Type: application/json Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Host: 10.222.0.67 Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Openstack-System-Scope: None Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: User-Agent: python-urllib3/1.26.10 Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Auth-Token: gAAAAABi4vPjSxUw37rRU8Vbyz_pWJUtrEXO7qbJwbtCon2-jhGKEAkpN0SH2-xVFD7lIC3BnLH9aljqed1aj6mflPT9LINaal-owRXZNSYvdZjdHG1RxkAZzCYfQvGpDcABZ8DSVYYGOnRHaG-qJIYdvA-LrWsgWg07KfJV41hU6-upW9K87gU Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Id: None Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Domain-Name: None Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Identity-Status: Confirmed Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Is-Admin-Project: True Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Id: default Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Domain-Name: Default Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Id: 92f934b29b224cce936b6548b5d624a5 Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Project-Name: tempest-VolumesActionsTest-361522340 Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Role: reader,member Jul 28 20:39:35.652306 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Roles: reader,member Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/92f934b29b224cce936b6548b5d624a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/92f934b29b224cce936b6548b5d624a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/92f934b29b224cce936b6548b5d624a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_92f934b29b224cce936b6548b5d624a5"}]}] Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant: tempest-VolumesActionsTest-361522340 Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Id: 92f934b29b224cce936b6548b5d624a5 Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-Tenant-Name: tempest-VolumesActionsTest-361522340 Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User: tempest-VolumesActionsTest-361522340-project Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Id: default Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Domain-Name: Default Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Id: 1e308dccd1ec4cc1a43dfe1b051595b1 Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: X-User-Name: tempest-VolumesActionsTest-361522340-project Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: method: > Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: exception: Instance ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b could not be found. Jul 28 20:39:35.653700 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: action_args: {'id': 'ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b'} Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: {{(pid=117969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b could not be found. Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 20:39:35.654478 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b could not be found. Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b could not be found. Jul 28 20:39:35.655703 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: ERROR nova.api.openstack.wsgi Jul 28 20:39:35.656797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: DEBUG nova.api.openstack.wsgi [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] Returning 404 to user: Instance ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b could not be found. {{(pid=117969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 20:39:35.656797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO nova.api.openstack.requestlog [None req-cd248306-f6fe-4857-a140-7461d738a520 tempest-VolumesActionsTest-361522340 tempest-VolumesActionsTest-361522340-project] 10.222.0.67 "GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b" status: 404 len: 111 microversion: 2.1 time: 0.031900 Jul 28 20:39:35.656797 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: [pid: 117969|app: 0|req: 1811/3479] 10.222.0.67 () {58 vars in 1236 bytes} [Thu Jul 28 20:39:35 2022] GET /compute/v2.1/servers/ccebb3c4-fc82-402d-a2e5-afa4c3f8fc7b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 20:40:08.343044 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:40:08.343707 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:41:25.848617 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:41:25.849189 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:41:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:41:52.095959 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:41:52.096629 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:41:58.637414 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:41:58.638031 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:42:08.002592 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:42:08.003248 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:42:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:42:10.292644 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:42:10.293229 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:42:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:43:28.350792 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:43:28.351384 dv-cinder-851449-1-iscsi devstack@n-api.service[117969]: Thu Jul 28 20:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 20:44:45.856250 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 20:44:45.856821 dv-cinder-851449-1-iscsi devstack@n-api.service[117968]: Thu Jul 28 20:44:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!